33 lines
1.1 KiB
ReStructuredText
33 lines
1.1 KiB
ReStructuredText
FileSystem
|
|
==========
|
|
|
|
A pure file-system L2 adapter using async I/O (``aiofiles``). Each KV cache
|
|
object is stored as a raw ``.data`` file whose name encodes the full
|
|
``ObjectKey``. Does **not** require NIXL -- works on any POSIX file system.
|
|
|
|
**Required fields:**
|
|
|
|
- ``base_path``: Directory for storing KV cache files.
|
|
|
|
**Optional fields:**
|
|
|
|
- ``relative_tmp_dir``: Relative sub-directory for temporary files during
|
|
writes (atomic rename on completion).
|
|
- ``read_ahead_size``: Trigger file-system read-ahead by reading this many
|
|
bytes first (positive integer, optional).
|
|
- ``use_odirect``: ``true`` or ``false`` (default ``false``) -- bypass the
|
|
page cache via ``O_DIRECT``.
|
|
|
|
**Configuration examples:**
|
|
|
|
.. code-block:: bash
|
|
|
|
# Basic FS adapter
|
|
--l2-adapter '{"type": "fs", "base_path": "/data/lmcache/l2"}'
|
|
|
|
# With temp directory
|
|
--l2-adapter '{"type": "fs", "base_path": "/data/lmcache/l2", "relative_tmp_dir": ".tmp"}'
|
|
|
|
# With O_DIRECT for bypassing page cache
|
|
--l2-adapter '{"type": "fs", "base_path": "/data/lmcache/l2", "use_odirect": true}'
|