Local file system

Local file system mode is the simplest mode of retrieval and also provides the fastest response times for RPC calls.

In this mode, you host the CAR files locally as files on a file system. Depending on the epoch range you are wanting to support, this can require a very large amount of storage (~350TB as of Epoch 827).

You can also host the indexes locally for best performance or mix with some indexes locally and some remotely.

data/
  0/
    epoch-0.car
    epoch-0.cid
    epoch-0-bafy...-mainnet-cid-to-offset-and-size.index
    epoch-0-bafy...-mainnet-sig-exists.index
    gsfa/
      ...

Local Filesystem Example Configuration File

This is an example epoch 100 configuration that targets local files:

version: 1
epoch: 100
data:
  car:
    uri: /of1/100/epoch-100.car
indexes:
  cid_to_offset_and_size:
    uri: /of1/100/epoch-100-bafyreibqt2nvroysxlxctgb52xxn27ectsllv2xyka4qar7ga6vupmbs3i-mainnet-cid-to-offset-and-size.index
  slot_to_cid:
    uri: /of1/100/epoch-100-bafyreibqt2nvroysxlxctgb52xxn27ectsllv2xyka4qar7ga6vupmbs3i-mainnet-slot-to-cid.index
  sig_to_cid:
    uri: /of1/100/epoch-100-bafyreibqt2nvroysxlxctgb52xxn27ectsllv2xyka4qar7ga6vupmbs3i-mainnet-sig-to-cid.index
  sig_exists:
    uri: /of1/100/epoch-100-bafyreibqt2nvroysxlxctgb52xxn27ectsllv2xyka4qar7ga6vupmbs3i-mainnet-sig-exists.index

Be aware that a full local clone of the OF1 genesis archive runs in multiple 100s of TB.

Split retrievals

If your file system or network file system store does not like serving large files, you can configure split retrievals for the local file system in the same way they work for HTTP retrievals.