Jetstreamer
One of the best and easier ways to get started using Old Faithful archive is to use Jetstreamer client developed by Anza. It's optimized to pull data directly from the archive (no storage requirements) at very high throughput allowing you to perform a full ingest within days.
Jetstreamer can stream the data to any geyser plugin, Clickhouse or you can write your own jetstream plugin for everything else.
Keep in mind the CAR file archive is physically stored in Amsterdam, run from nearby for best results.
See the repo to get started https://github.com/anza-xyz/jetstreamer
Last updated