Skip to main content

Indexer configuration

note

The advice on this page only applies to the index-in-place storage mode.

Configure the indexer​

The indexer reads metadata from recordings in your configured buckets and uploads that index to Foxglove.

When a file is uploaded to a bucket, the indexer:

  1. Reads the file's summary section (a small portion of the recording)
  2. Extracts metadata such as timestamps, topics, and schemas
  3. Uploads this index to Foxglove for search and playback

Since the indexer only reads a small part of each recording and doesn't perform CPU-intensive operations, you generally don't need to scale it out. In most cases, the default configuration works well.

Concurrency​

By default, the indexer processes multiple files in parallel. You can adjust the degree of concurrency in your Helm values file:

indexer:
  deployment:
    env:
      - name: MAX_CONCURRENCY
        # Defaults to 4
        value: "16"

Increase this value if you have a large backlog of files to index. Decrease it if you're experiencing rate-limit errors from your storage provider.