Index storage

The index being built is stored according to configured backend (either S3 or local storage).

Note

Currently, only local storage is supported. S3 support will be added in future releases.

On the disk, index consist of several files:

1. meta.json contains meta information about index, including what kind of objects are indexed.

2. index.dat binary data of the index.

3. ids.dat ordered list of identifiers of objects in the index.

Each index has unique name, and it is used as key/folder name.

Warning

Indices can take a lot of disk space, so you need to calculate both the disk and the network performance.