Skip to main content

New Features

Index Compaction Task

A new compaction endpoint is now available for indexes. This task defragments the LMDB environment used by each index, which reduces fragmentation that accumulates over time. Indexes typically experience around 30% fragmentation, and compaction can provide significant performance improvements (2-4x speed-ups) in search and indexation operations. This is achieved by reordering LMDB internal pages and removing scattered free pages throughout the file, relocating content to the beginning for better cache efficiency.

Improvements

Parallelized Facet Post-Processing

Facet post-processing during indexation is now multi-threaded. Previously, iterating over index prefixes was done in a single-threaded loop, which was a bottleneck. This redesign delivers 4-6x performance improvements for facet-related operations.

Request UID Added to Search Routes

Search routes now include the request UID in responses, making it easier to track and correlate requests across your system. Find more information on GitHub