Hey, thank you for this great library! I've been using it in one of my projects for a while.
The one missing feature I'd really love to see is being able to use a filter directly from file storage, without the need to load it into RAM first.
My filter file (cbor) has currently a size of about 10 GiB, and keeping all this in RAM for the occasional query (maybe once a second) is unnecessarily heavy on resources. Luckily, linux already does the right thing by shoving all of this into swap space quickly, but it still requires the memory to be available when starting, enough idle swap space, and of course takes a fair amount of time to load the entire filter into memory on startup.
Querying the filter from storage instead of memory, possibly in a read-only mode (I don't care about create/update), would be a nice feature.
Hey, thank you for this great library! I've been using it in one of my projects for a while.
The one missing feature I'd really love to see is being able to use a filter directly from file storage, without the need to load it into RAM first.
My filter file (cbor) has currently a size of about 10 GiB, and keeping all this in RAM for the occasional query (maybe once a second) is unnecessarily heavy on resources. Luckily, linux already does the right thing by shoving all of this into swap space quickly, but it still requires the memory to be available when starting, enough idle swap space, and of course takes a fair amount of time to load the entire filter into memory on startup.
Querying the filter from storage instead of memory, possibly in a read-only mode (I don't care about create/update), would be a nice feature.