Tuning
Spider has many tuning handles to adapt its deployment to match your needs.
You may, straight from configuration:
- Adjust the Elasticsearch cluster for speed, high availability, retention size or time
- Adjust Redis pods to your load
- Adjust services replicas for load or high availability
- Adjust Whisperers to filter unwanted capture to limit load and volume
- Adjust Whisperers to absorb more load
There are many possible use cases of Spider, and this guide can't guess them all.
But we are going to see what configuration features you should use to tune Spider depending on your need.
- Tune to control retention volume
- Tune for high capture load
- Tune for search speed
- Tune for high availability