2024.04.22-2 Release Note
· 6 min read
April release comes with 2 major features:
- Public Links
- Data Store Policies
Upgrade risk
warning
- No API breaking changes 👍
- ⚠ Compatibility issue
- Requires helm chart version 3.0
- Indices lifecycle definitions needs to be adjusted with new values
- ⚠ Data loss
- Existing index for Links service is migrated from a time based index to a static one.
- Existing data (links) are lost.
Key changes
How to upgrade
- Pull new Helm chart
3.0
from repository - Adjust
global.version
field value to2024.04.22-2
in your values.yaml - Transform the
global.elasticsearch.stores.operations
key in your value file to thestreamedData
anduploadedData
structures to define various Data Storage Policies. See Elasticsearch indices setup - Deploy
- Migration of Links index will be performed automatically, as well as removal of existing template and indices.
- Creation of new Data Storage Policies ILMs templates and indices will be done automatically.
- Previous data will still be accessible, and their current indices will be removed at their end of TTL.
tip
See Reference documentation for details.
Versions
Spider
New versions of Spider components:
Component | Version | Docker tag |
---|---|---|
Helm chart | 3.0 | - |
Analysis UI | 10.6.1 | 2024.04.22-2 |
Controllers | 1.2 | 2024.04.22-2 |
Whisperers | 6.1 | 2024.04.22-2 |
Back office | - | 2024.04.22-2 |
Login UI | - | 2024.04.22-2 |
Monitoring UI | - | 2024.04.22-2 |
Dependencies
These components are set up in the correct versions by the Helm chart:
Dependency | Version | Docker tag |
---|---|---|
Elastic stack | 7.17.4 | 7.17.4 |
Redis | 7 | 7-alpine |
Traefik | 2.11 | 2.11 |
Compatibility
Spider has been successfully tested under these versions of dependencies:
3rd party software | Version |
---|---|
Helm | 3.14 |
Kube | 1.24 - 1.28 |
List of changes
Helm chart
✨ New features |
|
---|---|
⚙️ Improvements |
|
🐞 Bug fixes |
Analysis UI
✨ New features |
|
---|---|
⚙️ Improvements |
|
🐞 Bug fixes |
|
Controllers
✨ New features | |
---|---|
⚙️ Improvements | |
🐞 Bug fixes |
Whisperers
✨ New features | |
---|---|
⚙️ Improvements | |
🐞 Bug fixes |
Back office
✨ New features |
|
---|---|
⚙️ Improvements |
|
🐞 Bug fixes |
|
Login UI
✨ New features |
|
---|---|
⚙️ Improvements | |
🐞 Bug fixes |
Monitoring UI
✨ New features |
|
---|---|
⚙️ Improvements |
|
🐞 Bug fixes |
Online documentation
- Public Links manual
- Data storage policies configuration
API impacts
note
This section informs about any impact on Spider API, so you may adjust your scripts.
- New Public Links APIs
- New Public Link schema
- Updated API descriptions for Search and Get APIs of
- Hosts
- Web-Read
- Tcp-Read
- Pack-Read
- Customers
- Whisps-Status
Data impacts
note
The table below tells if there are data mapping changes in Elasticsearch indices, associated or not with migrations (Yes ✅ / No ❌).
Migration are automated at upgrade time, but they may leave unattended indices that you have to remove manually.
Index | Description | Migration |
---|---|---|
spider-link-2024.0*.*-0* | Time based indices for links deleted | ❌ |
spider-link-2023-03-31 | New static index to store links | |
spider-{dataset}-{upload|streaming}-{dsp} | New indices created by DSP settings |