Monitored Search was a prequel to the Jobs system available. With the migration of all monitored search usage to Jobs, the functionality of Monitored searches has been retired.
As part of supporting customer's usage of queries with data sources, the Datastreamer team has released a "Query Builder" for select data sources.
This new option in some data sources is designed to help the creation of queries and reduce errors or validation issues. You can also switch between "Text" and "Builder" options to assist with complex query creation.
This initial release covers the Lucene-query sources of: Socialgist TikTok, Socialgist Reddit, WSL Instagram, WSL Threads, and Searchable Storage.
Screenshot of query builder in action.
Connect your pipelines with Fivetran's ETL with the new Fivetran Egress component.
This egress allows customers to leverage more data sources previously not able to be integrated le to Fivetran's ETL platform.
Official partnership announcement and release will arrive late in April 2025.
The Billing Dashboard within Portal has been updated to now show Searchable Storage billing, as well as show the automatic commits that may be triggered through usage of some data sources.
It is now possible to filter Vetric X content by 'date' or by 'date and time'.
Fixed an issue that may cause the Datastreamer Language Detection component to not run in some situations.
A bug was discovered that caused metadata to be lost that was required for upload. This impacted upload of data into some cloud storage egresses.
The team responded quickly and all pipelines affected received the update. No content was impacted or lost, due to the intelligent component caching.
In cases of Jobs failing due to 3rd party errors, the status of Jobs have been updated to show the error details provided from that 3rd party API. This will replace the showing "Failed" messages without description in these cases.
This initial improvement ensures that the "Bad Request" error messages from Vetric APIs are now being displayed when the Job fails.
When using provided components to ingress data through Jobs, the Platform will validate if the queries are valid. If the queries are not valid, the user be notified, and not able to save the Job. This will help ensure that data collection failures are proactively addressed, saving time and spend!
This release brings Lucene query validation to:
- WebSightLine Instagram
- WebSightLine Threads
- Socialgist TikTok
- Opoint News
Thank you for this feedback from our customers and users!
Our Datascience team has released a number of Recipes to provide starting templates for Custom Functions. You can copy/modify/tweak and use any of these Recipes within the Custom Functions capability released earlier this month.
These Recipes give you a quick way to add many in-Pipeline capabilities to do things like: detect urgency, sentiment analysis, text cleaning, extract links from content, and much more!
You can view all Recipes here: docs.datastreamer.io/recipes