Updates have been released to the collation capabilities within both the Profile Fetcher and File Fetcher from WebSightLine. The collation and combination of messages and of files are clearly distinguished and simplified to prevent confusion in the user experience.

Exorde Labs has now partnered with Datastreamer to make available their data sources in streaming or search API ingress methods. With over 2.5 billion social media posts collected each month, their coverage of many sources is a powerful addition.

The Exorde data components are able to use as integrated sources in pipelines now.

You can now consume messages into your Pipelines, running on Datastreamer, using Kafka. This new component leverages the full infrastructure power of Datastreamer to consume high-volume social and web feeds.

The new Portal homepage brings together key information from across billing, pipelines, jobs, and logging into a central view. You can see this new Portal homepage when you login to your account.

A number of fixes and improvements have been released in the last few days, including:

• A compatibility fix with the Bright Data ingress components increases their performance and error handling.
• Profile Fetcher has received improvements in it's ability to handle large files and extended requests.
• Data365 ingress components have additional compatibility supports to handle long-running Jobs and high concurrent volumes that may have otherwise exceeded rate limits.

The new "Influence Classification" enrichment estimates the influence of a social media posts. Created by the Datastreamer data science team, it works to provide predictions of the future rearch, impressions, and engagements scores. It does this by analyzing text, time features, profile features and extracted data

Read more: https://docs.datastreamer.io/docs/influence-classification#/

Fixes have been released for:

• Rare error messages preventing the opening of a pipeline.
• Components later down the pipeline no longer flag earlier pipelines as having errors, when they are simply waiting.
• Email fields in alerts no longer require saving each email individually.
• Removed typo from the Lucene examples in component descriptions.

This new major update solves the issue of selecting and integrating the right provider for outcome-focused companies hosting their pipelines on Datastreamer.

"Auto" source selection is available for many major data categories, and handles the selection and ingestion of web and social data! Selecting "Auto" components offloads to the platform to select the premium 3rd party data source provider best fit for the query, and with the highest reliability based on current demand.

Using the "Auto" source selection components for any data source simplifies the process of selecting, testing, maintaining, and migrating between various providers.

Organizations who are already running their web and social pipelines on Datastreamer have already seen the benefits of: Unify (data normalization), Jobs (integrated query running and management), and a centralized usage and billing system. Now, with "Auto", the flexibility and reliability of data ingestion has gone to a new level, and is something uniquely possible only for pipelines running on Datastreamer

For more information on this new capability feature: Read More

For non-integrated sources, the reporting of used metrics was not available. With this update, we are starting to add usage metrics from various vendors inside the Job metrics.

In this first release, Jobs using Data365 will return the number of DVUs in the usage endpoints.

For more information on the Jobs Count API, Click Here

The billing dashboard within Portal has been improved to show clearer breakdowns of daily data volume costs within the platform. With this improvement, you can easily see (and filter) to the specific elements leading to your total costs.

This has also been applied to historical data available in the billing platform.

Learn more about the Billing Dashboard, Cost Explorer, and other billing support tools. More Info