A new component that allows you to egress content from your Pipeline, as a Firehose!
A new integration to work with Socialgist Reddit has been released.
Within the Jobs screen within Portal you now have the ability to bulk cancel and delete jobs. If you have created a Job that you wish to cancel, you can cancel while it is running; and the Platform will handle cancelling it with the integrated source as quickly as possible. As close to an "undo" as possible!
The Custom Function component allows you to write Python functions to manipulate and transform documents within your pipeline. This flexibility enables you to perform a wide range of tasks, from simple data cleaning to merge documents.
Whether you're filtering documents, enriching data, or transforming formats, the Custom Function component empowers you to customize your pipeline to meet your specific needs.
Updates and refactoring of the underlying models for converting tables in PDFs into JSON has been released.
The Add-On estimator has been released from Early-Access to allow you to estimate the costs of many of the add-ons present in the platform.
View it in your Portal account here
Datastreamer has updated their pricing model to adjust to a single tier and include more into your platform cost!
You can now set email alerts to trigger on your budget milestones. Specify emails, amounts, and thresholds to get custom billing alerts.
Searchable Storage is a managed storage solution that can be used within a Pipeline to manage, deduplicate, store, and search content. As Pipelines focus on processing the data live, in-pipeline storage can offer a number of benefits.
We have updated our platform catalog to showcase the 35,000+ capabilities and combinations available with pre-built components.