🎯 Platform FAQs

Here are some of the most common questions we hear!

What are my new Pipelines capable of?

The Datastreamer platform can power Pipeline capable of ingesting more content per second than there are Google searches!

With our Component-based architecture and ability to create Dynamic Pipelines, products that use Datastreamer's platform are able to ship faster, cheaper, and expand their capabilities easier.

The Datastreamer platform was designed from the DNA of real-time threat intelligence expertise. It was crafted to handle the complexities and volumes of semi-structured web data at high-volumes with low latency. πŸ’ͺ


How do my new Pipelines scale?

While the Pipelines themselves are more of a set of directions, the Components that are part of the Pipelines do auto-scale! Our operations teams built a powerful underlying systems which non-stop monitors the requirements of the different Components and scales-up/down within seconds. It also helps us keep the costs flexible.

This is also part of why pricing is based on usage and flexible between months!


What are "Add-Ons"?

Add-Ons are additional capabilities that you can add to your Pipelines, which go beyond the included capabilities. These "Add-Ons" are most often coming from an entire marketplace of partners and providers. They include ML models, LLMs, data sources, scraping network, and even BI platforms.


What is included in the Platform's cost?

The Platform's pricing include everything you need to craft and run your Pipelines.

  • Unlimited pipelines, unlimited users, unlimited integrations.
  • Data management capabilities like: Unify, schema transformations, batching, logging, etc.
  • Data collection automation tools: like the Job system, and also pre-built integrations to hundreds of data source APIs
  • Pipeline creation and management tools: deployment, auto-scaling and recovery, budget management, integration alerting, pipeline and component metrics, version controls, etc.

What is not included? Premium data sources and operations.

πŸ“˜

Pricing Details

You can view the pricing details and a complete list of included capabilities on the site at https://datastreamer.io/pricing/.


Can I bring my own...?

A key part of the Datastreamer platform is the ability to integrate seamlessly with what you are using today. It is quite common for customers' pipelines to include the following (and is encouraged):

  • Their own data sources
  • Their own API keys for sources they want to connect
  • Their own models they want to integrate with.
  • Their own Schemas and delivery criteria.
  • Their own egress and database requirements.

What’s Next

The "Security & Compliance" section has many other overviews diving into security and compliance FAQs.