Understanding and Optimizing Your Datastreamer Usage
This guide outlines the best practices to optimization of costs at various levels of usage.
Usage-based pricing means direct price to value. It also means that it is important for you to:
- Predict and forecast usage.
- Ensure your data volumes fit within your budget.
- Take advantage of Pipeline capabilities to optimize value for dollar.
Below are a number of tips to help you understand and optimize your usage using Datastreamer.
Tip 1: Integrate the right sources and enrichments for the use case
With your pipelines are running on Datastreamer, you are not vendor-locked to any specific data source provider, model, or enrichments within your data workflows.
By using the right combination of sources, you can use multiple providers even within the same data stream. This allows you to increase functionality while managing latency, costs, and coverage requirements. Selecting the right providers for a query can be set as part of your workflow, or automated using Auto Sources.
Potential Savings: 20-60%
Tip 2: Pre-commit to usage volumes to take advantage of volume discounts.
The more you use different data sources, enrichments, and your pipelines, the more you can save. Unit costs (measured in Data Volume Units) can decrease as your volumes increase if you pre-commit to an expected volume in that month.
Not only does this decrease your additional usage, but it also discounts all your usage up to that commitment. For example, with the platform costs alone:
| Increase in Volume | Posts per month | Unit Cost (per 100 Posts) | Cost Savings |
|---|---|---|---|
| 1x | 500,000 | 0.12 | - |
| 2x | 1,000,000 | 0.094 | 22% Savings |
| 100x | 5,000,000 | 0.057 | 53% Savings |
| 1000x | 500,000,000 | 0.013 | 90% Savings |
You can apply commits of different levels to different sources, enrichments, and platform elements; allowing you to right-size your cost optimizations.
Potential Savings: Up to 90%
Tip 3. Use Job Tagging To Get Detailed Cost Data
Tip 4: Use the Add-On Estimator to plan your usage and your costs.
Tip 5: Use filtering and pipeline workflow design to optimize processing costs.
Tip 6: Set budget alerts and volume notifications.
Tip 7: Take advantage of the monthly volume flexibility
Tip 8: Leverage Auto Sources Low Entry Point for Testing or Low Volumes
Answering Common Myths
"I need to get my data sources from Datastreamer's ecosystem" FALSE
"More components = More Cost." FALSE
"More complex pipelines = More Cost." FALSE
"I'll need to overlap spend in any migration." FALSE
Updated 1 day ago