Create Your First Pipeline

1. Create a Datastreamer account if you don't already have one.
2. (Optional) Some partner sources can require an API Key, which can be requested from our support [email protected] if needed.
3. Create a pipeline and add the Ingress component.
4. (Optional) Add your API key using the configuration section or by accessing the portal's Keys & Secrets page.
5. (Optional) Add a Unify Schema component as the second step in your pipeline is recommended. This optional component standardizes formats across multiple data sources, simplifying the addition of enrichment operations.
6. Define the destination of your data, you can choose from various egress options.

   💡

   Tip: Document Inspector

   The Document Inspector is a great start to explore content.

7. Save your pipeline to ensure all pipeline settings are recorded
8. Deploy your pipeline, clicking on the Deploy button and your pipeline will be created with all the dependencies needed. This operation should take a few seconds. More details on Deployment & Versioning.
9. Run your queries by creating Jobs to execute and monitor the results, either through the Portal UI or API (more details on Using Jobs).