About Jobs

Jobs are tasks running inside Components to trigger collection, ingestion, and processing of information. Running as highly powerful services, they handle the scheduling, translation, error control, pagination, rate limit management, and other requirements of interacting with other data services.

Job management and creation can be done with both APIs and the Datastreamer Portal. Within Portal you can also see additional tools for bulk addition, cross-pipeline Jobs, and some analytics.

The other pages in this section dive into the specifics of Job management.