Apify Setup Guide

How to integrate Apify actors to your Datastreamer pipelines.

Apify is a comprehensive cloud-based platform designed for large-scale web scraping, data extraction, and browser automation.

How to connect Apify to Datastreamer

To use the Apify Actor Integrations within your Datastreamer platform, you will need an Apify account.

1. Get your API key from the Apify platform settings

Once you create your Apify account, you need you Apify API token. To get the Apify API token, navigate to Settings > API & Integrations in the Apify Console.

Apify settings page

2. Add your Apify API key to the Datastreamer platform's Secrets

Click the Copy icon next to your API token to copy it to your clipboard. Then, return to Datastreamer's Portal screen.

Under Keys & Secrets, add your Apify API key as its' own secret.

Screenshot of the Keys & Secrets screen within Datastreamer's Portal UI

3. Use your Apify API key in Component configuration within your pipeline

Within your Pipeline, when you add an Apify Actor Integration component into your pipeline, you can select the secret key within the component configuration.