Socialgist Collection Jobs

🚧

Have you registered your token?

If you have registered your Socialgist Token in the Datastreamer platform, proceed to step 3. If not, begin at step 1.

1. Adding the Access Token from Socialgist

To get started with Socialgist, you will first need to have an access token from Socialgist (please contact us if you don’t already have one). You can do this by going to the "Keys & Secrets" page within Portal. <https://portal.datastreamer.io/myapikeys>.

2. Navigating to your Pipeline

Within your Pipeline, select a new ingress, and choose a Socialgist source. Select "Configure".

3. Configuring Socialgist Component

Below is an example screenshot of a Socialgist component that has been configured. Optional fields do not need to be filled, but are great for adding additional clarity. There are three main sections:

1. Node Properties: This is how the node will appear in the Pipeline viewer.
2. Component Properties: This is where we will choose the authorization from step 1.
3. New Job: The component will prompt for the creation of an initial job. You can specify your query, and add any additional steps. A label is also useful for adding metadata to separate the results coming from different jobs.

📘

Periodic Jobs

Periodic jobs running on a recurring basis that you can set. Timeframes are selectable from hourly to every 7 days. When a Job is saved, it will wait the defined timeframe before running and searching for data since last run. It will then continue to run on that periodic timeframe.

4. Saving

Pipeline Job is now ready to go! You can add additional jobs from this screen at any time. Once this Pipeline is deployed with these latest changes, your tasks will being processing automatically. You also can add new jobs at any time within needing to add additional pipelines.

👍

You are all set!

If you want to explore with a sample source before diving into production usage, try out these sample sources: https://docs.datastreamer.io/docs/sample-sources.