Get Started

Socialgist News

The News Search Web Service from Socialgist allows you to search for news posts.

This source can be integrated with our Jobs feature and you can also use our Unify Transformer.

The complete Socialgist documentation about their endpoint can be found in their site here.

Portal

To integrate Socialgist News using our Portal, navigate to 'Dynamic Pipelines', create your Pipeline and select Socialgist News Ingress in the Component Picker, configure your query and settings, then add to your Pipeline.

API

Below you can find some examples about how the Datastreamer API empowers you to build efficient data orchestration using our Socialgist partner.

Creating Data Collection Job

This request configures a new data collection job within your platform. It specifies to pull company news from CNN's (cnn.com) website in the United States (US), in English (en). The job will run daily at 1 AM (every 24 hours).

curl --location 'https://api.platform.datastreamer.io/api/pipelines/<your-pipeline-id>/components/<your-component-id>/jobs?ready=true' \
      --header 'apikey: <your-api-key>' \
      --header 'Content-Type: application/json' \
      --data \
        '{
          "job_name": "<job-name>",
          "data_source": "socialgist_news",
          "query": {
            "query": "company",
            "country": "US",
            "language": "en",
            "domain": "cnn.com"
          },
          "job_type": "periodic",
          "schedule": "0 0 0 1/1 * ? *"
        }'