Talkwalker Search

📘
Documentation Accuracy
We try to ensure every component documentation is as accurate as possible. However as we do not manage 3rd parties product features and documentation, some discrepancies could appear.

The Talkwalker Search (provided by Talkwalker) provides access to Talkwalker's social listening and analytics platform, enabling continuous ingestion of monitored content into your Datastreamer pipeline.

The complete Talkwalker documentation about their Search API can be found on their site here.

New to Datastreamer? Start here.

👍
Unify Schema
This data source already uses Unify Schema.

How To Use?

The component is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.

Search Query

Filters

Filter Name	Description
query	Search query with keywords.
project_id	The Talkwalker project ID (UUID). Required to identify which project to pull data from.
topic	The Talkwalker topic ID to pull documents from.
time_range	Relative time range filter. Format: number + time unit (e.g., `1h` for 1 hour, `1d` for 1 day, `7d` for 7 days).
sort_by	Field used to sort results. Default: `published` (Published Date).
sort_order	Sort direction. Default: `desc` (Descending — newest first).
max_documents	Set a limit for the number of documents that will be fetched for the search. This is a soft limit; actual results may exceed this value up to the next full page boundary.
hits_per_page	Number of results returned per page from the Talkwalker API. Default: `100`. Cannot exceed 500.

Examples

Search for 'government'

You also have the option to use the API. You can use the Code button to extract this example:

curl --location 'https://api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
      --header 'apikey: <your-api-key>' \
      --header 'Content-Type: application/json' \
      --data \
        '{
  				"job_name": "{JOB_NAME}", 
					"component_name": "talkwalker-search-ingress",
          "data_source": "talkwalker_search",
          "query": {
            "query_string": "government",
            "project_id": "ff7de11b-7129-41ce-8a78-182bf55a219c",
            "topic": "50b4f2a4_8c9517cf3eba1",
            "time_range": "7d",
            "sort_by": "published",
            "sort_order": "desc",
            "hpp": 100
          },
          "job_type": "oneTime",
          "max_documents": 10
        }'

For more details on creating data collection jobs, see Job Management.