Opoint News
Provides a historical view into public international news content
Opoint News Search (provided by Opoint Media) provides a view into public international news content. The component is fully integrated with Opoint News Search API.
New to Datastreamer? Start here.
Unify SchemaThis data source already use Unify Schema.
API Key
You will need a Opoint API key to use this component. If you don't have one reach out to [email protected] and our team will help you with that.
How to use?
The Opoint News Search is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.
Search Queries
Filter
Available filters for Opoint News Search can be found in the table below:
| Filter Name | Description |
|---|---|
| documents_per_page | Controls the number of documents fetched per API request (pagination). |
| documents_per_message | Controls the number of documents included in a single batch when sending data to the next stage in the pipeline. |
| query | List of keywords or a phrase to search |
| max_documents | Set a limit for the number of posts that will be fetched for the search. |
The Lucene Query is supported for this component in the query field. Here are some of the basics queries that you can try:
Keywords
spotify
Phrases:
'Michael Jordan'
Wildcard:
Michae*
Proximity:
'Trump Biden'~5
Fields:
header:'Trump Biden'~5
header:tax lang:en
Boolean expressions:
football AND (url:theguardian.com OR url:bbc.com)
You can find more examples in the official documentation.
Examples
Search for cats or dogs
Query cats or dogs every 2 days:
Using the API, you can use the Code button to extract this example:
curl --location 'https://api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
--header 'apikey: <your-api-key>' \
--header 'Content-Type: application/json' \
--data \
'{
"job_name": "{JOB_NAME}",
"data_source": "opoint_news",
"query": {
"query_string": "cats OR dogs"
},
"job_type": "periodic",
"schedule": "0 0 0 1/2 * ? *",
"max_documents": 50
}'
For more details on creating data collection jobs, see Job Management.
Additional Details
Compatible Metadata Fields
| Applicable Metadata Categories | Compatible |
|---|---|
| Source | Yes |
| Content | Yes |
| Author | Yes |
| Person | No |
| Enrichment | Yes |
| Organization | No |
| Data source-specific fields? | Yes, please see the Metadata page. |
Updated 19 days ago
