Data365 X (Twitter) Keywords
This component enables real-time and historical data collection of X (Twitter) content based on keywords.
Documentation Accuracy
We try to ensure every component documentation is as accurate as possible. However as we do not manage 3rd parties product features and documentation, some 3rd party documentation may not be accurate at the time of the last update. Thank you for your understanding.
Use the Data365 X (Twitter) Keywords component to query the most recent X (Twitter) posts easily.
The component is fully integrated with Data365 Twitter API.
New to Datastreamer? Start here.
Unify Schema
This data source is supported by Unify Schema
API Key
You will need a Data365 API key to use this component. If you don't have one reach out to [email protected] and our team will help you with that.
How To Use?
The Data365 Facebook Keyword is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.
Search Query
Data365 X (Twitter) API keywords search query accepts a list of keywords or phrases to search. It also accepts logical operators like (AND, OR) and stop-words.
About the length
Maximum allowed length of keywords string is 400 characters
For more details on supported search operators, see Data365 Twitter API
Filters
| Filter Name | Description |
|---|---|
| query | Supports Language and logical operators (AND, OR, etc). Limited to 400 characters in total length. A syntax validation is applied in the query, to guarantee that the query is correct. |
| query_from | Filter dates from/since - Example '2024-05-01T00:00:00Z' |
| query_to | Filter dates to - Example '2024-08-01T00:00:00Z' |
| max_documents | The maximum number of documents to be returned. Due to the asynchronous nature of pipelines this is a soft limit and more documents may be returned. The maximum quantity of posts retrieved is 20,000 posts per query. |
Cats or dogs:
cats OR dogsExactly cats OR dogs
"cats" OR "dogs"Exactly phrase
"happy hour"Cats and no dogs
cats -"dogs"Cats and English language (list of supported language codes):
("cats") lang:enYou can found a more complete list of query examples in the Data365 documentation.
Examples
Query cats or dogs from December 1st, 2024 to January 1st, 2024.
You also have the option to use the API, use the Code button to extract this example.
curl --location 'https: //api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
--header 'apikey: <your-api-key>' \
--header 'Content-Type: application/json' \
--data \
'{
"job_name": "my twitter data collection",
"data_source": "data365_twitter_keywords",
"from": "2023-10-01",
"to": "2023-10-02",
"query": {
"query": "cats OR dogs"
},
"job_type": "oneTime"
}'For more details on creating data collection jobs, see Job Management
Additional Details
Metadata Example
{
"data_source": "data365_twitter_keywords",
"meta_data": {
"job_label": "job-label",
"job_id": "job-id"
},
"id": "1704492629574991926",
"doc_date": "2023-09-20T13:48:05.000",
"twitter": {
"user_id": "134198871",
"post_identifier": "1704492629574991926",
"quote_count": 0,
"reply_count": 0,
"retweet_count": 0,
"tweet_type": "POST",
"retweet_type": "NONE"
},
"author": {
"handle": "bikulmishra",
"url": "https://twitter.com/bikulmishra"
},
"content": {
"links": [
"https://youtu.be/jMpiBeDq-jY"
],
"published": "2023-09-20T13:48:05.000",
"favorites": 0,
"body": "TTOO Stock - T2 Biosystems Inc Stock Breaking News Today | TTOO Stock Price Prediction | TTOO Stock Target $183USD. Watch The Video Now.\nhttps://t.co/Ug9TLL09T2",
"found": "2023-09-22T04:51:17.000Z",
"found_by": "c557fdc5-2581-4597-bb65-30049e6c6164",
"likes_count": 0
},
"enrichment": {
"language": "en"
},
"source": {
"link": "https://twitter.com/bikulmishra/status/1704492629574991926"
}
}Updated 9 days ago