Guides
Guides
Get Started

Data365 X (Twitter) Keywords

This component enables real-time and historical data collection of X (Twitter) content based on keywords.

Suggest Edits

Use the Data365 X (Twitter) Keywords component to query the most recent X (Twitter) posts easily.

The component is fully integrated with Data365 Twitter API.

New to Datastreamer? Start here.

👍

Unify Schema

This data source is supported by Unify Schema

API Key

You will need a Data365 API key to use this component. If you don't have one reach out to [email protected] and our team will help you with that.

How To Use?

The Data365 Facebook Keyword is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.

Search Query

Data365 X (Twitter) API keywords search query accepts a list of keywords or phrases to search. It also accepts logical operators like (AND, OR) and stop-words.

🚧

About the length

Maximum allowed length of keywords string is 400 characters

For more details on supported search operators, see Data365 Twitter API

Filters

Filter NameDescription
querySupports Language and logical operators (AND, OR). Limited to 400 characters in total length
query_fromFilter dates from/since - Example '2024-05-01T00:00:00Z'
query_toFilter dates to - Example '2024-08-01T00:00:00Z'
max_documentsThe maximum number of documents to be returned. Due to the asynchronous nature of pipelines this is a soft limit and more documents may be returned. The maximum quantity of posts retrieved is 20,000 posts per query.

Cats or dogs:

cats OR dogs

Exactly cats OR dogs

"cats" OR "dogs"

Cats and no dogs

cats -\"dogs\"

Cats and English language

((\"cats\") lang:en)

List of Supported Language Codes.

Examples

Query cats or dogs from December 1st, 2024 to January 1st, 2024.


You also have the option to use the API, use the Code button to extract this example.

curl --location 'https: //api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
      --header 'apikey: <your-api-key>' \
      --header 'Content-Type: application/json' \
      --data \
        '{
            "job_name": "my twitter data collection",
            "data_source": "data365_twitter_keywords",
            "from": "2023-10-01",
            "to": "2023-10-02",
            "query": {
                "query": "cats OR dogs"
            },
            "job_type": "oneTime"
        }'

For more details on creating data collection jobs, see Job Management

Additional Details

Metadata Example

{
    "data_source": "data365_twitter_keywords",
    "meta_data": {
        "job_label": "job-label",
        "job_id": "job-id"
    },
    "id": "1704492629574991926",
    "doc_date": "2023-09-20T13:48:05.000",
    "twitter": {
        "user_id": "134198871",
        "post_identifier": "1704492629574991926",
        "quote_count": 0,
        "reply_count": 0,
        "retweet_count": 0,
        "tweet_type": "POST",
        "retweet_type": "NONE"
    },
    "author": {
        "handle": "bikulmishra",
        "url": "https://twitter.com/bikulmishra"
    },
    "content": {
        "links": [
            "https://youtu.be/jMpiBeDq-jY"
        ],
        "published": "2023-09-20T13:48:05.000",
        "favorites": 0,
        "body": "TTOO Stock - T2 Biosystems Inc Stock Breaking News Today | TTOO Stock Price Prediction | TTOO Stock Target $183USD. Watch The Video Now.\nhttps://t.co/Ug9TLL09T2",
        "found": "2023-09-22T04:51:17.000Z",
        "found_by": "c557fdc5-2581-4597-bb65-30049e6c6164",
        "likes_count": 0
    },
    "enrichment": {
        "language": "en"
    },
    "source": {
        "link": "https://twitter.com/bikulmishra/status/1704492629574991926"
    }
}

Updated 8 days ago