📘

Documentation Accuracy

We try to ensure every component documentation is as accurate as possible. However as we do not manage 3rd parties product features and documentation, some 3rd party documentation may not be accurate at the time of the last update. Thank you for your understanding.

The Socialgist Tiktok component allows you to search for short videos on Tiktok

New to Datastreamer? Start here.

👍

Unify Schema

This data source already use Unify Schema.

How to use?

The Socialgist Tiktok is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.

Search Queries

Filters

Available filters for Socialgist Tiktok can be found in the table below:

The Lucene Query is supported for this component in the query field. Here are some of the basics queries that you can try:

Keywords:

content.body: drinks

Boolean operators:

cats OR dogs

Comments only:

tiktok.content_type: comment

Videos only:

tiktok.content_type: video

Comments and Videos:

tiktok.content_type: (comment OR video)

Hashtags only:

tiktok.content_type: tag

English content:

enrichment.language: en

Search by hashtags:

tiktok.content_type: video AND content.hashtags:(fashion OR perfume)

Examples

Search for cats or dogs

Query cats or dogs every 12 hours:

Using the API, you can use the Code button to extract this example:

curl --location 'https://api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
      --header 'apikey: <your-api-key>' \
      --header 'Content-Type: application/json' \
      --data \
        '{
          "job_name": "{JOB_NAME}",
          "data_source": "socialgist_tiktok",
          "query": {
            "query_string": "cats OR dogs"
          },
          "job_type": "periodic",
          "schedule": "0 0 0/12 1/1 * ? *",
          "max_documents": 50
        }'

For more details on creating data collection jobs, see Job Management.

Additional Details

Source Attributes and Stats

There are 3 types of content: video, comment and tag. You can use the field tiktok.content_type to filter the kind you want.

Other information about the content:

• Crawling is focused on user and hashtag pages.
• Available data: videos, hashtag stats, top level comments. Only 2 years of data is available at current rollout.
• Crawl frequency:
  • User and hashtag pages: every 12 hours (includes updating the video metadata stats)
  • Hashtag stats: every 6 hours
  • Comments: periodically for 30 days after initial video discovery (initial crawl, 1, 5, 10, 30 days)
• Initial Collection:
  • User pages: when adding user pages, 30 most recent videos will be captured with initial crawl and new videos moving forward
  • Hashtag pages: these pages are not sorted by date so not possible to guarantee latest videos; with each crawl the 30 “top” videos are captured. This sorting is determined by TikTok.
  • To participate in program, submit user pages and hashtag pages your clients wish to track and analyze.

Available fields

The available fields can be changed by the data provider (Socialgist), but currently this is the possible field names.

Common fields (present in most entries):

• data_source
• id
• doc_date
• source.link
• author.userid
• author.handle
• author.bio
• author.url
• author.profile_image_source
• author.followers
• author.videos_count
• author.verified

Content Metadata:

• tiktok.content_type (e.g., "video", "comment")
• tiktok.music.id
• tiktok.music.author
• tiktok.music.title
• tiktok.music.duration
• tiktok.is_share_enabled
• tiktok.is_duet_enabled
• tiktok.is_for_friend
• tiktok.is_official_item
• tiktok.is_original_item
• tiktok.is_stitch_enabled
• tiktok.stickers (array of strings)

Video/Post Content:

• content.hashtags (array)
• content.published
• content.body
• content.likes_count
• content.shares_count
• content.comments_count
• content.plays_count
• content.found
• content.last_updated
• content.video_urls (array)

Video-Specific Fields:

• content.video.transcription
• content.video.transcribed (boolean)
• content.video.has_dialog (boolean)
• content.video.gallery (boolean)
• content.video.language_code (e.g., "en", "de")

Comment-Specific Fields (for content_type: "comment")

• content.parent_author_handle
• content.related_post_id

Enrichment Fields:

• enrichment.language (e.g., "en", "de")

Example Result

Video content example:

{
    "data_source": "socialgist_tiktok",
    "tiktok": {
        "content_type": "video",
        "music": {
            "id": "7488133181292464939",
            "author": "catstermag",
            "title": "original sound - catstermag",
            "duration": "129"
        },
        "is_share_enabled": true,
        "is_for_friend": false,
        "is_official_item": false,
        "is_original_item": false
    },
    "id": "7488133032738704683",
    "doc_date": "2025-04-01T00:21:13Z",
    "content": {
        "hashtags": [
            "weratecats",
            "yourcat",
            "catsoftheweek",
            "cats"
        ],
        "published": "2025-04-01T00:21:13Z",
        "body": "📢The cats were good again this week! 📢 This week's cats: @tuesdaythedwarfcat @dookieandluca  @ivy.alien @cicipepecats @pogcchamp  IB: @weratedogs #weratecats #yourcat #catsoftheweek #cats",
        "likes_count": 755,
        "shares_count": 53,
        "comments_count": 24,
        "plays_count": 2592,
        "found": "2025-04-02T14:52:34.288Z",
        "video_urls": [
            "https://v16-webapp-prime.us.tiktok.com/video/tos/useast5/tos-useast5-ve-0068c001-tx/ogIkInrEQHAefI3WgPxAiYyWkCLHep1GmMQLYA/?a=1988&bti=ODszNWYuMDE6&ch=0&cr=3&dr=0&lr=all&cd=0%7C0%7C0%7C&cv=1&br=2522&bt=1261&cs=0&ds=3&ft=4KJMyMzm8Zmo0Z4yLb4jVwQjQpWrKsd.&mime_type=video_mp4&qs=0&rc=OjloMzU3N2RmZzY2NTpoZkBpM2k7ZGo5cnNteTMzZzgzNEA2MzQvYzBjXmMxL2NiYjQ0YSMzXzEzMmRjLmlgLS1kLy9zcw%3D%3D&btag=e00090000&expire=1743778477&l=20250402145228D8AE95C056036701C0C4&ply_type=2&policy=2&signature=b369c6e834ed023703219555b4d60f05&tk=tt_chain_token"
        ],
        "last_updated": "2025-04-02T14:52:36.449Z"
    },
    "source": {
        "link": "https://www.tiktok.com/@catstermag/video/7488133032738704683"
    },
    "author": {
        "userid": "7147525388099453998",
        "handle": "catstermag",
        "bio": "catstermag",
        "url": "https://www.tiktok.com/@catstermag",
        "profile_image_source": "https://p16-sign.tiktokcdn-us.com/tos-useast5-avt-0068-tx/19321d3c1573f1408385bc423772319d~tplv-tiktokx-cropcenter:100:100.jpeg?dr=9640&refresh_token=1ee842b3&x-expires=1743775200&x-signature=V2o9w3xRKr%2FKAmivO09BTuwkEaQ%3D&t=4d5b0474&ps=13740610&shp=a5d48078&shcp=81f88b70&idc=useast8",
        "followers": 88200,
        "videos_count": 690,
        "verified": false
    }
}

Tag content example:

{
                "data_source": "socialgist_tiktok",
                "tiktok": {
                    "content_type": "tag"
                },
                "doc_date": "2024-07-15T16:35:28.364Z",
                "source": {
                    "link": "https://www.tiktok.com/tag/gadget"
                },
                "content": {
                    "hashtags": [
                        "#gadget"
                    ],
                    "views_count": "22000000000",
                    "found": "2024-07-15T16:35:28.364Z"
                },
                "id": "c51d1f71907fb416528dda034a78c6d637baeca3ca0adb2eb3820e8e8b21b225"