Get Started

DarkOwl Search

DarkOwl Search allows you to query DarkOwl Vision’s DARKINT data collection

The DarkOwl Search (provided by DarkOwl) provides continuously updated darknet data into your existing technology or platform for display, analysis, and/or correlation.

The complete DarkOwl documentation about their endpoint can be found in their site here.

New to Datastreamer? Start here.

👍

Unify Schema

This data source already use Unify Schema.

How To Use?

The component is powered by the Jobs System, when interacting with the component you have the option to define your jobs queries.

Search Query

Filters

Filter NameDescription
queryHashtag IDs to search feed sections for
query_fromFilters records with timestamps on or after the specified date and time in ISO 8601 format (e.g., '2024-05-01T00:00:00Z')
query_toFilters records with timestamps on or before the specified date and time in ISO 8601 format (e.g., '2024-08-01T00:00:00Z').
max_documentsSet a limit for the number of documents that will be fetched for the search.

The query field is able to support different kind of operations. Here are some of the basics queries that you can try:

Keyword:

cats

Boolean operator:

cats OR dogs

Field:

email:[email protected]

Wildcards:

leomess*

Examples

Search for 'government'

Search for the 'government' keyword.

You also have the option to use the API. You can use the Code button to extract this example:

curl --location 'https://api.platform.datastreamer.io/api/pipelines/{PIPELINE_ID}/components/{COMPONENT_ID}/jobs?ready=true' \
      --header 'apikey: <your-api-key>' \
      --header 'Content-Type: application/json' \
      --data \
        '{
          "job_name": "{JOB_NAME}",
          "data_source": "darkowl_search",
          "query": {
            "query_string": "government"
          },
          "job_type": "oneTime",
          "max_documents": 10,
          "query_from": "2025-01-01T00:00:00.000Z",
          "query_to": "2025-01-09T00:00:00.000Z"
        }'

For more details on creating data collection jobs, see Job Management.

Additional Details

Stats

Searchable RecordsUpdate FrequencyPartner Type
685 MillionNear TimeIntegrated

Dark Owl Content Statistics (October 2022)

ContentStatistics
Total Unique Tor Pages685,910,985
Telegram Records9,639,045
Data Leak Records14,101,949
Unique I2P9,458,456
Zeronet & IRC Pages371,499
Authenticated Site Pages4,350,970
Darknet Forums46,165,892
Darknet Markets5,158,336
Encrypted Chat Records (sources redacted)1,109,594
Ransomware37,624
Total Number of Email Addresses8,876,108,595
Unique Email Addresses2,799,217,570
Unique Domains54,462,461
IP Addresses1,880,750,493
Cryptocurrency Addresses387,515,709
Credit Card Numbers15,279,228
Social Security Numbers2,145,087

📘

Filtering by Groups

You can filter by the logical groupings that DarkOwl has applied.

Compatible Metadata Fields

Applicable Metadata CategoriesCompatible?
SourceYes
ContentYes
AuthorYes
PersonNo
EnrichmentYes
OrganizationNo
Data source-specific fields?Yes, please see the Metadata page.

Compatible Classifiers & Models

Classifier & ModelCompatible?
Named Entity RecognitionNo
Location_InferenceNo
LanguageYes
Reported_ViolenceNo
SentimentNo
Hard_NewsNo

Compatible Features

As an Integrated partner, streaming features are not available.

FeaturesCompatible?
Search APIYes
Date HistogramsNo
Term AggregationsNo
HighlightingYes
Fuzzy and Proximate SearchNo