Jump to Content

View Interactive Demo ↗Book a call ↗Go to Datastreamer.io ↗

Documentation Recipes & Templates Product Updates

View Interactive Demo ↗Book a call ↗Go to Datastreamer.io ↗

Documentation

Documentation Recipes & Templates Product Updates

All

Pages

Start typing to search…

Getting Started

👋 Welcome to Datastreamer!
🚀 Platform Overview
🎯 Platform FAQs
📘 Core Concepts
- Platform Glossary

Creating Your First Pipeline

Creating Your First Pipeline
Creating Your Account
Quick Start Pipeline Templates
- Sentiment, Location, and Language Enriched Pipeline Template
- Multi-source Entity Recognition Pipeline Template

Pipeline Management

What is a Dynamic Pipeline?
Pipeline Deployment
Managing Pipelines
Tracking & Monitoring
Quick Diagnostics

DATA CONNECTORS

Connector Automation (Jobs)
Connector Automation (AI Tools)
- MCP Server Setup Guide
- Job Creation Agent
Data Sources
Databases
- Datastreamer File Storage Ingress
- Datastreamer Searchable Storage Ingress
Event Streaming
- Google Pub/Sub Ingress
Direct Data Upload
Cloud Storage

TRANSFORMATIONS

Unify Transformer
- Unified Data Dictionary
JSON Schema Transformer
Custom Transformations

OPERATIONS

Operations & Enrichments Overview
Custom Functions
Routing & Filtering
AI Operations
NLP Classifiers
- Language Detection (Datastreamer)
- Language Detection (Google Service)
File Operations

DESTINATION CONNECTORS

What is "Pipeline Egress"?
Databases
- Snowflake
  - Snowflake Setup Guide
- Databricks
  - Databricks File Egress
  - Databricks SQL Egress
Searchable Storage by Datastreamer
ETL Platforms
- Fivetran
  - Fivetran Setup Guide
Webhook
Firehose
- Firehose
Cloud Storage
Event Streaming
- Google Pub/Sub Egress Connector
Datastreamer File Storage Egress
Elasticsearch Egress
Big Query
- Big Query Writer
- Big Query Fixed Schema Writer
Social Voice

Billing & Cost Management

Usage-Based Pricing
Billing Dashboard
Detailed Billing Views (Using Tags)
What are Data Volume Units?
Pricing Calculator
Budget Alerts
Add-On Bundles

Security & Compliance

Datastreamer Architecture Overview
Pipeline Regional Deployment
Platform Transparency Overview
Platform Security Overview
Compliance-Sensitive Usage

Other

Tips & Tricks
Google Sheet Integration
Understanding and Optimizing Your Datastreamer Usage

Powered by

Failed Items Viewer

Built-in panel that lets you inspect, retry, or discard failed items from a component in your pipeline

Updated 4 months ago

Component Log Viewer

Quick Diagnostics