Direct data Ingress (UI & HTTPS)
The HTTPS Endpoint Ingress allows you send documents through the UI or via a HTTPS endpoint.
Getting Started
To begin, add a HTTPS Endpoint Ingress component to the beginning of your pipeline. Save and deploy the configuration for changes to take effect.
This component has an Upload button, which opens a dedicated menu containing relevant options.
You can interact with the HTTPS Endpoint in one of two ways:
- Upload a JSON file or JSON Lines file directly.
- Alternatively, you can paste or type your document into the text area below and send.
The text area supports either a single document as can be seen in the example text, or an array of documents, for example:
[
{
"id": "123456",
"content":{
"body": "First document"
}
},
{
"id": "789012",
"content":{
"body": "Second document"
}
}
]
API
After pasting or typing valid JSON into the text area, the Code button will become available. Click it to view a code snippet with a curl example that demonstrates how to send documents programmatically via a POST request. The generated code looks like this:
curl --location 'https://portal.datastreamer.io/api/pipelines/<your-pipeline-id>/steps/<your-component-id>/documents' \
--header 'apikey: <your-api-key>' \
--header 'Content-Type: application/json' \
--data \
'[
{
"property": "value"
}
]'
Updated 7 days ago