With the Datastreamer Searchable Storage Ingress component added to your pipeline, you can read the content of any of your current searchable storages created by the Datastreamer Searchable Storage Egress (displayed in the Storage & Data page).

Component Configuration

After adding the Datastreamer Searchable Storage Ingress to your Pipeline and starting its configuration, you will see the Job setup:

Below is quick and easy explanation of how to fill out each important field:

• In the Data Source field, enter the name of your Searchable Storage from Storage & Data page.
• In the Query field, enter the Lucene query that you want to execute against the Searchable Storage. You can test the query directly in your storage before using it in the Job.
  • Query example: content.title:*pizza* AND content.followers:{72470 TO *}
  • The available fields will be determined by the content that you have in the storage.
• In the Mode field, you can choose between:
  • Search: in the Search mode, the query will run, and you will receive the documents that match the query.
  • Aggregation: in the Aggregation mode, you are able to provide not just the query but also the aggregation query in JSON format. This aggregation query will be used for the Elasticsearch to run the aggregation. The result of this operation will be the buckets.

The fields Job Type, Document Limit, Label and Tags follow the same logic as in other component jobs.

Adding the Job, it will be executed upon deployment.