The Datastreamer File Storage Ingress component will enable you to read the files currently saved in the Datastreamer File Storage and use them for processing in your pipeline.

Setup the Component Properties

The Component Properties section of this component should look like this:

The Component Properties setup for this component is very similar to the Cloud Storage Ingress. You can check the documentation there to understand how to fill out each field.

Different from other providers supported by Cloud Storage Ingress (Google Cloud, Azure, and AWS), when using the Datastreamer File Storage, you do not need to provide a secret or do any extra additional configuration to connect to it.

The next step is setup a Job, that will read the Datastreamer File Storage. The Job page will look like this:

The Job configuration is also explained in detail in the Cloud Storage Ingress documentation. There you can understand what each field represents and fill them out.