added

New: Document Deduplication Component

This new component can filter out duplicates with 24-hour rolling windows by allowing you to select configurable deduplication fields. You can use this filter to move duplicate content into another stream, storage, or trash.

Read more here: https://docs.datastreamer.io/docs/document-deduplication#/