Merging Streams
You can merge several streams or topics with a merge part. All the messages from all the input sources will be sent to the output. A merge part has the following fields:
| Field | Mandatory | Description |
|---|---|---|
| fromCollections | Exclusive with fromTopics and fromStreams |
An array of MongoDB collection names. See also streams. |
| fromStreams | Eclusive with fromTopics and fromCollections |
An array of stream names. |
| fromTopics | Exclusive with fromStreams and fromCollections |
An array of Kafka topic names. |
| name | Yes | The name of the output stream. Other streams can connect to it with that name. |
| toCollection | No | The name of the MongoDB collection to which the messages are sent. |
| toString | No | A boolean field that, when the toTopic field is present, will cause the JSON messages to be written as strings. |
| toTopic | No | The name of the Kafka topic to which this stream will be connected as a producer. |
| type | Yes | The value is always merge. |
This is an example:
---
application: "my-app"
version: "1.0"
parts:
- type: "merge"
name: "merged-init"
fromStreams:
- "absences-init"
- "activities-init"
- "owners-init"
- "subscriptions-init"