How to Stream XML messages from IBM MQ into Kafka into MongoDB

Written by rmoff | Published 2020/10/19
Tech Story Tags: apache-kafka | kafka | data-integration | etl | ibm-mq | mongodb | coding | prog

TLDR Using Docker Compose, we can stream XML data from IBM MQ to Kafka using the IbmMQSource connector and XML Transformation. We can then ingest the data from Kafka into MongoDB using the plugin for Kafka Connect from MongoDB. This same pattern for ingesting XML will work with other connectors such as JMS and ActiveMQ. You can use ksqlDB to work with the data, to an extent - although there’s currently no support for handing the XML to kafkacat.via the TL;DR App

no story

Written by rmoff | Developer Advocate at Confluent.
Published by HackerNoon on 2020/10/19