Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-152

slice and size pipeline commands not working in source connector.

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Works as Designed
    • Icon: Major - P3 Major - P3
    • None
    • 1.2.0
    • None
    • None
    • Kafka Connector: 1.2.0
      MongoDb version: 3.6.17

    Description

      If I have an array in my document and I wanted to know only the size of the array rather than actual array or to get the top 3 or top 10 rather than full array. I was able to use the pipeline commands slice and size in the mongo cli. But when i use the same in the mongo source connector configuration i don't see any data in the kafka topic. 

       

      Interestingly i don't see any error or issue and I also see something like this in the logs which usually confirms data is published to the topic.

      Finished commitOffsets successfully in 3 ms.

      Can you please confirm what's the valid pipeline configuration to achieve the above scenario. Thanks in advance.

      Attachments

        Activity

          People

            ross@mongodb.com Ross Lawley
            sabari.mgn@gmail.com Sabari Gandhi
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: