Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-355

poll.await.time.ms in source connector not working ?

    • Type: Icon: Question Question
    • Resolution: Works as Designed
    • Priority: Icon: Unknown Unknown
    • None
    • Affects Version/s: 1.9.1
    • Component/s: Source
    • None

      I want to apply Mongo connect  as cronjob, so I change poll.await.time.ms to high number (60000 - 1 minutes or 1 day).

      But as soon as I update document, the message produced immediately.

      {  "name": "pp",  
      "config": {    
      "behavior.on.null.values": "ignore",    "connection.timeout.ms": "60000",    
      "max.retries": "2147483647",    
      "read.timeout.ms": "300000",    "max.connection.idle.time.ms": "3000000",    "behavior.on.malformed.documents": "warn",    "key.converter.schemas.enable": "false",    "value.converter.schemas.enable": "false",   
       "name": "pp",    
      "connector.class": "com.mongodb.kafka.connect.MongoSourceConnector",    "tasks.max": "1",   
       "key.converter": "Json",    
      "value.converter": "Json",    
      "errors.retry.timeout": "-1",    
      "errors.tolerance": "none",    
      "connection.uri": "mongodb://...",   
       "database": "...",    
      "collection": "...",   
       "pipeline": "[    {       \"$match\":{  \"operationType\":{             \"$in\":[                \"insert\",                \"update\",                \"delete\",                \"replace\"             ]          }       }    } ]",    "publish.full.document.only": "false",    "change.stream.full.document": "updateLookup",    "poll.await.time.ms": "600000",    
      "startup.mode": "copy_existing",    
      "mongo.errors.tolerance": "none",    
      "offset.partition.name": "pp.0"  }} 

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            0124hoang@gmail.com Hoàng Việt
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: