[KAFKA-248] WARN No topic set. Could not publish the message Created: 16/Aug/21  Updated: 27/Oct/23  Resolved: 16/Aug/21

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Unknown
Reporter: BRIJ MOHAN GUPTA Assignee: Ross Lawley
Resolution: Works as Designed Votes: 0
Labels: external-user
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File image-2021-08-16-11-39-04-425.png    

 Description   

I get this message when I launch the MongoDB source connector and perform an update on source DB:

“WARN No topic set. Could not publish the message (…)”

If I remove "ns" from the aggregation pipeline then it throws a warning message and does not insert the data into Topic. But if I add ns in the project operation then it is working fine. This may be the bug.

Current Pipeline:

[
{$match:
{"operationType": "insert"}
},
{$project:
{
"_id":1,

"identity_id": "$fullDocument.profile.userIdentityId",
"user_guid":"$fullDocument.userGuid",
"status": "$fullDocument.status",
"product_items": "$fullDocument.productItems",
"last_updated_on": {$subtract :["$$NOW","$fullDocument.lastUpdatedOn"]}
}
}
]

 



 Comments   
Comment by Ross Lawley [ 16/Aug/21 ]

Hi guptabrijmohan30@gmail.com,

This is by design as Mongo Namespaces map to topics. Please see the Source connector configuration properties. If you just want to publish the full document only - please use the publish.full.document.only=true configuration.

All the best,

Ross

Generated at Thu Feb 08 09:05:56 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.