[SERVER-41738] Query Command missing from Mongod log from parallel Pymongo process Created: 14/Jun/19  Updated: 18/Jun/19  Resolved: 18/Jun/19

Status: Closed
Project: Core Server
Component/s: Logging
Affects Version/s: 3.6.12
Fix Version/s: None

Type: Question Priority: Major - P3
Reporter: ben10he Assignee: Eric Sedor
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:

 Description   

Runnig a single Mongod instance using default logging level. Normally, I use Pymongo to read and write data. All these commands would be correctly log in mongod log. Recently, experience a problem with a piece of python code using both multiprocessing and multi-threading to write data into Mongod. Inside Mongod log, I only see the meta data from the IP addresses running these processes/threads, but cannot see any command come they use although data has been loading into mongodb. Increase mongo logging level does not help. 



 Comments   
Comment by Eric Sedor [ 18/Jun/19 ]

Glad to hear, ben10he

Comment by ben10he [ 18/Jun/19 ]

I managed to solve the problem by increasing the logging level for command

Comment by Eric Sedor [ 17/Jun/19 ]

Hi ben10he,

Can you provide details about specific operations that you know have completed on the client-side which were not logged on the database-side? Client-side logs of the operations, the responses from the database, and the queries that show the operations had or had not occurred would be most helpful.

It may also be useful to run through this documentation for context about pymongo and multiprocessing.

Thanks in advance.

Comment by ben10he [ 14/Jun/19 ]

Forgot to mention I am using pymongo version 3.7.2 and python 3.6.8. In addition, I use  multiprocessing.Pool and ThreadPool. The ThreadPool is running inside multiprocessing.Pool. In another word, there are a number of Threads running inside one process.

Generated at Thu Feb 08 04:58:31 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.