[SERVER-41738] Query Command missing from Mongod log from parallel Pymongo process Created: 14/Jun/19 Updated: 18/Jun/19 Resolved: 18/Jun/19 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Logging |
| Affects Version/s: | 3.6.12 |
| Fix Version/s: | None |
| Type: | Question | Priority: | Major - P3 |
| Reporter: | ben10he | Assignee: | Eric Sedor |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Participants: |
| Description |
|
Runnig a single Mongod instance using default logging level. Normally, I use Pymongo to read and write data. All these commands would be correctly log in mongod log. Recently, experience a problem with a piece of python code using both multiprocessing and multi-threading to write data into Mongod. Inside Mongod log, I only see the meta data from the IP addresses running these processes/threads, but cannot see any command come they use although data has been loading into mongodb. Increase mongo logging level does not help. |
| Comments |
| Comment by Eric Sedor [ 18/Jun/19 ] |
|
Glad to hear, ben10he |
| Comment by ben10he [ 18/Jun/19 ] |
|
I managed to solve the problem by increasing the logging level for command |
| Comment by Eric Sedor [ 17/Jun/19 ] |
|
Hi ben10he, Can you provide details about specific operations that you know have completed on the client-side which were not logged on the database-side? Client-side logs of the operations, the responses from the database, and the queries that show the operations had or had not occurred would be most helpful. It may also be useful to run through this documentation for context about pymongo and multiprocessing. Thanks in advance. |
| Comment by ben10he [ 14/Jun/19 ] |
|
Forgot to mention I am using pymongo version 3.7.2 and python 3.6.8. In addition, I use multiprocessing.Pool and ThreadPool. The ThreadPool is running inside multiprocessing.Pool. In another word, there are a number of Threads running inside one process. |