-
Type: Task
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: Server
-
Labels:
-
Environment:Linux, logging to syslog
When logging to syslog, messages are subject to the rules as defined in /etc/systemd/journald.conf. By default, this limits log message bursts to 1000 messages within a 30 second period. Any messages that exceed this limit are enumerated and suppressed by systemd-journal (Suppressed 6512 messages from /system.slice/mongodb-mms-automation-agent.service).
When it rains, it pours, and any sufficiently large problem within a cluster can lose messages precisely when those messages are most necessary for troubleshooting purposes.
Proposing that we include this limitation in our documentation when customers are logging to syslog, as well as a recommendation to increase the RateLimitBurst parameter in /etc/systemd/journald.conf to handle more messages. In a recent customer case, we saw 10k-15k messages being suppressed.
Potential updates:
- Clarify the syslog limit info in Configure Auditing
- Add info to Log Messages