Check WT-15969 is limiting the log spam during validate()

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Minor - P4
    • None
    • Affects Version/s: 8.3.0-rc0
    • Component/s: None
    • None
    • Storage Engines - Persistence
    • SE Persistence backlog
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Currently validate with full: true causes the logs to get spammed (usually into the realm of several GB) with log lines like this, per index:

      {"t":{"$date":"2025-10-27T00:18:38.456+00:00"},"s":"I",  "c":"WT",       "id":22431,   "ctx":"initandlisten","msg":"WiredTiger progress","attr":{"operation":"WT_SESSION.verify","progress":228800}}

      Ultimately it is good to know that progress is being made, but it would be helpful if we could throttle or suppress these messages since they often take up 90% or more of the mongod logs generated from validate().

       
      A helpful example of the verbosity we would prefer is "Validate: scanning documents" which reports progress meaningful progress but at a far slower rate and with less spam (often <5% of logs generated from validate()). Another option would just be polling for progress every minute or so instead of potentially several times a second.

      {"t":{"$date":"2025-10-26T13:35:24.031+00:00"},"s":"I",  "c":"-",        "id":51773,   "ctx":"initandlisten","msg":"progress meter","attr":{"name":"Validate: scanning documents","done":3900,"total":131120,"percent":2}}  

            Assignee:
            Albert Song
            Reporter:
            Chris Kelly
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: