Uploaded image for project: 'MongoDB CLI Tools'
  1. MongoDB CLI Tools
  2. TOOLS-1765

mongoreplay crashes with out of memory recording from 8GB pcap file

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: 3.4.7
    • Fix Version/s: 3.7.2, 3.6.5
    • Component/s: mongoreplay
    • Labels:
      None
    • Environment:
      Linux

      Description

      I recorded a minute's worth of heavy traffic with tcpdump.

       tcpdump -B $((100*1024)) -i eth0 -n "port 27017" -w /replay/test2both.pcap
      

      The resulting pcap file was ~8GB. I then processed the file using:

      mongoreplay record -f test2both.pcap -p test2both.bson
      

      The machine, a c4.8xlarge, had 64GB of memory, about 55GB of the which showed free using top when the mongoreplay record command was run. Little by little, free memory declined until the process crashed with:

      fatal error: runtime: out of memory
      

      Link to the pcap file and full mongoreplay output from crash in first comment.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              eric.sommer Eric Sommer
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: