mongoreplay crashes with out of memory recording from 8GB pcap file

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Fixed
    • Priority: Major - P3
    • 3.7.2, 3.6.5
    • Affects Version/s: 3.4.7
    • Component/s: mongoreplay
    • None
    • Environment:
      Linux

      I recorded a minute's worth of heavy traffic with tcpdump.

       tcpdump -B $((100*1024)) -i eth0 -n "port 27017" -w /replay/test2both.pcap
      

      The resulting pcap file was ~8GB. I then processed the file using:

      mongoreplay record -f test2both.pcap -p test2both.bson
      

      The machine, a c4.8xlarge, had 64GB of memory, about 55GB of the which showed free using top when the mongoreplay record command was run. Little by little, free memory declined until the process crashed with:

      fatal error: runtime: out of memory
      

      Link to the pcap file and full mongoreplay output from crash in first comment.

              Assignee:
              Unassigned
              Reporter:
              Eric Sommer
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: