Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-8431

Large update to text index can cause group commit to exceed max size

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: 2.3.2
    • Fix Version/s: 2.4.0-rc2
    • Component/s: Storage, Text Search
    • Labels:
      None
    • Environment:
      OSX 10.8, SSD storage
    • Operating System:
      ALL
    • Case:

      Description

      Inserting a document with 500,000 unique words can generate a group commit of >512MB. Trips assertion failure in AlignedBuilder::growReallocate, in util/alignedbuffer.cpp.

       91             verify( a <= 512*1024*1024 );

      This leads to a server shutdown. Reproduce with (after creating a {{

      {content: "text"}

      }} index):

      >>> import pymongo
      >>> testdb = pymongo.MongoClient()['test']
      >>> num_words_in_doc = 500 * 1000
      >>> large_doc = {'content':" ".join(map(str, range(1,num_words_in_doc+1)))}
      >>> num_docs = 50
      >>> for i in xrange(num_docs):
      ...   large_doc['_id'] = i
      ...   testdb.foo.insert(large_doc)
      ... 

      In my environment above, assertion trips on insert #32. Logfile attached.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              eliot Eliot Horowitz (Inactive)
              Reporter:
              rassi J Rassi
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: