<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:06:00 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-4441] Got Signal: 11 (Segmentation Fault) under heavy load</title>
                <link>https://jira.mongodb.org/browse/SERVER-4441</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We had this problem before occasionally. But now we started to shard a collection with about 120GB data and it is not possible to keep the balancer active.&lt;/p&gt;

&lt;p&gt;After some time mongod instances (master + 2 slaves) on the first shard begin to SegFault every few minutes.&lt;br/&gt;
I&apos;ve disabled the balancer and mongod instances keep running again.&lt;/p&gt;

&lt;p&gt;This happens with 2.0.1 as well as 2.0.2-rc1. My impression is that high load leads to these SegFaults.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Sun Dec  4 17:20:37 Invalid access at address: 0xfffffd59fedb32cc&lt;/p&gt;

&lt;p&gt;Sun Dec  4 17:20:38 Got signal: 11 (Segmentation Fault).&lt;/p&gt;

&lt;p&gt;Sun Dec  4 17:20:38 Backtrace:&lt;/p&gt;

&lt;p&gt;Logstream::get called in uninitialized state&lt;br/&gt;
Sun Dec  4 17:20:41 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn49&amp;#93;&lt;/span&gt; end connection 192.168.151.20:39137&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Sun Dec  4 17:20:41 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; connection accepted from 192.168.151.20:37360 #50&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Sun Dec  4 17:20:41 ERROR: Client::~Client _context should be null but is not; client:rsSync&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Sun Dec  4 17:20:41 ERROR: Client::shutdown not called: rsSync&lt;/p&gt;&lt;/blockquote&gt;







</description>
                <environment>SunOS 5.11 oi_148 i86pc i386 i86pc, 64 GB RAM</environment>
        <key id="26076">SERVER-4441</key>
            <summary>Got Signal: 11 (Segmentation Fault) under heavy load</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="greg_10gen">Greg Studer</assignee>
                                    <reporter username="psartini">Piero Sartini</reporter>
                        <labels>
                    </labels>
                <created>Tue, 6 Dec 2011 15:21:35 +0000</created>
                <updated>Mon, 11 Jul 2016 18:35:26 +0000</updated>
                            <resolved>Mon, 2 Jan 2012 17:48:06 +0000</resolved>
                                    <version>2.0.1</version>
                                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="498182" author="krauss" created="Wed, 12 Feb 2014 22:59:15 +0000"  >&lt;p&gt;Still getting this!&lt;/p&gt;

&lt;p&gt;Wed Feb 12 11:21:49.327 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; auth: couldn&apos;t find user yogi@yogi_berra, yogi_berra.system.users&lt;br/&gt;
Wed Feb 12 11:36:48.282 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn15&amp;#93;&lt;/span&gt; end connection 127.0.0.1:49873 (1 connection now open)&lt;br/&gt;
Wed Feb 12 11:37:22.812 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; end connection 127.0.0.1:49977 (0 connections now open)&lt;br/&gt;
Wed Feb 12 14:32:36.572 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; connection accepted from 127.0.0.1:51840 #18 (1 connection now open)&lt;br/&gt;
Wed Feb 12 14:52:18.262 Invalid access at address: 0x10 from thread: conn18&lt;/p&gt;

&lt;p&gt;Wed Feb 12 14:52:18.262 Got signal: 11 (Segmentation fault: 11).&lt;/p&gt;

&lt;p&gt;Wed Feb 12 14:52:18.282 Backtrace:&lt;br/&gt;
0x1011c19e0 0x100cd227d 0x100cd25b8 0x7fff92d6a5aa 0x10f51b368 0x1012f4097 0x1013c1699 0x1013c1501 0x10117b5cb 0x10117b48f 0x10117636a 0x1011757cf 0x100e1d675 0x100e270a7 0x100e4b055 0x100e4c013 0x100e4cdf6 0x100f6104d 0x100f67468 0x100f0492a&lt;br/&gt;
 0   mongod                              0x00000001011c19e0 _ZN5mongo15printStackTraceERSo + 64&lt;br/&gt;
 1   mongod                              0x0000000100cd227d _ZN5mongo10abruptQuitEi + 397&lt;br/&gt;
 2   mongod                              0x0000000100cd25b8 &lt;em&gt;ZN5mongo24abruptQuitWithAddrSignalEiP9&lt;/em&gt;_siginfoPv + 344&lt;br/&gt;
 3   libsystem_platform.dylib            0x00007fff92d6a5aa _sigtramp + 26&lt;br/&gt;
 4   ???                                 0x000000010f51b368 0x0 + 4551979880&lt;br/&gt;
 5   mongod                              0x00000001012f4097 _ZN2v88internal15DeoptimizerDataD1Ev + 55&lt;br/&gt;
 6   mongod                              0x00000001013c1699 _ZN2v88internal7Isolate6DeinitEv + 105&lt;br/&gt;
 7   mongod                              0x00000001013c1501 _ZN2v88internal7Isolate8TearDownEv + 81&lt;br/&gt;
 8   mongod                              0x000000010117b5cb _ZN5mongo7V8ScopeD2Ev + 267&lt;br/&gt;
 9   mongod                              0x000000010117b48f _ZN5mongo7V8ScopeD0Ev + 15&lt;br/&gt;
 10  mongod                              0x000000010117636a _ZN5mongo11PooledScopeD2Ev + 842&lt;br/&gt;
 11  mongod                              0x00000001011757cf _ZN5mongo11PooledScopeD0Ev + 15&lt;br/&gt;
 12  mongod                              0x0000000100e1d675 _ZN5mongo2mr5StateD2Ev + 341&lt;br/&gt;
 13  mongod                              0x0000000100e270a7 _ZN5mongo2mr16MapReduceCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb + 6455&lt;br/&gt;
 14  mongod                              0x0000000100e4b055 _ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb + 37&lt;br/&gt;
 15  mongod                              0x0000000100e4c013 _ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb + 2915&lt;br/&gt;
 16  mongod                              0x0000000100e4cdf6 _ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi + 886&lt;br/&gt;
 17  mongod                              0x0000000100f6104d _ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi + 45&lt;br/&gt;
 18  mongod                              0x0000000100f67468 &lt;em&gt;ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1&lt;/em&gt; + 1112&lt;br/&gt;
 19  mongod                              0x0000000100f0492a _ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE + 1338&lt;/p&gt;</comment>
                            <comment id="469984" author="krauss" created="Thu, 12 Dec 2013 17:04:10 +0000"  >&lt;p&gt;This is happening for me often on my development machine. MacBook Pro, running OSX 10.9. &lt;br/&gt;
I am using mongo version 2.4.8. &lt;br/&gt;
Could be related to this bug &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-11671&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-11671&lt;/a&gt;, because started happening when I began using map reduce functions.&lt;br/&gt;
My first couple of tries writing the functions weren&apos;t perfect javascript so I had errors and it started crashing.&lt;br/&gt;
Now it crashes about every 5-10 requests.&lt;/p&gt;

&lt;p&gt;var map = function() {&lt;br/&gt;
  emit(this.error_message, &lt;/p&gt;
{ count: 1, date: this.created_at }
&lt;p&gt;);&lt;br/&gt;
};&lt;/p&gt;

&lt;p&gt;var reduce = function(key, values) {&lt;br/&gt;
  var result = &lt;/p&gt;
{count: 0, dates: []}
&lt;p&gt;;&lt;br/&gt;
  values.forEach(function(value){&lt;br/&gt;
    if (value.date) &lt;/p&gt;
{
      result.count += value.count;
      result.dates.push(value.date);
    }
&lt;p&gt;  });&lt;br/&gt;
  return result;&lt;br/&gt;
}&lt;/p&gt;

&lt;p&gt;db.runCommand({&lt;br/&gt;
  mapReduce: &quot;caught_exceptions&quot;,&lt;br/&gt;
  map: map,&lt;br/&gt;
  reduce: reduce,&lt;br/&gt;
  out: &lt;/p&gt;
{ inline: 1 }
&lt;p&gt;,&lt;br/&gt;
  query: {&lt;br/&gt;
    error_message: &lt;/p&gt;
{ $exists: true, $ne: &quot;&quot; }
&lt;p&gt;  }&lt;br/&gt;
})&lt;/p&gt;

&lt;p&gt;Thu Dec 12 08:48:02.963 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; connection accepted from 127.0.0.1:61765 #8 (2 connections now open)&lt;br/&gt;
Thu Dec 12 08:48:03.040 Invalid access at address: 0x10 from thread: conn8&lt;/p&gt;

&lt;p&gt;Thu Dec 12 08:48:03.040 Got signal: 11 (Segmentation fault: 11).&lt;/p&gt;

&lt;p&gt;Thu Dec 12 08:48:03.046 Backtrace:&lt;br/&gt;
0x10aef69e0 0x10aa0727d 0x10aa075b8 0x7fff907e65aa 0x10b205ed1 0x10b029097 0x10b0f6699 0x10b0f6501 0x10aeb05cb 0x10aeb048f 0x10aeab36a 0x10aeaa7cf 0x10ab52675 0x10ab5c0a7 0x10ab80055 0x10ab81013 0x10ab81df6 0x10ac9604d 0x10ac9c468 0x10ac3992a&lt;br/&gt;
 0   mongod                              0x000000010aef69e0 _ZN5mongo15printStackTraceERSo + 64&lt;br/&gt;
 1   mongod                              0x000000010aa0727d _ZN5mongo10abruptQuitEi + 397&lt;br/&gt;
 2   mongod                              0x000000010aa075b8 &lt;em&gt;ZN5mongo24abruptQuitWithAddrSignalEiP9&lt;/em&gt;_siginfoPv + 344&lt;br/&gt;
 3   libsystem_platform.dylib            0x00007fff907e65aa _sigtramp + 26&lt;br/&gt;
 4   mongod                              0x000000010b205ed1 _ZN2v88internal9StubCache17ComputeCallGlobalEiNS0_4Code4KindEiNS0_6HandleINS0_6StringEEENS4_INS0_8JSObjectEEENS4_INS0_12GlobalObjectEEENS4_INS0_20JSGlobalPropertyCellEEENS4_INS0_10JSFunctionEEE + 641&lt;br/&gt;
 5   mongod                              0x000000010b029097 _ZN2v88internal15DeoptimizerDataD1Ev + 55&lt;br/&gt;
 6   mongod                              0x000000010b0f6699 _ZN2v88internal7Isolate6DeinitEv + 105&lt;br/&gt;
 7   mongod                              0x000000010b0f6501 _ZN2v88internal7Isolate8TearDownEv + 81&lt;br/&gt;
 8   mongod                              0x000000010aeb05cb _ZN5mongo7V8ScopeD2Ev + 267&lt;br/&gt;
 9   mongod                              0x000000010aeb048f _ZN5mongo7V8ScopeD0Ev + 15&lt;br/&gt;
 10  mongod                              0x000000010aeab36a _ZN5mongo11PooledScopeD2Ev + 842&lt;br/&gt;
 11  mongod                              0x000000010aeaa7cf _ZN5mongo11PooledScopeD0Ev + 15&lt;br/&gt;
 12  mongod                              0x000000010ab52675 _ZN5mongo2mr5StateD2Ev + 341&lt;br/&gt;
 13  mongod                              0x000000010ab5c0a7 _ZN5mongo2mr16MapReduceCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb + 6455&lt;br/&gt;
 14  mongod                              0x000000010ab80055 _ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb + 37&lt;br/&gt;
 15  mongod                              0x000000010ab81013 _ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb + 2915&lt;br/&gt;
 16  mongod                              0x000000010ab81df6 _ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi + 886&lt;br/&gt;
 17  mongod                              0x000000010ac9604d _ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi + 45&lt;br/&gt;
 18  mongod                              0x000000010ac9c468 &lt;em&gt;ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1&lt;/em&gt; + 1112&lt;br/&gt;
 19  mongod                              0x000000010ac3992a _ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE + 1338&lt;/p&gt;</comment>
                            <comment id="124138" author="skottler" created="Wed, 30 May 2012 01:45:59 +0000"  >&lt;p&gt;I have seen a similar issue on our infrastructure. Here is the complete stack trace:&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:28 Backtrace:&lt;br/&gt;
0xa89b19 0x7ffaec686af0 0x7ffaec686a75 0x7ffaec68a5c0 0x87ffb7 0x76134b 0x7615bd 0x761d4b 0xaa4560 0x7ffaed18a9ca 0x7ffaec73970d &lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa89b19&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(+0x33af0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686af0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(gsignal+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686a75&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(abort+0x180) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec68a5c0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10mongoAbortEPKc+0x47) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x87ffb7&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0xcb) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x76134b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7615bd&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3dur9durThreadEv+0x10b) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x761d4b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(thread_proxy+0x80) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xaa4560&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x69ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed18a9ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec73970d&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:28 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1632100&amp;#93;&lt;/span&gt; insert mq.mq_coll 129ms&lt;br/&gt;
Thu May 24 03:20:28 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1632110&amp;#93;&lt;/span&gt; query kv.kv_collection ntoreturn:1 nscanned:2 nreturned:1 reslen:97 5731ms&lt;br/&gt;
Thu May 24 03:20:28 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1634789&amp;#93;&lt;/span&gt; query action.pending_coll ntoreturn:50 reslen:20 483ms&lt;br/&gt;
Thu May 24 03:20:28 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1632131&amp;#93;&lt;/span&gt; query kv.kv_collection ntoreturn:1 nscanned:2 nreturned:1 reslen:97 15285ms&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Thu May 24 03:20:29 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1632100&amp;#93;&lt;/span&gt; insert mq.mq_coll 114ms&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Thu May 24 03:20:29 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1628299&amp;#93;&lt;/span&gt; insert mevent_collection.mevents 273ms&lt;br/&gt;
Thu May 24 03:20:29 Invalid access at address: 0x10000001f&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:29 Got signal: 11 (Segmentation fault).&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:29 Backtrace:&lt;br/&gt;
0xa89b19 0xa8a0f0 0x7ffaed1938f0 0x797fbb 0x9736e1 0x8c51b6 0x8c53e1 0x8c54ea 0x8d49af 0x8d50e6 0x8d8850 0x8da333 0x8db607 0x964369 0x882407 0x888c2c 0xa9c576 0x638937 0x7ffaed18a9ca 0x7ffaec73970d &lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa89b19&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa8a0f0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0xf8f0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed1938f0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12ClientCursor16recoverFromYieldERKNS0_9YieldDataE+0x3b) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x797fbb&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11UserQueryOp16recoverFromYieldEv+0x191) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x9736e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet6Runner18recoverFromYieldOpERNS_7QueryOpE+0x56) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8c51b6&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet6Runner16recoverFromYieldEv+0x21) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8c53e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet6Runner8mayYieldEv+0xca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8c54ea&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet6Runner4nextEv+0x2f) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8d49af&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet6Runner22runUntilFirstCompletesEv+0x56) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8d50e6&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12QueryPlanSet5runOpERNS_7QueryOpE+0x50) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8d8850&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16MultiPlanScanner9runOpOnceERNS_7QueryOpE+0x523) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8da333&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16MultiPlanScanner5runOpERNS_7QueryOpE+0x17) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x8db607&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(&lt;em&gt;ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1&lt;/em&gt;+0xa79) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x964369&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x882407&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x55c) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x888c2c&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa9c576&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x638937&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x69ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed18a9ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec73970d&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;Logstream::get called in uninitialized state&lt;br/&gt;
Thu May 24 03:20:29 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1634767&amp;#93;&lt;/span&gt; ERROR: Client::~Client _context should be null but is not; client:conn&lt;br/&gt;
Logstream::get called in uninitialized state&lt;br/&gt;
Thu May 24 03:20:29 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1634767&amp;#93;&lt;/span&gt; ERROR: Client::shutdown not called: conn&lt;br/&gt;
Thu May 24 03:20:29 Invalid access at address: 0&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:29 Got signal: 11 (Segmentation fault).&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:29 Backtrace:&lt;br/&gt;
0xa89b19 0xa8a0f0 0x7ffaed1938f0 0x7ffaec68c1b5 0xa89d6e 0x7ffaec686af0 0x7ffaec686a75 0x7ffaec68a5c0 0x87ffb7 0x76134b 0x7615bd 0x761d4b 0xaa4560 0x7ffaed18a9ca 0x7ffaec73970d &lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa89b19&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa8a0f0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0xf8f0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed1938f0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(exit+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec68c1b5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x5ee) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa89d6e&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(+0x33af0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686af0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(gsignal+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686a75&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(abort+0x180) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec68a5c0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10mongoAbortEPKc+0x47) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x87ffb7&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0xcb) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x76134b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7615bd&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3dur9durThreadEv+0x10b) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x761d4b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(thread_proxy+0x80) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xaa4560&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x69ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed18a9ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec73970d&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;pure virtual method called&lt;br/&gt;
Thu May 24 03:20:29 terminate() called, printing stack:&lt;br/&gt;
0xa8903d 0x7ffaecf3ad16 0x7ffaecf3ad43 0x7ffaecf3b61f 0x976674 0x9783b5 0x961745 0x964ad1 0x882407 0x888c2c 0xa9c576 0x638937 0x7ffaed18a9ca 0x7ffaec73970d &lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11myterminateEv+0x4d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa8903d&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcad16) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3ad16&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcad43) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3ad43&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcb61f) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3b61f&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x5c4) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x976674&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x705) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x9783b5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x961745&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(&lt;em&gt;ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1&lt;/em&gt;+0x11e1) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x964ad1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x882407&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x55c) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x888c2c&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa9c576&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x638937&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x69ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed18a9ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec73970d&amp;#93;&lt;/span&gt;&lt;br/&gt;
Thu May 24 03:20:29 Got signal: 6 (Aborted).&lt;/p&gt;

&lt;p&gt;Thu May 24 03:20:29 Backtrace:&lt;br/&gt;
0xa89b19 0x7ffaec686af0 0x7ffaec686a75 0x7ffaec68a5c0 0xa8910b 0x7ffaecf3ad16 0x7ffaecf3ad43 0x7ffaecf3b61f 0x976674 0x9783b5 0x961745 0x964ad1 0x882407 0x888c2c 0xa9c576 0x638937 0x7ffaed18a9ca 0x7ffaec73970d &lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa89b19&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(+0x33af0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686af0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(gsignal+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec686a75&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(abort+0x180) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec68a5c0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11myterminateEv+0x11b) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa8910b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcad16) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3ad16&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcad43) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3ad43&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/lib/libstdc++.so.6(+0xcb61f) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaecf3b61f&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x5c4) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x976674&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x705) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x9783b5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x961745&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(&lt;em&gt;ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1&lt;/em&gt;+0x11e1) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x964ad1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x882407&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x55c) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x888c2c&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x76) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa9c576&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /ebs/mongodb/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x287) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x638937&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x69ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaed18a9ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7ffaec73970d&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="77087" author="greg_10gen" created="Mon, 2 Jan 2012 17:47:52 +0000"  >&lt;p&gt;Issue isn&apos;t a race condition per-se, but depends heavily on the exact data being replicated and timing between hosts.  Definitely reopen if you continue to see in later versions.  &lt;/p&gt;</comment>
                            <comment id="72885" author="greg_10gen" created="Tue, 13 Dec 2011 20:54:05 +0000"  >&lt;p&gt;I suspect the issue was a race condition, but will verify with eliot.&lt;/p&gt;</comment>
                            <comment id="72822" author="psartini" created="Tue, 13 Dec 2011 18:33:10 +0000"  >&lt;p&gt;After switching the OS to Debian Squeeze (linux 2.6.32-5-amd64) we cannot reproduce the error.&lt;br/&gt;
It&apos;s now possible to enable the balancer without running into it.&lt;/p&gt;

&lt;p&gt;Same hardware, same database and similar load.&lt;/p&gt;</comment>
                            <comment id="71404" author="greg_10gen" created="Wed, 7 Dec 2011 14:54:20 +0000"  >&lt;p&gt;As soon as possible on our end - we&apos;re still testing some final stuff there, and MongoSV is going on right now, so probably right after. &lt;/p&gt;</comment>
                            <comment id="71389" author="psartini" created="Wed, 7 Dec 2011 12:47:35 +0000"  >&lt;p&gt;We can test to rollback to 2.0.0 tomorrow to be sure it is &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-4350&quot; title=&quot;Segmentation fault on replica recovery&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-4350&quot;&gt;&lt;del&gt;SERVER-4350&lt;/del&gt;&lt;/a&gt;.&lt;br/&gt;
Since there is no time pressure to re-enable balancing we will continue to use 2.0.1 afterward and wait for 2.0.2. Any hint when it will be available?&lt;/p&gt;</comment>
                            <comment id="71249" author="greg_10gen" created="Tue, 6 Dec 2011 21:16:17 +0000"  >&lt;p&gt;Actually this looks like &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-4350&quot; title=&quot;Segmentation fault on replica recovery&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-4350&quot;&gt;&lt;del&gt;SERVER-4350&lt;/del&gt;&lt;/a&gt; - one way to check would be to roll back to 2.0.0 mongod (though probably best only to test, since 2.0.1 contains other important fixes).  2.0.2 will have a fix for 4350, but it isn&apos;t fully integrated and tested in the rc yet.  &lt;/p&gt;</comment>
                            <comment id="71242" author="psartini" created="Tue, 6 Dec 2011 20:28:25 +0000"  >&lt;p&gt;I&apos;ve added the december log of one slave to SUPPORT-186. If you need master log as well you can get it, but there is a warning for each insert (bad shard config), so its bigger and takes some time to get.&lt;/p&gt;

&lt;p&gt;The MMS group is &quot;randombit GmbH&quot;&lt;/p&gt;</comment>
                            <comment id="71231" author="greg_10gen" created="Tue, 6 Dec 2011 19:50:42 +0000"  >&lt;p&gt;If you&apos;d like to open a ticket in the SUPPORT/Community Private group, only 10gen will be able to see it and the attachments - just mention this ticket in the description and ideally link it.  What&apos;s the mms group?&lt;/p&gt;

&lt;p&gt;In the meantime you can send the logs to greg@10gen.com, but it&apos;s hard to track issues that way so we should keep the discussion here.  &lt;/p&gt;</comment>
                            <comment id="71228" author="psartini" created="Tue, 6 Dec 2011 19:44:55 +0000"  >&lt;p&gt;It is a 64 bit machine:&lt;br/&gt;
{{&lt;br/&gt;
root@machine:~# isainfo -kv&lt;br/&gt;
64-bit amd64 kernel modules&lt;br/&gt;
}}&lt;/p&gt;

&lt;p&gt;Unfortunately I can&apos;t attach the log file in public, but could make it available to you (10gen).&lt;br/&gt;
May I send it to your eMail? Could not find an option to restrict attachements in Jira.&lt;/p&gt;

&lt;p&gt;MMS agent is active since today as well.&lt;/p&gt;</comment>
                            <comment id="71158" author="eliot" created="Tue, 6 Dec 2011 15:26:53 +0000"  >&lt;p&gt;Can you attach the full mongod log?&lt;/p&gt;

&lt;p&gt;Can you try a 64-bit machine as my first guess is mongod is running out of ram and its not being handled.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                        <issuelink>
            <issuekey id="25324">SERVER-4350</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>13.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 6 Dec 2011 15:26:53 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 1 week ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/SERVER-4350'>SERVER-4350</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 1 week ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10023"><![CDATA[Solaris]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>greg_10gen</customfieldvalue>
            <customfieldvalue>krauss</customfieldvalue>
            <customfieldvalue>psartini</customfieldvalue>
            <customfieldvalue>skottler</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrojtr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrit9j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>23394</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hszyzr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>