[SERVER-6759] Nightly Subscription build failing on SUSE Created: 14/Aug/12  Updated: 11/Jul/16  Resolved: 21/Aug/12

Status: Closed
Project: Core Server
Component/s: Build
Affects Version/s: None
Fix Version/s: 2.2.0-rc2, 2.3.0

Type: Bug Priority: Major - P3
Reporter: Ian Whalen (Inactive) Assignee: Mathias Stearn
Resolution: Done Votes: 0
Labels: buildbot
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: HTML File test_output.html    
Issue Links:
Related
related to SERVER-6817 Continue research on tcmalloc static ... Closed
Operating System: ALL
Participants:

 Description   

http://buildbot-special.10gen.com/builders/Nightly%20Linux%2064-bit%20Subscription%20SUSE%2011/builds/39



 Comments   
Comment by auto [ 21/Aug/12 ]

Author:

{u'date': u'2012-08-21T13:54:12-07:00', u'email': u'eliot@10gen.com', u'name': u'Eliot Horowitz'}

Message: SERVER-6759 - work around for libm loading on some platforms
Branch: v2.2
https://github.com/mongodb/mongo/commit/056704b124f2ba0525345658d3897f93981b267e

Comment by auto [ 21/Aug/12 ]

Author:

{u'date': u'2012-08-21T13:54:12-07:00', u'email': u'eliot@10gen.com', u'name': u'Eliot Horowitz'}

Message: SERVER-6759 - work around for libm loading on some platforms
Branch: master
https://github.com/mongodb/mongo/commit/b3b22a00237291f03b1d8d1aa15d52c6799435e9

Comment by Andy Schwerin [ 20/Aug/12 ]

The fail from Eliot is actually from LD_PRELOADing the shared library tcmalloc over the statically linked one.

The one from Mathias on SUSE 11 does not repro if you copy the same binary to Ubuntu. Have to try copying in the other direction, still.

Comment by Eliot Horowitz (Inactive) [ 20/Aug/12 ]

Linux erh-tm3 3.0.0-17-generic #30-Ubuntu SMP Thu Mar 8 20:45:39 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
gcc version 4.6.1 (Ubuntu/Linaro 4.6.1-9ubuntu3)

 
Program received signal SIGSEGV, Segmentation fault.
0x0000000000d32075 in tcmalloc::CentralFreeList::FetchFromSpans (this=0x11dff40) at src/third_party/gperftools-2.0/src/central_freelist.cc:295
295	  ASSERT(span->objects != NULL);
(gdb) where
#0  0x0000000000d32075 in tcmalloc::CentralFreeList::FetchFromSpans (this=0x11dff40) at src/third_party/gperftools-2.0/src/central_freelist.cc:295
#1  0x0000000000d3200a in tcmalloc::CentralFreeList::FetchFromSpansSafe (this=0x11dff40) at src/third_party/gperftools-2.0/src/central_freelist.cc:283
#2  0x0000000000d31f49 in tcmalloc::CentralFreeList::RemoveRange (this=0x11dff40, start=0x7fffffffd220, end=0x7fffffffd228, N=1) at src/third_party/gperftools-2.0/src/central_freelist.cc:263
#3  0x0000000000d7b93f in tcmalloc::ThreadCache::FetchFromCentralCache (this=0x1631000, cl=28, byte_size=0) at src/third_party/gperftools-2.0/src/thread_cache.cc:162
#4  0x0000000000c61194 in tcmalloc::ThreadCache::Allocate (this=0x1631000, size=0, cl=28) at src/third_party/gperftools-2.0/src/thread_cache.h:341
#5  0x0000000000c5f6bd in (anonymous namespace)::do_malloc (size=0) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1068
#6  0x0000000000c6067b in (anonymous namespace)::cpp_alloc (size=30, nothrow=false) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1354
#7  0x0000000000ed395b in tc_new (size=30) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1530
#8  0x00007ffff6fb8059 in std::string::_Rep::_S_create(unsigned long, unsigned long, std::allocator<char> const&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#9  0x0000000000b5128e in std::string::_S_construct<char const*> (__beg=0x7ffff7ba2c8e "pprof", __end=0x7ffff7ba2c93 "", __a=...) at /usr/include/c++/4.6/bits/basic_string.tcc:140
#10 0x00007ffff6fb9bb3 in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::basic_string(char const*, std::allocator<char> const&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#11 0x00007ffff7b80b56 in ?? () from /usr/lib/libtcmalloc.so
#12 0x00007ffff7deab56 in ?? () from /lib64/ld-linux-x86-64.so.2
#13 0x00007ffff7deac2f in ?? () from /lib64/ld-linux-x86-64.so.2
#14 0x00007ffff7ddd5ea in ?? () from /lib64/ld-linux-x86-64.so.2
warning: (Internal error: pc 0x1 in read in psymtab, but not in symtab.)
 
warning: (Internal error: pc 0x0 in read in psymtab, but not in symtab.)
 
warning: (Internal error: pc 0x0 in read in psymtab, but not in symtab.)
 
#15 0x0000000000000001 in ?? ()
warning: (Internal error: pc 0x0 in read in psymtab, but not in symtab.)
 
#16 0x00007fffffffd880 in ?? ()
warning: (Internal error: pc 0x0 in read in psymtab, but not in symtab.)
 
#17 0x0000000000000000 in ?? ()
(gdb) 

Comment by Randall Hunt [ 15/Aug/12 ]

mongod is segfaulting which is why none of the tests are running.

I think the issue is with the tcmalloc change, as Ian pointed out earlier. I ran scons and then ran mongod in GDB to get the output below:

buildbot@ip-10-123-37-120:/data/buildslaves/Linux_64bit_Subscription_SUSE_11_Nightly/mongo> gdb mongod
---- SKIPPING LINES ----
Reading symbols from /data/buildslaves/Linux_64bit_Subscription_SUSE_11_Nightly/mongo/mongod...done.
(gdb) run
---- SKIPPING LINES ----
 
Program received signal SIGSEGV, Segmentation fault.
0x0000000000000000 in ?? ()
(gdb) backtrace
#0  0x0000000000000000 in ?? ()
#1  0x00000000009ee0f4 in tcmalloc::Sampler::PopulateFastLog2Table () at src/third_party/gperftools-2.0/src/sampler.cc:68
#2  0x000000000091d196 in tcmalloc::ThreadCache::InitModule () at src/third_party/gperftools-2.0/src/thread_cache.cc:313
#3  0x0000000000624825 in GetCache () at src/third_party/gperftools-2.0/src/thread_cache.h:385
#4  (anonymous namespace)::do_malloc (size=568) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1058
#5  0x0000000000b0bb0c in do_malloc_or_cpp_alloc (size=<optimized out>) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1005
#6  tc_malloc (size=568) at src/third_party/gperftools-2.0/src/tcmalloc.cc:1492
#7  0x00007ffff5bf1bba in __fopen_internal () from /lib64/libc.so.6
#8  0x00007ffff3e8319d in ?? () from /lib64/libselinux.so.1
#9  0x00007ffff3e8b7b6 in ?? () from /lib64/libselinux.so.1
#10 0x00007ffff7ffa710 in ?? ()
#11 0x00007ffff7fe3000 in ?? ()
#12 0x0000000000000000 in ?? ()
(gdb)

Generated at Thu Feb 08 03:12:37 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.