[SERVER-56179] Caida de nodos secundarios en MongoDB ReplicaSet Created: 19/Apr/21 Updated: 15/Jul/21 Resolved: 15/Jul/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | WiredTiger |
| Affects Version/s: | 4.4.4 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Frank Alejandro Aquino Altuna | Assignee: | Eric Sedor |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
| Operating System: | ALL |
| Participants: |
| Description |
|
Buenas tardes, Se ha estado presentando caídas de nodos en un replicaSet configurado con MongoDB Community 4.4.4. Se ha generado estos archivos .MDMP producto de las caídas de los nodos. Adicionalmente se adjunta el archivo de configuración para uno de los nodos y en los otros solo se cambia el puerto y la ruta de los archivos de la BD y del log.
También quisiera consultar que desde estas ultimas versiones el log File de los nodos crece muy rápido y eso dificulta ver el motivo de la cada, por mas que se ha configurado en 0 el systemlog en el archivo de configuración, sigue generando archivos log de gran tamaño.
Quedo atento a sus comentarios. Saludos cordiales,
|
| Comments |
| Comment by Eric Sedor [ 15/Jul/21 ] |
|
faaquinoa@gmail.com, I'm going to close this ticket. But we can reopen it if you can provide the additional information I requested and upload the logs and diagnostic data to this portal. |
| Comment by Eric Sedor [ 01/Jul/21 ] |
|
faaquinoa@gmail.com, I wanted to see if you got my last message. Are you able to provide files via the link I provided? |
| Comment by Eric Sedor [ 07/Jun/21 ] |
|
Hi faaquinoa@gmail.com, and sorry for the delay. Unfortunately I am not able to obtain files from the mediafire link you provided. Can you please upload the diagnostic.data directory to this new location on Box. Files uploaded here are private and only visible to MongoDB employees participating in this investigation. A few questions:
I understand the log files are large but if it is possible to upload diagnostic data and log files for a single crash, it will be very helpful in our investigation. Eric |
| Comment by Frank Alejandro Aquino Altuna [ 06/May/21 ] |
|
Hi Eric Sedor, In log of nodes this is show: {"t":\{"$date":"2021-05-06T14:05:29.879-05:00"} ,"s":"W", "c":"-", "id":23075, "ctx":"conn26","msg":"DBException thrown","attr":{"error": {"code":262,"codeName":"ExceededTimeLimit","errmsg":"operation exceeded time limit"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31380, "ctx":"conn26","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[ {"a":"7FF72AB97393","module":"mongod.exe","file":".../src/mongo/util/stacktrace_windows.cpp","line":349,"s":"mongo::`anonymous namespace'::printWindowsStackTraceImpl","s+":"43"},{"a":"7FF72ABA39FF","module":"mongod.exe","file":".../src/mongo/util/assert_util.cpp","line":82,"s":"mongo::DBException::traceIfNeeded","s+":"BF"},{"a":"7FF72ABFC461","module":"mongod.exe","file":".../src/mongo/util/assert_util.h","line":152,"s":"mongo::AssertionException::AssertionException","s+":"41"},{"a":"7FF72ABEAD13","module":"mongod.exe","file":".../src/mongo/util/assert_util.h","line":183,"s":"mongo::error_details::ExceptionForImpl<262,mongo::ExceptionForCat<2>,mongo::ExceptionForCat<10>,mongo::ExceptionForCat<14> >::ExceptionForImpl<262,mongo::ExceptionForCat<2>,mongo::ExceptionForCat<10>,mongo::ExceptionForCat<14> >","s+":"53"},{"a":"7FF72AC01E97","module":"mongod.exe","file":"C:/data/mci/1a6309d4f2fbd6937ba087af7c306dc3/src/build/opt/mongo/base/error_codes.cpp","line":2327,"s":"mongo::error_details::throwExceptionForStatus","s+":"1B07"},{"a":"7FF72ABA2F11","module":"mongod.exe","file":".../src/mongo/util/assert_util.cpp","line":276,"s":"mongo::internalAssertWithLocation","s+":"181"},{"a":"7FF7298E33EA","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":425,"s":"<lambda_e92ad99fc1275512ced0a76fd2cfd93f>::operator()","s+":"16A"},{"a":"7FF7298E0667","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":449,"s":"mongo::Interruptible::waitForConditionOrInterruptUntil<std::unique_lock<mongo::latch_detail::Latch>,<lambda_288a0b92bfbc0fe7785d4a35b7a95cde> >","s+":"137"},{"a":"7FF7298ED4DC","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":389,"s":"mongo::future_details::SharedStateBase::wait","s+":"AC"},{"a":"7FF729997DA0","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":679,"s":"mongo::future_details::SharedStateHolder<std::shared_ptr<mongo::repl::IsMasterResponse const > >::getNoThrow","s+":"20"},{"a":"7FF72997B615","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":286,"s":"mongo::Interruptible::runWithDeadline<<lambda_86d5c867d075c2bc03446f6a1a506613> >","s+":"65"},{"a":"7FF72997A4A1","module":"mongod.exe","file":".../src/mongo/db/repl/replication_coordinator_impl.cpp","line":178,"s":"mongo::repl::`anonymous namespace'::futureGetNoThrowWithDeadline<std::shared_ptr<mongo::repl::IsMasterResponse const > >","s+":"41"},{"a":"7FF729991783","module":"mongod.exe","file":".../src/mongo/db/repl/replication_coordinator_impl.cpp","line":2230,"s":"mongo::repl::ReplicationCoordinatorImpl::awaitIsMasterResponse","s+":"623"},{"a":"7FF729959853","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":110,"s":"mongo::repl::`anonymous namespace'::appendReplicationInfo","s+":"1B3"},{"a":"7FF729958043","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":510,"s":"mongo::repl::`anonymous namespace'::CmdHello::runWithReplyBuilder","s+":"CA3"},{"a":"7FF72A17B831","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":808,"s":"mongo::BasicCommandWithReplyBuilderInterface::Invocation::run","s+":"111"},{"a":"7FF72A17BD93","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":187,"s":"mongo::CommandHelpers::runCommandInvocation","s+":"83"},{"a":"7FF7298EC371","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":856,"s":"mongo::`anonymous namespace'::runCommandImpl","s+":"171"},{"a":"7FF7298E6F79","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1207,"s":"mongo::`anonymous namespace'::execCommandDatabase","s+":"1919"},{"a":"7FF7298E1D82","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1395,"s":"<lambda_544331c0dc5456bd033660d38db896d9>::operator()","s+":"5E2"},{"a":"7FF7298EA3C6","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1423,"s":"mongo::`anonymous namespace'::receivedCommands","s+":"B6"},{"a":"7FF7298E8B89","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1726,"s":"mongo::ServiceEntryPointCommon::handleRequest","s+":"989"},{"a":"7FF7298D65A2","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_mongod.cpp","line":291,"s":"mongo::ServiceEntryPointMongod::handleRequest","s+":"32"},{"a":"7FF7298D8AB7","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":483,"s":"mongo::ServiceStateMachine::processMessage","s+":"1B7"},{"a":"7FF7298D9091","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":577,"s":"mongo::ServiceStateMachine::_runNextInGuard","s+":"C1"},{"a":"7FF7298D81C4","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.26.28801/include/functional","line":910,"s":"std::_Func_impl_no_alloc<<lambda_b23af5efc3b61ab25bff0c3bcd13382b>,void>::_Do_call","s+":"54"},{"a":"7FF72A8C78E2","module":"mongod.exe","file":".../src/mongo/transport/service_executor_synchronous.cpp","line":127,"s":"<lambda_29546a6698e80e311a5ae805fe7aad67>::operator()","s+":"152"},{"a":"7FF72AA45AB6","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.26.28801/include/thread","line":43,"s":"std::thread::_Invoke<std::tuple<<lambda_30130984df28a890937aeb9eb32385d9> >,0>","s+":"36"},{"a":"7FFACEF0CDE0","module":"ucrtbase.dll","s":"o_realloc_base","s+":"60"},{"a":"7FFACF9D8364","module":"KERNEL32.DLL","s":"BaseThreadInitThunk","s+":"14"}]}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72AB97393","module":"mongod.exe","file":".../src/mongo/util/stacktrace_windows.cpp","line":349,"s":"mongo::`anonymous namespace'::printWindowsStackTraceImpl","s+":"43"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72ABA39FF","module":"mongod.exe","file":".../src/mongo/util/assert_util.cpp","line":82,"s":"mongo::DBException::traceIfNeeded","s+":"BF"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72ABFC461","module":"mongod.exe","file":".../src/mongo/util/assert_util.h","line":152,"s":"mongo::AssertionException::AssertionException","s+":"41"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72ABEAD13","module":"mongod.exe","file":".../src/mongo/util/assert_util.h","line":183,"s":"mongo::error_details::ExceptionForImpl<262,mongo::ExceptionForCat<2>,mongo::ExceptionForCat<10>,mongo::ExceptionForCat<14> >::ExceptionForImpl<262,mongo::ExceptionForCat<2>,mongo::ExceptionForCat<10>,mongo::ExceptionForCat<14> >","s+":"53"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72AC01E97","module":"mongod.exe","file":"C:/data/mci/1a6309d4f2fbd6937ba087af7c306dc3/src/build/opt/mongo/base/error_codes.cpp","line":2327,"s":"mongo::error_details::throwExceptionForStatus","s+":"1B07"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72ABA2F11","module":"mongod.exe","file":".../src/mongo/util/assert_util.cpp","line":276,"s":"mongo::internalAssertWithLocation","s+":"181"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298E33EA","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":425,"s":"<lambda_e92ad99fc1275512ced0a76fd2cfd93f>::operator()","s+":"16A"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298E0667","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":449,"s":"mongo::Interruptible::waitForConditionOrInterruptUntil<std::unique_lock<mongo::latch_detail::Latch>,<lambda_288a0b92bfbc0fe7785d4a35b7a95cde> >","s+":"137"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298ED4DC","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":389,"s":"mongo::future_details::SharedStateBase::wait","s+":"AC"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF729997DA0","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":679,"s":"mongo::future_details::SharedStateHolder<std::shared_ptr<mongo::repl::IsMasterResponse const > >::getNoThrow","s+":"20"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72997B615","module":"mongod.exe","file":".../src/mongo/util/interruptible.h","line":286,"s":"mongo::Interruptible::runWithDeadline<<lambda_86d5c867d075c2bc03446f6a1a506613> >","s+":"65"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72997A4A1","module":"mongod.exe","file":".../src/mongo/db/repl/replication_coordinator_impl.cpp","line":178,"s":"mongo::repl::`anonymous namespace'::futureGetNoThrowWithDeadline<std::shared_ptr<mongo::repl::IsMasterResponse const > >","s+":"41"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF729991783","module":"mongod.exe","file":".../src/mongo/db/repl/replication_coordinator_impl.cpp","line":2230,"s":"mongo::repl::ReplicationCoordinatorImpl::awaitIsMasterResponse","s+":"623"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF729959853","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":110,"s":"mongo::repl::`anonymous namespace'::appendReplicationInfo","s+":"1B3"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF729958043","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":510,"s":"mongo::repl::`anonymous namespace'::CmdHello::runWithReplyBuilder","s+":"CA3"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72A17B831","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":808,"s":"mongo::BasicCommandWithReplyBuilderInterface::Invocation::run","s+":"111"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72A17BD93","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":187,"s":"mongo::CommandHelpers::runCommandInvocation","s+":"83"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298EC371","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":856,"s":"mongo::`anonymous namespace'::runCommandImpl","s+":"171"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298E6F79","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1207,"s":"mongo::`anonymous namespace'::execCommandDatabase","s+":"1919"}}} {"t":\{"$date":"2021-05-06T14:05:29.925-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298E1D82","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1395,"s":"<lambda_544331c0dc5456bd033660d38db896d9>::operator()","s+":"5E2"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298EA3C6","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1423,"s":"mongo::`anonymous namespace'::receivedCommands","s+":"B6"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298E8B89","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1726,"s":"mongo::ServiceEntryPointCommon::handleRequest","s+":"989"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298D65A2","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_mongod.cpp","line":291,"s":"mongo::ServiceEntryPointMongod::handleRequest","s+":"32"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298D8AB7","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":483,"s":"mongo::ServiceStateMachine::_processMessage","s+":"1B7"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298D9091","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":577,"s":"mongo::ServiceStateMachine::_runNextInGuard","s+":"C1"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF7298D81C4","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.26.28801/include/functional","line":910,"s":"std::_Func_impl_no_alloc<<lambda_b23af5efc3b61ab25bff0c3bcd13382b>,void>::_Do_call","s+":"54"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72A8C78E2","module":"mongod.exe","file":".../src/mongo/transport/service_executor_synchronous.cpp","line":127,"s":"<lambda_29546a6698e80e311a5ae805fe7aad67>::operator()","s+":"152"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FF72AA45AB6","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.26.28801/include/thread","line":43,"s":"std::thread::_Invoke<std::tuple<<lambda_30130984df28a890937aeb9eb32385d9> >,0>","s+":"36"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FFACEF0CDE0","module":"ucrtbase.dll","s":"o__realloc_base","s+":"60"}}} {"t":\{"$date":"2021-05-06T14:05:29.926-05:00"},"s":"I", "c":"CONTROL", "id":31445, "ctx":"conn26","msg":" Frame: {frame}","attr":{"frame": {"a":"7FFACF9D8364","module":"KERNEL32.DLL","s":"BaseThreadInitThunk","s+":"14"}}}
|
| Comment by Frank Alejandro Aquino Altuna [ 29/Apr/21 ] |
|
https://www.mediafire.com/file/pzzvolyy2zunkqy/diagnostic.data.zip/file |
| Comment by Frank Alejandro Aquino Altuna [ 28/Apr/21 ] |
|
Hi Eric Sedor. The Mongo.log is a very heavy file that in just minutes reaches 500MB in size, and when the nodes fell, it reached a weight of 56GB and I don't think it can be loaded here. But the contents of the diagnostic.data folder if I can upload it here. Stay tuned to your comments.
|
| Comment by Frank Alejandro Aquino Altuna [ 28/Apr/21 ] |
|
Hi Eric Sedor. The Mongo.log is a very heavy file that in just minutes reaches 500MB in size, and when the nodes fell, it reached a weight of 56GB and I don't think it can be loaded here. But the contents of the diagnostic.data folder if I can upload it here. Stay tuned to your comments.
|
| Comment by Eric Sedor [ 27/Apr/21 ] |
|
Hi faaquinoa@gmail.com, thanks for your report. Would you please archive (tar or zip) the mongod.log files and the $dbpath/diagnostic.data directory (the contents are described here) and upload them to this support uploader location? Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time. Thank you, |