[SERVER-52685] Fix drivers-nightly-4.4's tests Created: 20/Oct/20  Updated: 29/Oct/23  Resolved: 09/Mar/21

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Richard Samuels (Inactive) Assignee: Prashant Mital (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-51384 Enable and Fix Compile for Drivers Ni... Closed
Duplicate
is duplicated by SERVER-53048 Python's drivers-nightly-4.4 tests sh... Closed
Related
is related to SERVER-53634 Use venv on Windows Closed
Backwards Compatibility: Fully Compatible
Participants:

 Description   

SERVER-51384 was filed to enable the drivers-nightly-4.4 project in Evergreen and fix compile, which has now been merged and closed.

This patch was run to check the outcome of the individual drivers tests, and all Java tests are failing with the following stack trace:

[2020/10/20 11:42:52.161] net.rubygrapefruit.platform.NativeIntegrationLinkageException: Native library 'libnative-platform-file-events.so' could not be loaded for Linux amd64.
[2020/10/20 11:42:52.161] 	at net.rubygrapefruit.platform.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:61)
[2020/10/20 11:42:52.161] 	at net.rubygrapefruit.platform.internal.Platform.initFileEventFunctions(Platform.java:143)
[2020/10/20 11:42:52.161] 	at net.rubygrapefruit.platform.internal.Platform$Linux.get(Platform.java:295)
[2020/10/20 11:42:52.161] 	at net.rubygrapefruit.platform.Native.get(Native.java:88)
[2020/10/20 11:42:52.161] 	at org.gradle.internal.watch.registry.impl.LinuxFileWatcherRegistryFactory.<init>(LinuxFileWatcherRegistryFactory.java:31)
[2020/10/20 11:42:52.161] 	at org.gradle.internal.service.scopes.VirtualFileSystemServices$GradleUserHomeServices.determineWatcherRegistryFactory(VirtualFileSystemServices.java:218)
[2020/10/20 11:42:52.161] 	at org.gradle.internal.service.scopes.VirtualFileSystemServices$GradleUserHomeServices.createVirtualFileSystem(VirtualFileSystemServices.java:195)
[2020/10/20 11:42:52.161] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2020/10/20 11:42:52.161] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[2020/10/20 11:42:52.161] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2020/10/20 11:42:52.163] 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:104)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.ReflectionBasedServiceMethod.invoke(ReflectionBasedServiceMethod.java:34)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryMethodService.invokeMethod(DefaultServiceRegistry.java:841)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:768)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.assembleParameters(DefaultServiceRegistry.java:781)
[2020/10/20 11:42:52.163] 	at org.gradle.internal.service.DefaultServiceRegistry$FactoryService.create(DefaultServiceRegistry.java:767)
[2020/10/20 11:42:52.164] 	at org.gradle.internal.service.DefaultServiceRegistry$ManagedObjectServiceProvider.getInstance(DefaultServiceRegistry.java:558)
[2020/10/20 11:42:52.164] 	at org.gradle.internal.service.DefaultServiceRegistry$SingletonService.get(DefaultServiceRegistry.java:616)
[2020/10/20 11:42:52.164] 	at org.gradle.internal.service.DefaultServiceRegistry.find(DefaultServiceRegistry.java:305)
[2020/10/20 11:42:52.164] 	at org.gradle.internal.service.DefaultServiceRegistry.get(DefaultServiceRegistry.java:289)
[2020/10/20 11:42:52.164] 	at org.gradle.internal.service.DefaultServiceRegistry.get(DefaultServiceRegistry.java:284)
[2020/10/20 11:42:52.164] 	at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:40)
[2020/10/20 11:42:52.164] 	at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:31)
[2020/10/20 11:42:52.164] 	at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:44)
[2020/10/20 11:42:52.164] 	at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:29)
[2020/10/20 11:42:52.164] 	at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:87)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:55)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.SubscribableBuildActionExecuter.execute(SubscribableBuildActionExecuter.java:60)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.SubscribableBuildActionExecuter.execute(SubscribableBuildActionExecuter.java:38)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.SessionScopeBuildActionExecuter.execute(SessionScopeBuildActionExecuter.java:68)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.SessionScopeBuildActionExecuter.execute(SessionScopeBuildActionExecuter.java:38)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:37)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:26)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:60)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:32)
[2020/10/20 11:42:52.165] 	at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:56)
[2020/10/20 11:42:52.166] 	at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:42)
[2020/10/20 11:42:52.166] 	at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:48)
[2020/10/20 11:42:52.166] 	at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:32)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.exec.ExecuteBuild.doBuild(ExecuteBuild.java:68)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:37)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.exec.WatchForDisconnection.execute(WatchForDisconnection.java:39)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.exec.ResetDeprecationLogger.execute(ResetDeprecationLogger.java:29)
[2020/10/20 11:42:52.166] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.RequestStopIfSingleUsedDaemon.execute(RequestStopIfSingleUsedDaemon.java:35)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.create(ForwardClientInput.java:78)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.create(ForwardClientInput.java:75)
[2020/10/20 11:42:52.167] 	at org.gradle.util.Swapper.swap(Swapper.java:38)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.ForwardClientInput.execute(ForwardClientInput.java:75)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.LogAndCheckHealth.execute(LogAndCheckHealth.java:55)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.LogToClient.doBuild(LogToClient.java:63)
[2020/10/20 11:42:52.167] 	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:37)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment.doBuild(EstablishBuildEnvironment.java:82)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:37)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy$1.run(StartBuildOrRespondWithBusy.java:52)
[2020/10/20 11:42:52.168] 	at org.gradle.launcher.daemon.server.DaemonStateCoordinator$1.run(DaemonStateCoordinator.java:297)
[2020/10/20 11:42:52.168] 	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
[2020/10/20 11:42:52.168] 	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
[2020/10/20 11:42:52.168] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[2020/10/20 11:42:52.168] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[2020/10/20 11:42:52.169] 	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.Thread.run(Thread.java:834)
[2020/10/20 11:42:52.169] Caused by: java.lang.UnsatisfiedLinkError: /root/.gradle/native/9f2fa17c089eee584f3420100432f77ec4c098959e4bf121a4d6054c26537dfb/linux-amd64/libnative-platform-file-events.so: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /root/.gradle/native/9f2fa17c089eee584f3420100432f77ec4c098959e4bf121a4d6054c26537dfb/linux-amd64/libnative-platform-file-events.so)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.ClassLoader$NativeLibrary.load0(Native Method)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2430)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2487)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2684)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2617)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.Runtime.load0(Runtime.java:767)
[2020/10/20 11:42:52.169] 	at java.base/java.lang.System.load(System.java:1834)
[2020/10/20 11:42:52.170] 	at net.rubygrapefruit.platform.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:51)
[2020/10/20 11:42:54.158] 	... 99 more
[2020/10/20 11:42:54.158] Starting Build 

 

Be advised that at the time of writing, the unittest db_repl_test is failing. When running patch builds against this project, you may need to comment out the "run mongo tests" function call just after the compile as a workaround.



 Comments   
Comment by Prashant Mital (Inactive) [ 09/Mar/21 ]

Closing this as BUILD-12368 has fixed the underlying issues that were causing the Python Driver's tests to fail.

Comment by Prashant Mital (Inactive) [ 30/Nov/20 ]

Python's test reporting requires a dependency that is currently missing on rhel70-small hosts. BUILD-12368 adds the Python toolchain to these hosts. I will proceed with fixing the test reporting once that is done.

Comment by Githook User [ 25/Nov/20 ]

Author:

{'name': 'Jeff Yemin', 'email': 'jeff.yemin@mongodb.com', 'username': 'jyemin'}

Message: SERVER-52685: Fix drivers-nightly

Comment by Jeffrey Yemin [ 25/Nov/20 ]

Assigning to prashant.mital to fix the remaining issue with Pymongo test reporting

Comment by Jeffrey Yemin [ 20/Nov/20 ]

I pushed my recommended changes to https://github.com/jyemin/mongo/tree/SERVER-52685. The patch build is failing on the server compilation step. Happy to pick this back up once that is resolved.

Comment by Jeffrey Yemin [ 17/Nov/20 ]

Just confirming: your request is that the drivers team take full ownership responsibility for https://github.com/mongodb/mongo/blob/v4.4/etc/drivers_nightly.yml? That is where the fixes I suggested are required.

Comment by Robert Guo (Inactive) [ 17/Nov/20 ]

Thanks for your input on the error message jeff.yemin. Would it be something you could ask someone on Drivers to change since STM doesn't work with drivers tests. My understanding with the change for SERVER-51384 is that we would help you get the Server compiled but Drivers' would own the test suite going forward. Happy to chat more to figure out an amicable ownership story for the suite.

Comment by Jeffrey Yemin [ 08/Nov/20 ]

richard.samuels

That error isn't actually fatal. You can see that the same error appears in standalone and replica set variants, but those tasks succeed.

The real cause is that there are two test failures, caused indirectly by a missing variable that run-tests.sh relies on. To fix that please add the following to the invocation of run-tests.sh:

SAFE_FOR_MULTI_MONGOS="true"

I also recommend the following changes:

  • Run tests in RHEL 7 rather than RHEL 6 (Java driver uses run_on: rhel70-small). I suspect this may be the cause of the non-fatal stack trace that you're seeing
  • Fix the upload of test results so they appear on the task page after completion. This will help to more easily diagnose future test failures. The Java driver does this with:

  "upload test results":
    - command: attach.xunit_results
      params:
        file: ./src/*/build/test-results/*/TEST-*.xml

The upload seems to be working for Python driver but not Java driver. Not sure why, but should be easily fixable.

Generated at Thu Feb 08 05:28:43 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.