<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 08:24:03 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[DRIVERS-1811] Astrolabe Testing Improvements</title>
                <link>https://jira.mongodb.org/browse/DRIVERS-1811</link>
                <project id="10980" key="DRIVERS">Drivers</project>
                    <description>&lt;div class=&quot;panel&quot; style=&quot;background-color: #fafbfc;border-color: #21313c;border-style: solid;border-width: 1px;&quot;&gt;&lt;div class=&quot;panelContent&quot; style=&quot;background-color: #fafbfc;&quot;&gt;
&lt;h3&gt;&lt;a name=&quot;Summary&quot;&gt;&lt;/a&gt;&lt;b&gt;Summary&lt;/b&gt;&lt;/h3&gt;
&lt;p&gt;We need to make improvements to Astrolabe testing in order to be sure we are receiving the full benefit of the tool. This project captures the effort to increase stability of Astrolabe as well as verify the efficacy of its testing such that it is accurately surfacing driver bugs.  &lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;EfficacyImprovements&quot;&gt;&lt;/a&gt;Efficacy Improvements&lt;/h4&gt;
&lt;p&gt;The astrolabe project currently tests various Atlas planned maintenance scenarios in an attempt to find problematic scenarios indicating either driver bugs or bugs in the planned maintenance scenarios themselves. So far the project has not found bugs in either (aside from timeout issues in cloud-dev).&lt;/p&gt;

&lt;p&gt;We need to test Astrolabe itself to see if it actually achieves its goals. One way to do this would be to test a driver version that is known to have bugs related to planned maintenance, along with the workload that was used to reproduce the bug, and see if those bugs are reproduced by Astrolabe. We would want to continually test Astrolabe this way to ensure future changes to it don&apos;t obscure known driver bugs. As new driver bugs are found the pre-bugfix version of the driver, and the workload that reproduces the bug, should be added to a corpus of such tests.&lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;StabilityImprovements&quot;&gt;&lt;/a&gt;Stability Improvements&lt;/h4&gt;
&lt;p&gt;The Atlas Planned Maintenance test suite should only be red due to a driver, server or Atlas bug. Not because of an Astrolabe bug, or cloud-dev/cloud-qa instability. The Atlas Planned Maintenance tests have a number of stability issues that obscure the problems the test suite was intended to find, reducing or eliminating its value:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Tests often time out waiting for maintenance to complete&lt;/li&gt;
	&lt;li&gt;Tests often time out attempting to download logs&lt;/li&gt;
	&lt;li&gt;Tests sometimes OOM tracking APM events&lt;/li&gt;
	&lt;li&gt;etc. etc. etc.&lt;/li&gt;
&lt;/ul&gt;


&lt;h4&gt;&lt;a name=&quot;Apolicyfortriageoftestingfailures&quot;&gt;&lt;/a&gt;A policy for triage of testing failures&lt;/h4&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Automatically notify language teams when Astrolabe failures occur for their driver&lt;/li&gt;
	&lt;li&gt;Define a process for handing off triage to other teams (server, cloud, etc.) when triage determines there is no driver bug&lt;/li&gt;
&lt;/ul&gt;


&lt;h3&gt;&lt;a name=&quot;Motivation&quot;&gt;&lt;/a&gt;&lt;b&gt;Motivation&lt;/b&gt;&lt;/h3&gt;
&lt;h4&gt;&lt;a name=&quot;Whoistheaffectedenduser%3F&quot;&gt;&lt;/a&gt;Who is the affected end user?&lt;/h4&gt;
&lt;p&gt;No end users will be affected by this work as it is internal testing. Driver engineers are essentially the end users here and they may need to make changes to their atlas testing to accommodate updates that come out of this project. &lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;Isthisissueurgent%3F&quot;&gt;&lt;/a&gt;Is this issue urgent?&lt;/h4&gt;
&lt;p&gt;This ticket is urgent because we must have a strong functional validation mechanism between drivers and Atlas. This only becomes more urgent over time as Atlas functionality expands and usage continues to grow.&lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;Isthisticketrequiredbyadownstreamteam%3F&quot;&gt;&lt;/a&gt;Is this ticket required by a downstream team?&lt;/h4&gt;
&lt;p&gt;Not functionally, but our testing with Astrolabe is an essential verification mechanism between drivers and Atlas, so it is implicitly required cross-org. &lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;Isthisticketonlyfortests%3F&quot;&gt;&lt;/a&gt;Is this ticket only for tests?&lt;/h4&gt;
&lt;p&gt;Sort of - this project is solely about testing, however it involves making changes to Astrolabe and is more significant in urgency and scope than simply adding tests. &lt;/p&gt;

&lt;h3&gt;&lt;a name=&quot;CastofCharacters&quot;&gt;&lt;/a&gt;&lt;b&gt;Cast of Characters&lt;/b&gt;&lt;/h3&gt;
&lt;p&gt;Engineering Lead:&lt;br/&gt;
Document Author: &lt;br/&gt;
POCers: &lt;br/&gt;
Product Owner: &lt;br/&gt;
Program Manager: &lt;br/&gt;
Stakeholders:&lt;/p&gt;

&lt;h3&gt;&lt;a name=&quot;Channels%26Docs&quot;&gt;&lt;/a&gt;&lt;b&gt;Channels &amp;amp; Docs&lt;/b&gt;&lt;/h3&gt;
&lt;h4&gt;&lt;a name=&quot;RunningListofAstrolabeIssueshttps%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F1279kZL86IVImEvY5CcUlyIYn3OpR3BMTLVPo56pFn8%2Fedit%23heading%3Dh.50lves7axhyz&quot;&gt;&lt;/a&gt;&lt;a href=&quot;https://docs.google.com/document/d/1279kZL86IVImEvY5CcUl_yIYn3OpR3BMTLVPo56pFn8/edit#heading=h.50lves7axhyz&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Running List of Astrolabe Issues&lt;/a&gt;&lt;/h4&gt;
&lt;h4&gt;&lt;a name=&quot;SlackChannel&quot;&gt;&lt;/a&gt;Slack Channel&lt;/h4&gt;
&lt;h4&gt;&lt;a name=&quot;ScopeDocumentsome.url&quot;&gt;&lt;/a&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;Scope Document|some.url&amp;#93;&lt;/span&gt;&lt;/h4&gt;
&lt;h4&gt;&lt;a name=&quot;TechnicalDesignDocumentsome.url&quot;&gt;&lt;/a&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;Technical Design Document|some.url&amp;#93;&lt;/span&gt;&lt;/h4&gt;
&lt;/div&gt;&lt;/div&gt;</description>
                <environment></environment>
        <key id="1786966">DRIVERS-1811</key>
            <summary>Astrolabe Testing Improvements</summary>
                <type id="11" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14707&amp;avatarType=issuetype">Epic</type>
                                            <priority id="10300" iconUrl="https://jira.mongodb.org/images/icons/priorities/medium.svg">Unknown</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="rachelle.palmer@mongodb.com">Rachelle Palmer</reporter>
                        <labels>
                    </labels>
                <created>Wed, 16 Jun 2021 18:55:41 +0000</created>
                <updated>Wed, 15 Feb 2023 23:10:41 +0000</updated>
                            <resolved>Fri, 7 Jan 2022 14:19:54 +0000</resolved>
                                                                            <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="3924535" author="behackett" created="Fri, 9 Jul 2021 00:17:03 +0000"  >&lt;p&gt;This is an epic that was intended to encompass all of the Astrolabe projects in the backlog. I think we just haven&apos;t done the proper cleanup yet.&lt;/p&gt;</comment>
                            <comment id="3924531" author="kaitlin.mahar" created="Fri, 9 Jul 2021 00:11:29 +0000"  >&lt;p&gt;What is this ticket about? Is this related to (or is there a dependency on) &lt;a href=&quot;https://jira.mongodb.org/browse/DRIVERS-1576&quot; title=&quot;Testing the efficacy of Astrolabe&quot; class=&quot;issue-link&quot; data-issue-key=&quot;DRIVERS-1576&quot;&gt;&lt;del&gt;DRIVERS-1576&lt;/del&gt;&lt;/a&gt;?&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                                        </outwardlinks>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="1629922">DRIVERS-1576</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1708899">DRIVERS-1745</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10820">
                    <name>Initiative</name>
                                                                <inwardlinks description="included in Initiative">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_13653" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Detailed Project Statuses</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;Engineer(s): Oleg, Jeff&lt;/p&gt;

&lt;p&gt;Summary: Make improvements to Astrolabe testing in order to be sure we are receiving the full benefit of the tool. This project captures the effort to increase stability of Astrolabe as well as verify the efficacy of its testing such that it is accurately surfacing driver bugs.&lt;/p&gt;

&lt;p&gt;2021-12-01:&lt;br/&gt;
No updates since Oleg returned from vacation earlier this week&lt;/p&gt;

&lt;hr /&gt;

&lt;p&gt;2021-11-17:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;On pause while Oleg is on vacation&lt;/li&gt;
&lt;/ul&gt;


&lt;hr /&gt;

&lt;p&gt;2021-10-06:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Completed &lt;a href=&quot;https://jira.mongodb.org/browse/DRIVERS-1924&quot; title=&quot;Retrieve server logs in Astrolabe only when tests fail&quot; class=&quot;issue-link&quot; data-issue-key=&quot;DRIVERS-1924&quot;&gt;&lt;del&gt;DRIVERS-1924&lt;/del&gt;&lt;/a&gt;: Retrieve server logs only when tests fail&lt;/li&gt;
	&lt;li&gt;Completed &lt;a href=&quot;https://jira.mongodb.org/browse/DRIVERS-1923&quot; title=&quot;Retrieve logs in Astrolabe in separate task&quot; class=&quot;issue-link&quot; data-issue-key=&quot;DRIVERS-1923&quot;&gt;&lt;del&gt;DRIVERS-1923&lt;/del&gt;&lt;/a&gt;: Retrieve server logs in a separate task&lt;/li&gt;
	&lt;li&gt;Deferred DRIVERS-1691: Research ways to avoid OutOfMemory exception when we handle huge batch of events&lt;/li&gt;
	&lt;li&gt;Started DRIVERS-1932: When Astrolabe run fails due to issue with Atlas, color it lavender to indicate a setup failure rather than a task failure&lt;/li&gt;
	&lt;li&gt;Next up: RCA on the regularly occurring timeouts in Atlas QA.  Cory is going to help with triage in #astrolabe-triage Slack channel.  Eventually will add the on-call leads to assist&lt;/li&gt;
&lt;/ul&gt;


&lt;hr /&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17052" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Downstream Changes Summary</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;NA&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10951" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Driver Changes</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10940"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10860" key="com.pyxis.greenhopper.jira:gh-epic-color">
                        <customfieldname>Epic Colour</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ghx-label-12</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10858" key="com.pyxis.greenhopper.jira:gh-epic-label">
                        <customfieldname>Epic Name</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Astrolabe Testing Improvements</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10859" key="com.pyxis.greenhopper.jira:gh-epic-status">
                        <customfieldname>Epic Status</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10640"><![CDATA[To Do]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_23450" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Initiative Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[
                            <a href="https://jira.mongodb.org/browse/INIT-4">INIT-4</a> - Minimizing Atlas Planned Maintenance Impact
                    ]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_21553" key="com.atlassian.jira.plugin.system.customfieldtypes:labels">
                        <customfieldname>Quarter</customfieldname>
                        <customfieldvalues>
                                        <label>FY22Q4</label>
    
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hz7d1b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    </customfields>
    </item>
</channel>
</rss>