<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:40:43 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-79338] Expand metrics found in reports to provide more coverage signal to MongoDB Teams</title>
                <link>https://jira.mongodb.org/browse/SERVER-79338</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;1. The number of times after a leader election a node goes into member state ROLLBACK. The server also logs some other metrics related to replication rollback like how many operations are being rolled back:&#160;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/fb679bde06827e98f7c55272a83c754959a3ffd6/src/mongo/db/repl/rollback_impl.cpp#L1529&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/blob/fb679bde06827e98f7c55272a83c754959a3ffd6/src/mongo/db/repl/rollback_impl.cpp#L1529&lt;/a&gt;&lt;br/&gt;
2. The number of times a chunk successfully migrates.&#160;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/fb679bde06827e98f7c55272a83c754959a3ffd6/src/mongo/db/s/migration_source_manager.cpp#L634-L635&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/blob/fb679bde06827e98f7c55272a83c754959a3ffd6/src/mongo/db/s/migration_source_manager.cpp#L634-L635&lt;/a&gt;&lt;br/&gt;
3. The number of times a node has 0 read tickets or write tickets available for operations. This kind of metric probably requires post-processing the contents&#160;of the diagnostic.data/ directory. It is something we can defer until exploring more into deadlock scenarios.&#160;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-75205&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-75205&lt;/a&gt;&#160;is the type of bug I&apos;m thinking of to know &quot;would it be possible for Antithesis to hit this?&quot;&lt;br/&gt;
&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="2400624">SERVER-79338</key>
            <summary>Expand metrics found in reports to provide more coverage signal to MongoDB Teams</summary>
                <type id="3" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14718&amp;avatarType=issuetype">Task</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="10038" iconUrl="https://jira.mongodb.org/images/icons/subtask.gif" description="">Backlog</status>
                    <statusCategory id="2" key="new" colorName="default"/>
                                    <resolution id="-1">Unresolved</resolution>
                                        <assignee username="devprod-correctness-team@mongodb.com">[DO NOT ASSIGN] Backlog - DevProd Correctness</assignee>
                                    <reporter username="javier.arguello@antithesis.com">javi Arguello</reporter>
                        <labels>
                            <label>antithesis</label>
                    </labels>
                <created>Tue, 25 Jul 2023 19:59:21 +0000</created>
                <updated>Mon, 23 Oct 2023 18:58:19 +0000</updated>
                                                                                                <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="5659281" author="JIRAUSER1272962" created="Fri, 25 Aug 2023 14:06:19 +0000"  >&lt;p&gt;(posting Max H. response for tracking)&lt;/p&gt;

&lt;p&gt;&#160;&lt;br/&gt;
1. These top level metrics look great.&lt;br/&gt;
2. Similar&#160;to graph B, I would want to see separate graphs for each type of operation being rolled back (insert, create, update, collMod, createIndexes, etc.). A histogram of that form would answer a question such as &quot;are most branches seeing a small number of inserts being rolled back?&quot; And so rather than summing up the total number of inserts rolled back over the course of the entire branch, we&apos;d track each rollback as its own event (effectively ignoring which branch in the experiment the rollback came from). We could additionally do a max(inserts within the branch) if we want to track something at the distribution of each branch within an experiment.&lt;br/&gt;
3. Thanks, I think for graphs A and B my brain would want to see them as a bar chart because the line suggests there&apos;s some continuity which doesn&apos;t really exist. Graph E is also interesting like you were thinking it would be!&#160;One adjustment to it I&apos;d recommend would be to narrow in the number of the transitions made by the specific mongod process which had the fatal error.&lt;br/&gt;
4. The metrics being in the report can&apos;t hurt in an &quot;at a glance&quot; sense though I feel like ultimately the fatal assertion / invariant / etc. text is going to be more informative of where to look next than likely what the metrics would&#160;say. Integrating our team&apos;s log message extraction on the server logs collected by Antithesis will probably be more&#160;of an area to focus on. I&apos;ll leave that to Alex to coordinate&#160;the priority.&lt;/p&gt;</comment>
                            <comment id="5633055" author="JIRAUSER1272962" created="Mon, 14 Aug 2023 18:04:09 +0000"  >&lt;p&gt;(pasting my email here to &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=max.hirschhorn%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;max.hirschhorn@mongodb.com&quot;&gt;max.hirschhorn@mongodb.com&lt;/a&gt;&#160; for easier visibility and context tracking)&lt;br/&gt;
&#160;&lt;br/&gt;
1) the top level metrics are good to go and highlighted at the top of each experiment report&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.1&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ8O2u34w_iSBjgnw2YUivuHJ3s1ZwfsHAzrP1NRvCYsSvHBB6b4pPsTOhjYkhNrv4DcGNS3O1U16drJ7Vxx3xu-3434x6QKBaYlFpL8Hnuw05dFVW8RWpJxE-o&amp;amp;disp=emb&amp;amp;realattid=ii_ll6q409j0&quot; height=&quot;410&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
2) In terms of the rollbackCommandCounts, is there some metric in particular that&apos;s interesting to track and/or a way to display the data? For example, here are a few ideas I could do:&#160;&lt;br/&gt;
&#160;&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;an aggregate&#160;count of the sum number of &quot;insert&quot;, &quot;create&quot;, &quot;update&quot;, &quot;collMod&quot; and &quot;createIndexes&quot; across the whole experiment?&#160;&lt;/li&gt;
	&lt;li&gt;sum of each across each branch?&#160;&lt;/li&gt;
	&lt;li&gt;the number of rollbacks that have an &quot;insert&quot;, but not a &quot;create&quot;? (or any combo of the various command options?)&#160;&lt;/li&gt;
	&lt;li&gt;how many branches have an &quot;collMod&quot; vs how many&#160;branches have a &quot;createIndexes&quot;&#160; (or any combo of the various command options)?&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
3) for the histograms representing the stats for each branch here&apos;s what those graphs would look like :&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
A.&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.2&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ8KYq52Dz5A1K5NOzC6-efyjILtBHmB9uWGT5tLrsvQvyOOJxlnj1e7NIq_yzNdSrMoCB1FbsZx-FMSr-KOKXsfhG-lcUva4JjOMSygury5tXkmnYZD30MuBEo&amp;amp;disp=emb&amp;amp;realattid=ii_ll6rz4i11&quot; height=&quot;269&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
B.&lt;br/&gt;
&#160; &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.3&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ9Arq9t2qiEKxqpy1aka8blzcdvO_H_02JaLw4l-JgTXWePQIm7ofiUeH85sc038Zkz9vlCTMlKm4XhSAdxNvLw3hissPe__H-N4shtHAoQrde95GLxLuEhCoc&amp;amp;disp=emb&amp;amp;realattid=ii_ll6rze4d2&quot; height=&quot;165&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
&#160;&lt;br/&gt;
however, in addition to these graphs I generated a few more charts in case any of these would also be interesting:&lt;br/&gt;
&#160;&lt;br/&gt;
C.&lt;br/&gt;
&#160; &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.4&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ-KV-R5R9QQuyxbgKIlkzN7X10DyH-umW1zGh5uIaF2TmA1dI99AYA1g2k9dt_o-jfPRprka4ubX3zeH5JVl2-4hxn2Ui-dazeHuw2qDJakedE3vS2x0PZr_e4&amp;amp;disp=emb&amp;amp;realattid=ii_ll6s3iwx3&quot; height=&quot;203&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
(this one above proves the statement &quot;The count would increase if the branch was played for a longer number of instructions&quot;)&lt;br/&gt;
&#160;&lt;br/&gt;
D.&lt;br/&gt;
&#160; &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.5&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ9OLuu9ZXM8zURwMIwhFvNk3Ee_NLcKn6jijfuWp0QDkfcZ3UyEQpGRbq4YxF7cynLbmrYE60E8f__LZ6E_bqGJ-1nO38qP3rIvR6RT4YhwrHMcvZDx6IcnUKY&amp;amp;disp=emb&amp;amp;realattid=ii_ll6s8ycu4&quot; height=&quot;188&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
E.&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.6&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ_pkvjzyqxMa9uSLFlLwdzYl0KHX6_HJdwcc5wnX8k6dkY-LAk-xyeVo0xuzxUQWnvhN0INKPeJEW3bE3zOhTgi0GMfKJJS69bIKZdxu2QiZ9vfBkqtW6yRHA0&amp;amp;disp=emb&amp;amp;realattid=ii_ll6s9b605&quot; height=&quot;190&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;I was thinking that some kind of connection to bugs could be interesting? This one above is the number of state transitions seen in branches that had a fatal failure (aka a bug). Note this experiment found a lot of fatals (many of them duplicates of the same failure).&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
F.&lt;br/&gt;
&#160;&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.7&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ9h6Ryrx04fkThRwaanieJL9H6qF3_iWvUpEzJ6kGpLvTJ7XK0QQSFwnjvsgb8eaqUfNiPJmT2okJ8pIyv7bMCuxTNky0U515mKu2dRTO9SSz3A_g24QEk3DzY&amp;amp;disp=emb&amp;amp;realattid=ii_ll6sctrv6&quot; height=&quot;274&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
This one above is a short snippet of the count of all 3 metrics for each branch based on its exit time. Similar to graph C above.&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
Let me know if any of these would be helpful to include, or if there&apos;s something else that would be helpful.&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
Finally, taking a different angle to this question, I wonder if the specific stats mean something in the presence of a fatal failure. So here&apos;s a mockup of what I could add to the specific debug report for a failure found:&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.8&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ-zKckdRg4iue42MBI1RF_DRVkdAnM1W0fxpJRQU3_GVRdpO58xdSX56yUsTkRFFJRuU5DZjmWg4ULgpvTJwbWLFlaC0xiuPdk50IBVXQReDud83mDDtnlTeWM&amp;amp;disp=emb&amp;amp;realattid=ii_ll6th0la7&quot; height=&quot;349&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
above is the mockup for a debug report including the counts of the new metrics, and below is a real debug report to see how it would fit&#160; &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://mail.google.com/mail/u/0?ui=2&amp;amp;ik=2d4ce5137f&amp;amp;attid=0.9&amp;amp;permmsgid=msg-a:r-6067312777461893317&amp;amp;th=189e6047564fb584&amp;amp;view=fimg&amp;amp;fur=ip&amp;amp;sz=s0-l75-ft&amp;amp;attbid=ANGjdJ__zBNarmEwoNViKgzl1fJnA8wYcOUuTzqsCAqlcpoclZf-Asgw9INhNiTiCKSLuv3dHH2mXBkrMjP5nFKF2JermrhvB4d2TvAZKfik4FmnWlkjIRPa_FjWMfQ&amp;amp;disp=emb&amp;amp;realattid=ii_ll6thnra8&quot; height=&quot;362&quot; width=&quot;562&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
&#160;&lt;br/&gt;
If it would be easier to hop on a quick call, let me know I can schedule something for 15 min to get feedback.&#160;&lt;br/&gt;
&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="26418"><![CDATA[Correctness]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 16 Aug 2023 18:38:31 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        23 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>iryna.zhuravlova@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            23 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>devprod-correctness-team@mongodb.com</customfieldvalue>
            <customfieldvalue>javier.arguello@antithesis.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i2jf5j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i21jg0:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i2j1av:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>