<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:42 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-152] slice and size pipeline commands not working in source connector.</title>
                <link>https://jira.mongodb.org/browse/KAFKA-152</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;If I have an array in my document and I wanted to know only the size of the array rather than actual array or to get the top 3 or top 10 rather than full array. I was able to use the pipeline commands&#160;slice and size in the mongo cli. But when i use the same in the mongo source connector configuration i don&apos;t see any data in the kafka topic.&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Interestingly i don&apos;t see any error or issue and I also see something like this in the logs which usually confirms data is published to the topic.&lt;/p&gt;

&lt;p&gt;Finished commitOffsets successfully in 3 ms.&lt;/p&gt;

&lt;p&gt;Can you please confirm what&apos;s the valid pipeline configuration to achieve the above scenario. Thanks in advance.&lt;/p&gt;</description>
                <environment>Kafka Connector: 1.2.0&lt;br/&gt;
MongoDb version: 3.6.17</environment>
        <key id="1458838">KAFKA-152</key>
            <summary>slice and size pipeline commands not working in source connector.</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13202">Works as Designed</resolution>
                                        <assignee username="ross@mongodb.com">Ross Lawley</assignee>
                                    <reporter username="sabari.mgn@gmail.com">Sabari Gandhi</reporter>
                        <labels>
                    </labels>
                <created>Tue, 1 Sep 2020 14:10:32 +0000</created>
                <updated>Fri, 27 Oct 2023 11:54:15 +0000</updated>
                            <resolved>Tue, 22 Sep 2020 09:26:11 +0000</resolved>
                                    <version>1.2.0</version>
                                                                        <votes>1</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="3394265" author="ross@10gen.com" created="Tue, 15 Sep 2020 13:18:56 +0000"  >&lt;p&gt;HI &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sabari.mgn%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;sabari.mgn@gmail.com&quot;&gt;sabari.mgn@gmail.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Just to let you know only the following &lt;a href=&quot;https://docs.mongodb.com/manual/changeStreams/#modify-change-stream-output&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;pipeline operators&lt;/a&gt;are supported by change streams. The source connector uses change streams to provide the CDC events.  Withoiut seeing the connector configuration I can&apos;t report back on if there is an error or if there is a misconfiguration.  In general server errors are reported back to the user.&lt;/p&gt;

&lt;p&gt;It may be worth looking at the schema design and how the data is organized when looking for a well architected solution.  There are a couple of support avenues open for yourself to get advice going forward:&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;our MongoDB support portal, located at &lt;a href=&quot;https://support.mongodb.com/welcome&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;support.mongodb.com&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;our MongoDB community portal, located &lt;a href=&quot;https://developer.mongodb.com/community/forums/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;All the best,&lt;/p&gt;

&lt;p&gt;Ross&lt;/p&gt;</comment>
                            <comment id="3369967" author="sabari.mgn@gmail.com" created="Tue, 1 Sep 2020 14:11:37 +0000"  >&lt;p&gt;FYI, I was trying to use the above to overcome the issue reported in &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-151&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/KAFKA-151&lt;/a&gt;&#160;and was not able to do it.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr69mf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>