Core Server
  1. Core Server
  2. SERVER-3253

aggregation: unsharded support $out

      Details

      • Type: New Feature New Feature
      • Status: Closed Closed
      • Priority: Major - P3 Major - P3
      • Resolution: Fixed
      • Affects Version/s: None
      • Fix Version/s: 2.5.2
      • Component/s: Aggregation Framework
      • Labels:
        None
      • # Replies:
        21
      • Last comment by Customer:
        true
      • Documentation Changes:
        Needed
      • Driver Changes:
        Needed

        Description

        Implement output option for aggregation pipelines

          Issue Links

          depends on

          Bug - A problem which impairs or prevents the functions of the product. SERVER-3627 sharded map-reduce output should be parallelized and properly distribute chunks

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

          New Feature - A new feature of the product, which has yet to be developed. SERVER-5932 support cursor based aggregation

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

          New Feature - A new feature of the product, which has yet to be developed. SERVER-8850 $tee command for aggregation framework

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.
          is depended on by

          New Feature - A new feature of the product, which has yet to be developed. CSHARP-800 Aggregate Command will support $out

          • Major - P3 - Major loss of function.
          • Resolved - A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.

          New Feature - A new feature of the product, which has yet to be developed. JAVA-912 Support $out aggregation pipeline operator

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

          New Feature - A new feature of the product, which has yet to be developed. SERVER-447 new aggregation framework

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

          New Feature - A new feature of the product, which has yet to be developed. DRIVERS-111 Support $out aggregation pipeline operator

          • Major - P3 - Major loss of function.
          • Waiting for Verification - Waiting to verify that QA case is in fact complete.

          Task - A task that needs to be done. DOCS-1832 Document $out support

          • Major - P3 - Major loss of function.
          • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

            Activity

            Ascending order - Click to sort in descending order
            • Comments
            15 older comments
            Hide
            Permalink
            auto (Inactive)             added a comment -

            Author:

            {u'username': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

            Message: SERVER-3253 Unsharded $out
            Branch: master
            https://github.com/mongodb/mongo/commit/ea776af8e3f982c488ca6d7476ab79e20733e9a9

            Show
            auto (Inactive)             added a comment - Author: {u'username': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'} Message: SERVER-3253 Unsharded $out Branch: master https://github.com/mongodb/mongo/commit/ea776af8e3f982c488ca6d7476ab79e20733e9a9
            Hide
            Permalink
            auto (Inactive)             added a comment -

            Author:

            {u'username': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

            Message: Use bulk-insert in $out

            About 4x faster at simple copy-collection benchmark.
            Follow-up to SERVER-3253
            Branch: master
            https://github.com/mongodb/mongo/commit/f8e37b3b9daffbb721e231bc4418b6c7aac93e8d

            Show
            auto (Inactive)             added a comment - Author: {u'username': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'} Message: Use bulk-insert in $out About 4x faster at simple copy-collection benchmark. Follow-up to SERVER-3253 Branch: master https://github.com/mongodb/mongo/commit/f8e37b3b9daffbb721e231bc4418b6c7aac93e8d
            Hide
            Permalink
            Shane R. Spencer             added a comment -

            I believe using a temporary collection and renaming it should be optional. I would love to use capped or TTL collections for aggregation results. I'm not sure if making this optional would also allow sharding to be done. I'm not too familiar with where code is processed when mongos is involved.

            Show
            Shane R. Spencer             added a comment - I believe using a temporary collection and renaming it should be optional. I would love to use capped or TTL collections for aggregation results. I'm not sure if making this optional would also allow sharding to be done. I'm not too familiar with where code is processed when mongos is involved.
            Hide
            Permalink
            Dan Pasette             added a comment -

            For those interested in experimenting with $out in the development release (v2.5.2), this feature is documented in the release notes: http://docs.mongodb.org/manual/release-notes/2.6/#aggregation-pipeline-changes

            Show
            Dan Pasette             added a comment - For those interested in experimenting with $out in the development release (v2.5.2), this feature is documented in the release notes: http://docs.mongodb.org/manual/release-notes/2.6/#aggregation-pipeline-changes
            Hide
            Permalink
            auto (Inactive)             added a comment -

            Author:

            {u'username': u'dannenberg', u'name': u'Matt Dannenberg', u'email': u'matt.dannenberg@10gen.com'}

            Message: SERVER-3253 expand $out testing
            Branch: master
            https://github.com/mongodb/mongo/commit/6ba8fc2f0ee77cffd2270556afc5984e44c1b243

            Show
            auto (Inactive)             added a comment - Author: {u'username': u'dannenberg', u'name': u'Matt Dannenberg', u'email': u'matt.dannenberg@10gen.com'} Message: SERVER-3253 expand $out testing Branch: master https://github.com/mongodb/mongo/commit/6ba8fc2f0ee77cffd2270556afc5984e44c1b243

              People

              • Votes:
                90 Vote for this issue
                Watchers:
                63 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Days since reply:
                  1 year, 20 weeks, 6 days ago
                  Date of 1st Reply: