Uploaded image for project: 'Documentation'
  1. Documentation
  2. DOCS-4894

Pre-Aggregated Reports use case doc needs changing to reflect WiredTiger use

    XMLWordPrintable

    Details

    • # Replies:
      4
    • Last comment by Customer:
      true
    • Story Points:
      0.25
    • Sprint:
      Docs Sprint 2016 (01.25-02.12), Docs Q3 W9 (10/4)

      Description

      The "Pre-Aggregated Reports" use case doc page http://docs.mongodb.org/ecosystem/use-cases/pre-aggregated-reports/ is one of the most important use case pages for MongoDB, and is used and reference by many customers/users, especially w.r.t. to time-series type usage patterns, often found in Financial Services and IoT.

      With the introduction of WiredTiger in MongoDB version 3.0, some of the advice in this page may no longer be applicable and may need to be marked as applying to MMAPv1 use only.

      The page defines 4 key patterns:
      1. Pre-aggregation (update averages/mins/maxs for each consumed event rather than recording raw event).
      2. Bucketing (grouping sets of records together, eg. by day, for fast subsequent access - the pattern to deal with consuming lots of fine grained events and then servicing analytics/reports that want to retrieve coarse grained data).
      3. Pre-allocation (aka. pre-padding, to avoid excessive document growth and re-allocation)
      4. Intra-document-hierarchy (to prevent event ingestion latencies from increasing as the time of each day increases)

      Note: These patterns are also documented in chapter 4 of the book "MongoDB Applied Design Patterns" by Rick Copeland (O'Reilly)

      With the introduction of WiredTiger, it is likely that pattern 3 (Pre-allocation) is no longer required and perhaps would even be detrimental, due to the way WiredTiger deals with "in-place updates" internally. Also it could be that pattern 4 (intra-document hierarchy) also adds no value when using WiredTiger (this needs to be validated by someone).

      Please update the doc page to indicate which of the 4 patterns should not be applied, when running WiredTiger rather than MMAPv1.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              kay.kim Kay Kim (Inactive)
              Reporter:
              paul.done Paul Done
              Participants:
              Last commenter:
              Jonathan Dahl
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Days since reply:
                4 years, 3 weeks, 2 days ago
                Date of 1st Reply: