[SERVER-2976] add a pure JS mode to map reduce to get improved performance for light jobs Created: 21/Apr/11 Updated: 12/Jul/16 Resolved: 27/Jun/11 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | MapReduce |
| Affects Version/s: | None |
| Fix Version/s: | 1.9.1 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Antoine Girbal | Assignee: | Antoine Girbal |
| Resolution: | Done | Votes: | 2 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Participants: |
| Description |
|
mongod will pick mode based on:
On Thu, Apr 21, 2011 at 2:41 PM, Antoine Girbal <antoine@10gen.com> wrote: |
| Comments |
| Comment by Eliot Horowitz (Inactive) [ 10/Jan/12 ] |
|
Please open a new ticket if you are having trouble sharded. |
| Comment by Juhi Bhatia [ 10/Jan/12 ] |
|
I get the same error for sharded enviornment, the stack trace being: com.mongodb.CommandResult$CommandFailure: command failed [command failed [mapreduce] { "serverUsed" : "localhost:27017" , "ok" : 0.0 , "errmsg" : "unknown m/r field for sharding: jsMode"} at com.mongodb.CommandResult.getException(CommandResult.java:75) Is jsMode : true not supported in sharded enviornment? |
| Comment by Nathan Ehresman [ 18/Oct/11 ] |
|
Is there a reason that this isn't supported in a sharded environment? When I attempt it I get: "unknown m/r field for sharding: jsMode". |
| Comment by Antoine Girbal [ 27/Jun/11 ] |
|
this mode is fully working but not sure it's a good idea to make it default for now. |
| Comment by auto [ 13/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 13/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 12/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 12/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 12/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 12/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 12/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by Antoine Girbal [ 11/May/11 ] |
|
some result from current code as of d47de50498be988f3a8b139214a63e80d4d9fac3 For the M/R of roundup.js (mongo downloads) we get about 2.5x , reduce: function(k,values) { return Array.sum( values); }, out: "myoutnew", verbose: true, jsMode: true }) SM in mixed mode: , , v8 in mixed mode: , , v8 in JS mode: , , — Test running jstests/mr1.js.. v8 in pure JS mode: |
| Comment by auto [ 10/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |
| Comment by auto [ 10/May/11 ] |
|
Author: {u'login': u'agirbal', u'name': u'agirbal', u'email': u'antoine@10gen.com'}Message: |