aggregate

On this page本页内容

Definition定义

aggregate

Performs aggregation operation using the aggregation pipeline. 使用聚合管道执行聚合操作。The pipeline allows users to process data from a collection or other source with a sequence of stage-based manipulations.管道允许用户通过一系列基于阶段的操作来处理来自集合或其他来源的数据。

Syntax语法

The command has following syntax:该命令具有以下语法:

Changed in version 3.6.在版本3.6中更改。

{
  aggregate: "<collection>" || 1,
  pipeline: [ <stage>, <...> ],
  explain: <boolean>,
  allowDiskUse: <boolean>,
  cursor: <document>,
  maxTimeMS: <int>,
  bypassDocumentValidation: <boolean>,
  readConcern: <document>,
  collation: <document>,
  hint: <string or document>,
  comment: <any>,
  writeConcern: <document>
}

Tip

Rather than run the aggregate command directly, most users should use the db.collection.aggregate() helper provided in the mongo shell or the equivalent helper in their driver. 大多数用户应该使用mongo shell中提供的db.collection.aggregate()助手或其驱动程序中的等效帮助程序,而不是直接运行聚合命令。In 2.6 and later, the db.collection.aggregate() helper always returns a cursor.在2.6及更高版本中,db.collection.aggregate()助手始终返回一个游标。

Command Fields命令字段

The aggregate command takes the following fields as arguments:聚合命令将以下字段作为参数:

Field字段Type类型Description描述
aggregate string The name of the collection or view that acts as the input for the aggregation pipeline. 充当聚合管道输入的集合或视图的名称。Use 1 for collection agnostic commands.对于集合无关的命令,请使用1
pipeline array An array of aggregation pipeline stages that process and transform the document stream as part of the aggregation pipeline.聚合管道阶段的数组,作为聚合管道的一部分处理和转换文档流。
explain boolean

Optional.可选。Specifies to return the information on the processing of the pipeline.指定返回有关管道处理的信息。

Not available in multi-document transactions.多文档事务中不可用。

allowDiskUse boolean

Optional.可选。Enables writing to temporary files. 允许写入临时文件。When set to true, aggregation stages can write data to the _tmp subdirectory in the dbPath directory.当设置为true时,聚合阶段可以将数据写入dbPath目录中的_tmp子目录。

Starting in MongoDB 4.2, the profiler log messages and diagnostic log messages includes a usedDisk indicator if any aggregation stage wrote data to temporary files due to memory restrictions.从MongoDB 4.2开始,如果任何聚合阶段由于内存限制将数据写入临时文件,探查器日志消息诊断日志消息将包括usedDisk指示符。

cursor document

Specify a document that contains options that control the creation of the cursor object.指定包含控制游标对象创建的选项的文档。

Changed in version 3.6:在3.6版中更改:MongoDB 3.6 removes the use of aggregate command without the cursor option unless the command includes the explain option. MongoDB 3.6删除了不带cursor选项的聚合命令的使用,除非该命令包含explain选项。Unless you include the explain option, you must specify the cursor option.除非包含explain选项,否则必须指定cursor选项。

  • To indicate a cursor with the default batch size, specify cursor: {}.要使用默认的批处理大小指示游标,请指定cursor: {}
  • To indicate a cursor with a non-default batch size, use cursor: {batchSize: <num> }.要指示具有非默认批量大小的游标,请使用cursor: {batchSize: <num> }
maxTimeMS non-negative integer非负整数

Optional.可选。Specifies a time limit in milliseconds for processing operations on a cursor. 指定处理游标上的操作的时间限制(以毫秒为单位)。If you do not specify a value for maxTimeMS, operations will not time out. 如果未为maxTimeMS指定值,操作将不会超时。A value of 0 explicitly specifies the default unbounded behavior.0显式指定默认的无界行为。

MongoDB terminates operations that exceed their allotted time limit using the same mechanism as db.killOp(). MongoDB使用与db.killOp()相同的机制终止超过其分配时间限制的操作。MongoDB only terminates an operation at one of its designated interrupt points.MongoDB只在其指定的中断点之一终止操作。

bypassDocumentValidation boolean

Optional.可选。Applicable only if you specify the $out or $merge aggregation stages.仅在指定$out$merge聚合阶段时适用。

Enables aggregate to bypass document validation during the operation. 启用聚合在操作期间绕过文档验证。This lets you insert documents that do not meet the validation requirements.这样可以插入不符合验证要求的文档。

New in version 3.2.版本3.2中的新功能。

readConcern document

Optional.可选。Specifies the read concern.指定读取关注点

Starting in MongoDB 3.6, the readConcern option has the following syntax: 从MongoDB 3.6开始,readConcern选项具有以下语法:readConcern: { level: <value> }

Possible read concern levels are:可能的阅读关注级别包括:

For more formation on the read concern levels, see Read Concern Levels.有关阅读关注级别的更多信息,请参阅读取关注级别

Starting in MongoDB 4.2, the $out stage cannot be used in conjunction with read concern "linearizable". 从MongoDB 4.2开始,$out阶段不能与读关注点"linearizable"结合使用。That is, if you specify "linearizable" read concern for db.collection.aggregate(), you cannot include the $out stage in the pipeline.也就是说,如果指定了db.collection.aggregate()"linearizable"读取关注点,就不能在管道中包含$out阶段。

The $merge stage cannot be used in conjunction with read concern "linearizable". $merge阶段不能与读取关注"linearizable"一起使用。That is, if you specify "linearizable" read concern for db.collection.aggregate(), you cannot include the $merge stage in the pipeline.也就是说,如果指定了db.collection.aggregate()"linearizable"读取关注点,就不能在管道中包含$merge阶段。

collation document

Optional.可选择的

Specifies the collation to use for the operation.指定要用于该操作的排序规则

Collation allows users to specify language-specific rules for string comparison, such as rules for lettercase and accent marks.排序规则允许用户为字符串比较指定特定于语言的规则,例如字母大小写和重音符号的规则。

The collation option has the following syntax:排序规则选项语法如下所示:

collation: {
   locale: <string>,
   caseLevel: <boolean>,
   caseFirst: <string>,
   strength: <int>,
   numericOrdering: <boolean>,
   alternate: <string>,
   maxVariable: <string>,
   backwards: <boolean>
}

When specifying collation, the locale field is mandatory; all other collation fields are optional. 指定排序规则时,locale(区域设置)字段是必需的;所有其他排序规则字段都是可选的。For descriptions of the fields, see Collation Document.有关这些字段的描述,请参阅排序规则文档

If the collation is unspecified but the collection has a default collation (see db.createCollection()), the operation uses the collation specified for the collection.如果未指定排序规则,但集合具有默认排序规则(请参见db.createCollection()),则操作将使用为集合指定的排序规则。

If no collation is specified for the collection or for the operations, MongoDB uses the simple binary comparison used in prior versions for string comparisons.如果没有为集合或操作指定排序规则,MongoDB将使用以前版本中用于字符串比较的简单二进制比较。

You cannot specify multiple collations for an operation. 不能为一个操作指定多个排序规则。For example, you cannot specify different collations per field, or if performing a find with a sort, you cannot use one collation for the find and another for the sort.例如,不能为每个字段指定不同的排序规则,或者如果使用排序执行查找,则不能对查找使用一种排序规则,对排序使用另一种排序规则。

New in version 3.4.版本3.4中的新功能。

hint string or document

Optional.可选。The index to use for the aggregation. 用于聚合的索引。The index is on the initial collection/view against which the aggregation is run.索引位于运行聚合的初始集合/视图上。

Specify the index either by the index name or by the index specification document.通过索引名称或索引规范文档指定索引。

Note

The hint does not apply to $lookup and $graphLookup stages.hint不适用于$lookup$graphLookup阶段。

New in version 3.6.版本3.6中的新功能。

comment any

Optional.可选。A user-provided comment to attach to this command. 用户提供了要附加到此命令的注释。Once set, this comment appears alongside records of this command in the following locations:设置后,此注释将与此命令的记录一起出现在以下位置:

A comment can be any valid BSON type (string, integer, object, array, etc).注释可以是任何有效的BSON类型(字符串、整数、对象、数组等)。

Note

Any comment set on an aggregate command is inherited by any subsequent getMore commands running with the same cursorId returned from the aggregate command.聚合命令上的任何注释集都会被使用从aggregate命令返回的相同cursorId运行的任何后续getMore命令继承。

Changed in version 4.4.在版本4.4中更改。 Prior to 4.4, comments could only be strings.在4.4之前,注释只能是字符串。

writeConcern document

Optional.可选。A document that expresses the write concern to use with the $out or $merge stage.表示要与$out阶段或$merge阶段一起使用的写入关注的文档。

Omit to use the default write concern with the $out or $merge stage.忽略在$out阶段或$merge阶段使用默认写关注点。

MongoDB 3.6 removes the use of aggregate command without the cursor option unless the command includes the explain option. MongoDB 3.6删除了不带cursor选项的聚合命令的使用,除非该命令包含解释选项。Unless you include the explain option, you must specify the cursor option.除非包含explain选项,否则必须指定游标选项。

  • To indicate a cursor with the default batch size, specify cursor:{}.要使用默认的批处理大小指示游标,请指定cursor:{}
  • To indicate a cursor with a non-default batch size, use cursor: {batchSize: <num> }.要指示具有非默认批量大小的游标,请使用cursor: {batchSize: <num> }

For more information about the aggregation pipeline Aggregation Pipeline, Aggregation Reference, and Aggregation Pipeline Limits.有关聚合管道聚合管道聚合参考聚合管道限制的更多信息。

Sessions会话

New in version 4.0.版本4.0中的新功能。

For cursors created inside a session, you cannot call getMore outside the session.对于在会话内创建的游标,不能在会话外调用getMore

Similarly, for cursors created outside of a session, you cannot call getMore inside a session.同样,对于在会话外部创建的游标,不能在会话内部调用getMore

Session Idle Timeout会话空闲超时

Starting in MongoDB 3.6, MongoDB drivers and the mongo shell associate all operations with a server session, with the exception of unacknowledged write operations. 从MongoDB 3.6开始,MongoDB驱动程序和mongo shell将所有操作与服务器会话相关联,但未确认的写入操作除外。For operations not explicitly associated with a session (i.e. using Mongo.startSession()), MongoDB drivers and the mongo shell creates an implicit session and associates it with the operation.对于与会话没有显式关联的操作(即使用Mongo.startSession()),MongoDB驱动程序和mongo shell会创建一个隐式会话,并将其与操作关联。

If a session is idle for longer than 30 minutes, the MongoDB server marks that session as expired and may close it at any time. 如果会话空闲时间超过30分钟,MongoDB服务器会将该会话标记为已过期,并可随时将其关闭。When the MongoDB server closes the session, it also kills any in-progress operations and open cursors associated with the session. 当MongoDB服务器关闭会话时,它还会终止任何正在进行的操作以及与会话相关的打开游标。This includes cursors configured with noCursorTimeout or a maxTimeMS greater than 30 minutes.这包括配置了noCursorTimeoutmaxTimeMS(大于30分钟)的游标。

For operations that return a cursor, if the cursor may be idle for longer than 30 minutes, issue the operation within an explicit session using Session.startSession() and periodically refresh the session using the refreshSessions command. 对于返回游标的操作,如果游标空闲时间可能超过30分钟,请使用Session.startSession()在显式会话中发出该操作并使用refreshSessions命令定期刷新会话。See Session Idle Timeout for more information.有关更多信息,请参阅会话空闲超时

Transactions事务

aggregate can be used inside multi-document transactions.聚合可以在多文档事务中使用。

However, the following stages are not allowed within transactions:但是,交易中不允许以下阶段:

You also cannot specify the explain option.也不能指定explain选项。

Important重要的

In most cases, multi-document transaction incurs a greater performance cost over single document writes, and the availability of multi-document transactions should not be a replacement for effective schema design. 在大多数情况下,与单文档写入相比,多文档事务会带来更大的性能成本,而多文档事务的可用性不应取代有效的模式设计。For many scenarios, the denormalized data model (embedded documents and arrays) will continue to be optimal for your data and use cases. 对于许多场景,非规范化数据模型(嵌入式文档和数组)将继续适合您的数据和用例。That is, for many scenarios, modeling your data appropriately will minimize the need for multi-document transactions.也就是说,对于许多场景,适当地建模数据将最大限度地减少对多文档事务的需求。

For additional transactions usage considerations (such as runtime limit and oplog size limit), see also Production Considerations.有关其他事务使用注意事项(如运行时限制和oplog大小限制),请参阅生产注意事项

Client Disconnection客户端断开

For aggregate operation that do not include the $out or $merge stages:对于不包括$out阶段或$merge阶段的聚合操作:

Starting in MongoDB 4.2, if the client that issued the aggregate disconnects before the operation completes, MongoDB marks the aggregate for termination (i.e. killOp on the operation).从MongoDB 4.2开始,如果发出聚合的客户端在操作完成之前断开连接,MongoDB会将聚合标记为终止(即操作上的killOp)。

Example示例

Changed in version 3.4:在3.4版中更改:MongoDB 3.6 removes the use of aggregate command without the cursor option unless the command includes the explain option. MongoDB 3.6删除了不带cursor选项的聚合命令的使用,除非该命令包含explain选项。Unless you include the explain option, you must specify the cursor option.除非包含explain选项,否则必须指定cursor选项。

  • To indicate a cursor with the default batch size, specify cursor: {}.要使用默认的批处理大小指示游标,请指定cursor: {}
  • To indicate a cursor with a non-default batch size, use cursor: {batchSize: <num> }.要指示具有非默认批量大小的游标,请使用cursor: {batchSize: <num> }

Rather than run the aggregate command directly, most users should use the db.collection.aggregate() helper provided in the mongo shell or the equivalent helper in their driver. 大多数用户应该使用mongo shell中提供的db.collection.aggregate()助手或其驱动程序中的等效帮助程序,而不是直接运行aggregate命令。In 2.6 and later, the db.collection.aggregate() helper always returns a cursor.在2.6及更高版本中,db.collection.aggregate()助手始终返回一个游标。

Except for the first two examples which demonstrate the command syntax, the examples in this page use the db.collection.aggregate() helper.除了前两个演示命令语法的示例外,本页中的示例使用db.collection.aggregate()助手。

Aggregate Data with Multi-Stage Pipeline使用多级管道聚合数据

A collection articles contains documents such as the following:包含以下文档的articles集合:

{
   _id: ObjectId("52769ea0f3dc6ead47c9a1b2"),
   author: "abc123",
   title: "zzz",
   tags: [ "programming", "database", "mongodb" ]
}

The following example performs an aggregate operation on the articles collection to calculate the count of each distinct element in the tags array that appears in the collection.下面的示例对articles集合执行聚合操作,以计算集合中出现的tags数组中每个不同元素的计数。

db.runCommand( {
   aggregate: "articles",
   pipeline: [
      { $project: { tags: 1 } },
      { $unwind: "$tags" },
      { $group: { _id: "$tags", count: { $sum : 1 } } }
   ],
   cursor: { }
} )

In the mongo shell, this operation can use the db.collection.aggregate() helper as in the following:mongo shell中,此操作可以使用db.collection.aggregate()助手,如下所示:

db.articles.aggregate( [
   { $project: { tags: 1 } },
   { $unwind: "$tags" },
   { $group: { _id: "$tags", count: { $sum : 1 } } }
] )

Use $currentOp on an Admin Database在管理数据库上使用$currentOp

The following example runs a pipeline with two stages on the admin database. 下面的示例在管理数据库上运行一个带有两个阶段的管道。The first stage runs the $currentOp operation and the second stage filters the results of that operation.第一阶段运行$currentOp操作,第二阶段筛选该操作的结果。

db.adminCommand( {
   aggregate : 1,
   pipeline : [ {
      $currentOp : { allUsers : true, idleConnections : true } }, {
      $match : { shard : "shard01" }
      }
   ],
   cursor : { }
} )

Note

The aggregate command does not specify a collection and instead takes the form {aggregate: 1}. aggregate命令不指定集合,而是采用{aggregate:1}的形式。This is because the initial $currentOp stage does not draw input from a collection. 这是因为最初的$currentOp阶段没有从集合中提取输入。It produces its own data that the rest of the pipeline uses.它生成自己的数据,供管道的其余部分使用。

The new db.aggregate() helper has been added to assist in running collectionless aggregations such as this. 已添加新的db.aggregate()助手,以帮助运行无集合的聚合,例如此处。The above aggregation could also be run like this example.上面的聚合也可以像这个例子一样运行。

Return Information on the Aggregation Operation返回有关聚合操作的信息

The following aggregation operation sets the optional field explain to true to return information about the aggregation operation.以下聚合操作将可选字段explain设置为true,以返回有关聚合操作的信息。

db.orders.aggregate([
      { $match: { status: "A" } },
      { $group: { _id: "$cust_id", total: { $sum: "$amount" } } },
      { $sort: { total: -1 } }
   ],
   { explain: true }
)

Note

The explain output is subject to change between releases.explain输出可能会在不同版本之间发生变化。

See also参阅

db.collection.aggregate() method

Aggregate Data using External Sort使用外部排序聚合数据

Aggregation pipeline stages have maximum memory use limit. 聚合管道阶段有最大内存使用限制To handle large datasets, set allowDiskUse option to true to enable writing data to temporary files, as in the following example:要处理大型数据集,请将allowDiskUse选项设置为true,以允许将数据写入临时文件,如下例所示:

db.stocks.aggregate( [
      { $project : { cusip: 1, date: 1, price: 1, _id: 0 } },
      { $sort : { cusip : 1, date: 1 } }
   ],
   { allowDiskUse: true }
)

Starting in MongoDB 4.2, the profiler log messages and diagnostic log messages includes a usedDisk indicator if any aggregation stage wrote data to temporary files due to memory restrictions.从MongoDB 4.2开始,如果任何聚合阶段由于内存限制将数据写入临时文件,探查器日志消息诊断日志消息将包括usedDisk指示符。

Aggregate Data Specifying Batch Size指定批量大小的聚合数据

To specify an initial batch size, specify the batchSize in the cursor field, as in the following example:要指定初始批次大小,请在cursor字段中指定batchSize(批次大小),如下例所示:

db.orders.aggregate( [
      { $match: { status: "A" } },
      { $group: { _id: "$cust_id", total: { $sum: "$amount" } } },
      { $sort: { total: -1 } },
      { $limit: 2 }
   ],
   { cursor: { batchSize: 0 } }
)

The {batchSize: 0 } document specifies the size of the initial batch size only. {batchSize:0}文档仅指定初始批大小的大小。Specify subsequent batch sizes to OP_GET_MORE operations as with other MongoDB cursors. 与其他MongoDB游标一样,指定后续批处理大小以执行OP_GET_MORE操作。A batchSize of 0 means an empty first batch and is useful if you want to quickly get back a cursor or failure message, without doing significant server-side work.batchSize0表示第一批为空,如果希望在不做大量服务器端工作的情况下快速返回游标或失败消息,则该值非常有用。

Specify a Collation指定排序规则

New in version 3.4.版本3.4中的新功能。

Collation allows users to specify language-specific rules for string comparison, such as rules for lettercase and accent marks.排序规则允许用户为字符串比较指定特定于语言的规则,例如字母大小写和重音符号的规则。

A collection myColl has the following documents:myColl集合包含以下文档:

{ _id: 1, category: "café", status: "A" }
{ _id: 2, category: "cafe", status: "a" }
{ _id: 3, category: "cafE", status: "a" }

The following aggregation operation includes the Collation option:以下聚合操作包括排序规则选项:

db.myColl.aggregate(
   [ { $match: { status: "A" } }, { $group: { _id: "$category", count: { $sum: 1 } } } ],
   { collation: { locale: "fr", strength: 1 } }
);

For descriptions on the collation fields, see Collation Document.有关排序规则字段的说明,请参阅排序规则文档

Hint an Index提示索引

New in version 3.6.版本3.6中的新功能。

Create a collection foodColl with the following documents:使用以下文档创建集合foodColl

db.foodColl.insert([
   { _id: 1, category: "cake", type: "chocolate", qty: 10 },
   { _id: 2, category: "cake", type: "ice cream", qty: 25 },
   { _id: 3, category: "pie", type: "boston cream", qty: 20 },
   { _id: 4, category: "pie", type: "blueberry", qty: 15 }
])

Create the following indexes:创建以下索引:

db.foodColl.createIndex( { qty: 1, type: 1 } );
db.foodColl.createIndex( { qty: 1, category: 1 } );

The following aggregation operation includes the hint option to force the usage of the specified index:以下聚合操作包括hint选项,用于强制使用指定的索引:

db.foodColl.aggregate(
   [ { $sort: { qty: 1 }}, { $match: { category: "cake", qty: 10  } }, { $sort: { type: -1 } } ],
   { hint: { qty: 1, category: 1 } }
)

Override Default Read Concern覆盖默认读关注点

To override the default read concern level, use the readConcern option. 要覆盖默认的读取关注级别,请使用readConcern选项。The getMore command uses the readConcern level specified in the originating aggregate command.

You cannot use the $out or the $merge stage in conjunction with read concern "linearizable". That is, if you specify "linearizable" read concern for db.collection.aggregate(), you cannot include either stages in the pipeline.

The following operation on a replica set specifies a read concern of "majority" to read the most recent copy of the data confirmed as having been written to a majority of the nodes.以下对副本集的操作指定"majority"读取关注点,以读取确认已写入多数Node的数据的最新副本。

Important重要的

  • To use read concern level of "majority", replica sets must use WiredTiger storage engine.

    You can disable read concern "majority" for a deployment with a three-member primary-secondary-arbiter (PSA) architecture; however, this has implications for change streams (in MongoDB 4.0 and earlier only) and transactions on sharded clusters. For more information, see Disable Read Concern Majority.

  • Starting in MongoDB 4.2, you can specify read concern level "majority" for an aggregation that includes an $out stage.

    In MongoDB 4.0 and earlier, you cannot include the $out stage to use "majority" read concern for the aggregation.

  • Regardless of the read concern level, the most recent data on a node may not reflect the most recent version of the data in the system.
db.restaurants.aggregate(
   [ { $match: { rating: { $lt: 5 } } } ],
   { readConcern: { level: "majority" } }
)

To ensure that a single thread can read its own writes, use "majority" read concern and "majority" write concern against the primary of the replica set.