File table index aggregate statistics

US10909074B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Shane Mainali · Duvall, US
• Krishnan Varadarajan · Redmond, US
• Quan Zhang · Nanhu, CN
• Jegan Devaraju · Redmond, US
• Ziehen Sun · Sammamish, US
• Hao Feng · Bellevue, US
• Ju Wang · Redmond, US
• Manish Chablani · Redmond, US

Key dates

• Filing date: Apr 18, 2017
• Grant date: Feb 2, 2021
• Expiry date: Jun 22, 2038

Classification

• Technology area (CPC G): Physics
• CPC primary: G06F16/9027
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Embodiments provide a method to collect aggregate information or usage data quickly and efficiently with minimal lag. Additionally, the system can use this aggregate information internally for improved load balancing, better data placement, optimization, and enhanced debugging. The system can quickly look at aggregate information across a huge amount of data and drill down cheaply because the aggregate information is generated using existing processes. Aggregated statistics storage and collection may be built on top of an LSM tree used to store a persistent index for a cloud storage system. The statistics may also represent the result of an operation (e.g., max, min, sum, average) on selected parameter(s) or attribute(s) of stored data. Aggregate statistics values may be efficiently maintained during index merge and garbage collection processes or any other index management. As delta LSM trees are merged into a base LSM tree, the aggregates are updated in delta fashion.