System, method and computer-accessible medium for capturing data changes

US11768954B2 · kind B2 · utility

Assignee

• CAPITAL ONE SERVICES, LLC · US

Inventors

• Mayur Jagtap · Frisco, US
• Naga Venkata Sriram Vadakattu · Frisco, US
• Abhijit Chitnis · Frisco, US
• Janardhan Prabhakara · Allen, US
• Anurag Jain · Mountain View, US
• Parvesh Kumar · Plano, US
• Rahul Surendra Nath · Frisco, US
• Behdad Forghani · Allen, US
• Mark Assousa · Plano, US

Key dates

• Filing date: Jun 16, 2020
• Grant date: Sep 26, 2023
• Expiry date: Jun 21, 2041

Classification

• Technology area (CPC G): Physics
• CPC primary: G06F21/31
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

The exemplary embodiments provide real-time data capture and processing which improves data processing performance and speed and facilitate passing of the processed data to various analytical sources, while maintaining superior data quality checks, particularly with respect to data elements associated with multiple data types. The proposed system and process can be used to continuously consume and listen to multiple events while mapping the events to appropriate schemas provided in a separate schema stream. The schema stream is provided once and cached to minimize bandwidth consumed by the transaction stream. The schema information is then further enriched with information from a metadata registry. The event data may then be compressed and aligned in memory tables based on the enriched schema. Once events are decoded and sorted into memory tables in accordance to the identified schema, each memory table can be processed in parallel.