Patent · US Active

Method and system for scalable acceleration of data processing pipeline

US12050563B2 · kind B2 · utility

0Cited by

1References

6Claims

0Family size

Assignee

Tata Consultancy Services Limited · IN

Inventors

Mayank Mishra · Singapore, SG
Archisman Bhowmick · Thane, IN
Rekha Singhal · Thane, IN

Key dates

Filing date	Oct 25, 2022
Grant date	Jul 30, 2024
Priority date	—
Expiry date	Dec 13, 2042

Classification

Technology area (CPC G)Physics
CPC primaryG06F16/217
WIPO fieldComputer technology
WIPO sectorElectrical engineering

Abstract

The present disclosure provides a scalable acceleration of data processing in Machine Learning pipeline which is unavailable in conventional methods. Initially, the system receives a dataset and a data processing code. A plurality of sample datasets are obtained based on the received dataset using a sampling technique. A plurality of performance parameters corresponding to each of the plurality of sample datasets are obtained based on the data processing code using a profiling technique. A plurality of scalable performance parameters corresponding to each of a plurality of larger datasets are predicted based on the plurality of performance parameters and the data processing code using a curve fitting technique. Simultaneously, a plurality of anti-patterns are located in the data processing code using a pattern matching technique. Finally, an accelerated code is recommended based on the plurality of anti-patterns and the predicted plurality of scalable performance parameters using an accelerated code recommendation technique.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.