Intelligent big data system, and method and apparatus for providing intelligent big data service

US11315034B2 · kind B2 · utility

Assignee

• BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD. · CN

Inventors

• Kai Zhou · Shanghai, CN
• Qian Wang · San Jose, US
• Faen Zhang · Beijing, CN
• Kun Liu · Beijing, CN
• Yuanhao Xiao · Beijing, CN
• Dongze Xu · Beijing, CN
• Tianhan Xu · Beijing, CN
• Jiayuan Sun · Beijing, CN
• Lan Liu · Nanhu, CN

Key dates

• Filing date: Aug 30, 2018
• Grant date: Apr 26, 2022
• Expiry date: Feb 25, 2041

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N3/045
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A system comprises: a data warehouse, a storage device and a cluster including a plurality of computing nodes; the data warehouse is configured to store task data obtained from the user; at least one computing node in the cluster includes a resource scheduling component, and is configured to perform resource scheduling for the task and determine a computing node executing the task; the computing node executing the task comprises a model training component and/or a prediction component; the model training component is configured to, according to task data, invoke a corresponding type of learning model from the storage device; use sample data and training target included in the task data to train the learning model, to obtain the prediction model corresponding to the task and store the prediction model in the storage device; the prediction component is configured to obtain a prediction result output by the prediction model.