Computer-implemented method, apparatus for data processing, and computer system for controlling a control device of a conveyor system

US12351401B2 · kind B2 · utility

Assignee

• KÖRBER SUPPLY CHAIN LOGISTICS GMBH · DE

Inventors

• Michael Zettler · Alexandria, US
• Marc Christian Weber · Munich, DE
• Daniel Hein · Berlin, DE
• Clemens Otte · Munich, DE
• Martin Schall · Konstanz, DE
• Frank Pfeiffer · Monsheim, DE

Key dates

• Filing date: Feb 1, 2022
• Grant date: Jul 8, 2025
• Expiry date: Jun 18, 2042

Classification

• Technology area (CPC G): Physics
• CPC primary: G05B19/4189
• WIPO field: Handling
• WIPO sector: Mechanical engineering

Abstract

A computer-implemented method, a device for data processing and a computer system for controlling a control device of a conveyor system to achieve an alignment and/or a defined spacing of piece goods, wherein the control of the control device is determined by an agent acting according to Reinforcement Learning methods. An individual, local state vector of predefined dimension that is the same for all the piece goods is created for each of the piece goods and an action vector is selected from an action space according to a strategy that is the same for all piece goods for the current state vector of this piece good. These action vectors are projected onto the conveying elements, wherein conflicts are resolved. After a cycle time has elapsed, state vectors are created again for each piece good and evaluated with rewards and the strategy is adjusted.