Load balancing and conflict processing in workflow with task dependencies

US10853130B1 · kind B1 · utility

Assignee

• Color Genomics, Inc. · US

Inventors

• Ryan Barrett · San Francisco, US
• Taylor Sittler · San Francisco, US
• Krishna Pant · San Jose, US
• Zhenghua Li · San Jose, US
• Katsuya Noguchi · San Francisco, US
• Nishant Bhat · San Francisco, US
• Othman Laraki · Palo Alto, US
• Jeroen Van den Akker · Palo Alto, US
• Kurt Smith · San Francisco, US

Key dates

• Filing date: Sep 19, 2017
• Grant date: Dec 1, 2020
• Expiry date: May 13, 2039

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N20/00
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Embodiments in the disclosure are directed to the use of distributed computing to align reads against multiple portions of a reference dataset. Aligned portions of the reference dataset that correspond with an above-threshold alignment score can be assessed for the presence of sparse indicators that can be categorized and used to influence a determination of a state transition likelihood. Various tasks associated with the processing of reads (e.g., alignment, sparse indicator detection, and/or determination of a state transition likelihood) may be able to take advantage of parallel processing and can be distributed among the machines while considering the resource utilization of those machines. Different load-balancing mechanisms can be employed in order to achieve even resource utilization across the machines, and in some cases may involve assessing various processing characteristics that reflect a predicted resource expenditure and/or time profile for each task to be processed by a machine.