Verification by metamorphic testing of applications that utilize artificial intelligence

US10438118B2 · kind B2 · utility

Assignee

• ACCENTURE GLOBAL SOLUTIONS LIMITED · IE

Inventors

• Anurag Dwarakanath · Bengaluru, IN
• Sanjay Podder · Thane, IN
• Neville Dubash · Mumbai, IN
• Kishore P. Durg · Bengaluru, IN
• Manish Ahuja · Pflugerville, US
• Raghotham M. RAO · Bengaluru, IN
• Samarth Sikand · Jaipur, IN
• Jagadeesh Chandra Bose Rantham Prabhakara · Chittoor, IN

Key dates

• Filing date: Sep 28, 2018
• Grant date: Oct 8, 2019
• Expiry date: Sep 28, 2038

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N3/045
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A device may receive, from a user device, a request to verify a machine learning (ML) application using a metamorphic testing procedure. The device may determine a type of ML process used by the ML application, and may select one or more metamorphic relations (MRs), to be used for performing the metamorphic testing procedure, based on the type of ML process. The device may receive test data to be used to test the ML application, wherein the test data is based on the one or more MRs, and may perform, by using the one or more MRs and the test data, the metamorphic testing procedure to verify one or more aspects of the ML application. The device may generate a report that indicates whether the one or more aspects of the ML application have been verified and may provide the report for display on an interface of the user device.