Dynamically validating AI applications for compliance
US12111754B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 16, 2024 |
| Grant date | Oct 8, 2024 |
| Priority date | — |
| Expiry date | Apr 16, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The technology evaluates the compliance of an AI application with predefined guidelines. The technology obtains a set of guidelines defining operation boundaries of the AI application and constructs test cases associated with each guideline. Each test case can include a prompt, an expected outcome, and an expected explanation. The technology supplies the prompts to the AI application, receives case-specific outcomes and explanations from the AI application, and compares them with the expected outcomes and expected explanations. A compliance indicator is generated based on the evaluation results, indicating the degree of compliance of the AI application with the guidelines.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.