Diagnostic tool for deep learning similarity models
US11769315B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 3, 2022 |
| Grant date | Sep 26, 2023 |
| Priority date | — |
| Expiry date | Nov 3, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A diagnostic tool for deep learning similarity models and image classifiers provides valuable insight into neural network decision-making. A disclosed solution generates a saliency map by: receiving a baseline image and a test image; determining, with a convolutional neural network (CNN), a first similarity between the baseline image and the test image; based on at least determining the first similarity, determining, for the test image, a first activation map for at least one CNN layer; based on at least determining the first similarity, determining, for the test image, a first gradient map for the at least one CNN layer; and generating a first saliency map as an element-wise function of the first activation map and the first gradient map. Some examples further determine a region of interest (ROI) in the first saliency map, cropping the test image to an area corresponding to the ROI, and determine a refined similarity score.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.