Self-supervised federated learning
US12039998B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 4, 2022 |
| Grant date | Jul 16, 2024 |
| Priority date | — |
| Expiry date | Jan 6, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/18
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An acoustic event detection system may employ self-supervised federated learning to update encoder and/or classifier machine learning models. In an example operation, an encoder may be pre-trained to extract audio feature data from an audio signal. A decoder may be pre-trained to predict a subsequent portion of audio data (e.g., a subsequent frame of audio data represented by log filterbank energies). The encoder and decoder may be trained using self-supervised learning to improve the decoder's predictions and, by extension, the quality of the audio feature data generated by the encoder. The system may apply federated learning to share encoder updates across user devices. The system may fine-tune the classifier to improve inferences based on the improved audio feature data. The system may distribute classifier updates to the user device(s) to update the on-device classifier.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.