Pengi 🐧: An Audio Language Model for Audio Tasks

Pengi is an Audio Language Model that leverages Transfer Learning by framing all audio tasks as text-generation tasks. It takes as input, an audio recording, and text, and generates free-form text as output. The unified architecture of Pengi enables open-ended tasks and close-ended tasks without any additional fine-tuning or task-specific extensions.

The code repository is: microsoft/Pengi: An Audio Language model for Audio Tasks (github.com)