Audio Intelligence: Enhancing Audio Transcriptions and Note-Taking Efficiency

Finding shortcuts that streamline our daily tasks is essential. That's why today I want to talk about an Apple Shortcuts that is helping how we handle audio transcriptions and note-taking: Audio Intelligence.

What is Audio Intelligence?

Created by @mikeje, Audio Intelligence is a shortcut designed to simplify and automate the audio transcription and note-taking process. It utilizes the Whisper API to transcribe audio files, which can be voice memos or files stored on your device or iCloud. What makes this shortcut particularly powerful is its ability to interact with GPT-4, providing detailed summaries, action items, concise summaries, and meeting notes, all neatly stored in Apple Notes.

Key Features

1. High-Quality Transcription: Uses the Whisper API to accurately transcribe your voice recordings or audio files.
2. Integration with GPT-4: Sends transcriptions to GPT-4 for summaries, action notes, and much more. You will need an OpenAI API key for this feature.
3. Customization: You can adjust the prompts sent to GPT-4 to suit your specific needs, whether summarizing a work meeting or creating detailed notes from a webinar.

Upcoming Features

@mikeje isn't stopping there. He is working to include options such as:

• Choice of Transcription Provider: You will be able to choose between AssemblyAI API, Whisper API, or running Whisper locally on iOS through ‘Aiko’.
• Choice of Large Language Models (LLM): Future options will include ChatGPT (app), OpenAI (API), and more.
• Speaker Diarization: It will identify different speakers within the audio and accurately attribute the transcripts.
• Transcribe and Summarize YouTube Videos and Podcasts: A highly anticipated feature that promises to add even more value.

Getting Started

To use Audio Intelligence, make sure you have an OpenAI API and run the shortcut from the voice memos share sheet if you are using a voice memo as your audio file. The shortcut is available for iOS 17 and has been downloaded 59 times since its release on April 26, 2024.

Conclusion

Whether you're a busy professional, a student, or just someone looking to optimize your workflow, Audio Intelligence could be the shortcut that improves your handling of transcriptions and notes. Not only will you save time, but you will also improve the quality and organization of your important records.