IEEE SPS @ UF

Aude — biologically plausible audio scene analysis

Research on source separation and sound localization in real-world environments using informed models and a multi-microphone capture pipeline.

Aude project logo.

Overview

Aude develops an end-to-end audio research workflow: collect synchronized microphone-array data, benchmark state-of-the-art baselines, and train models for robust source separation and localization.

Aude is focused on machine listening in realistic environments where multiple sound sources overlap. The project combines hardware-informed data capture and model design to improve both source separation quality and spatial localization accuracy.

Aude is early-stage and honest about it: a charter, a roadmap, and a hardware plan for machine listening in messy real-world rooms.

The idea

Aude is aimed at biologically plausible audio scene analysis: separating overlapping sound sources and locating them spatially in real, reverberant environments rather than clean benchmark recordings. The plan pairs hardware-informed data capture — a small multi-microphone array — with models for source separation and localization, benchmarked against strong baselines.

How the project runs

Aude is run as a disciplined team project, which for research code matters as much as the models:

  • Every piece of work starts as an issue with a named owner.
  • Work happens on a branch per issue, and each pull request links its issue.
  • Nothing merges without passing CI and review.
  • Docs are split into meetings, experiments, datasets, and hardware so decisions are traceable.

Where it stands

This is the planning and data-capture stage: the charter, roadmap, and hardware plan exist, and the first runnable baselines are being stood up. I am keeping this page honest — there is no finished architecture to show yet, and I would rather say so than draw one that does not exist.

What I built

  • A project plan for reproducible baseline evaluation on source separation and localization tasks.
  • An initial hardware/data strategy using a 3-microphone capture setup with embedded collection components.
  • A milestone-driven workflow for moving from literature review to demoable, publishable results.

Related projects

Snapshot

Track
IEEE SPS @ UF · audio ML · ICASSP track
Status
Active; baseline and data-capture phase in progress.
Focus
Source separationLocalizationMulti-mic data capture

Stack

  • Python
  • Audio DSP + machine learning
  • Microphone array + ESP32 capture hardware

Glossary

Source separation
Separating mixed audio into individual underlying sources (for example, different speakers or instruments).
Localization
Estimating where a sound source is located relative to the microphones.