audio.c File Reference

🔊 Client audio management: capture thread, sample processing, and playback coordination More...

Go to the source code of this file.

Data Structures
struct	audio_send_packet_t
	Audio packet for async sending. More...

Macros
#define	AUDIO_SEND_QUEUE_SIZE   32
#define	AUDIO_VOLUME_BOOST   1.0f
#define	OPUS_FRAME_SAMPLES   960
#define	OPUS_MAX_PACKET_SIZE   500
#define	CAPTURE_READ_SIZE   (OPUS_FRAME_SAMPLES * 4)
#define	MAX_BATCH_FRAMES   8
#define	BATCH_TIMEOUT_NS   (40LL * NS_PER_MS_INT)

Functions
void	audio_process_received_samples (const float *samples, int num_samples)
	Process received audio samples from server.
int	audio_client_init (void)
	Initialize audio subsystem.
int	audio_start_thread (void)
	Start audio capture thread.
void	audio_stop_thread (void)
	Stop audio capture thread.
bool	audio_thread_exited (void)
	Check if audio capture thread has exited.
void	audio_cleanup (void)
	Cleanup audio subsystem.
client_audio_pipeline_t *	audio_get_pipeline (void)
	Get the audio pipeline (for advanced usage)
int	audio_decode_opus (const uint8_t *opus_data, size_t opus_len, float *output, int max_samples)
	Decode Opus packet using the audio pipeline.
audio_context_t *	audio_get_context (void)
	Get the global audio context for use by other subsystems.

Detailed Description

🔊 Client audio management: capture thread, sample processing, and playback coordination

The audio system implements a dual-thread architecture:

• Capture Thread: Records microphone input and transmits to server
• Playback System: Receives server audio and plays through speakers
• Processing Pipeline: Real-time audio enhancement and filtering
• Coordination: Thread-safe communication between capture and playback

Audio Processing Pipeline

Both incoming and outgoing audio undergo comprehensive processing:

1. High-pass Filter: Removes low-frequency rumble and noise
2. Noise Gate: Eliminates background noise during silence
3. Dynamic Range: Soft clipping to prevent harsh distortion
4. Volume Control: Configurable boost for optimal listening levels
5. Batching: Groups samples for efficient network transmission

Capture Thread Management

Audio capture runs in a dedicated thread:

• Continuous Recording: Real-time microphone sample capture
• Processing Chain: Applies filters and enhancement algorithms
• Network Transmission: Sends processed samples to server
• Adaptive Quality: Noise gate reduces traffic during silence
• Thread Safety: Coordinated shutdown and resource management

Batching and Network Efficiency

Audio samples are batched for network efficiency:

• Batch Accumulation: Collect multiple sample packets
• Smart Transmission: Send batches when full or gate closes
• Reduced Overhead: Fewer network packets for better performance
• Quality Preservation: Maintain audio quality while optimizing bandwidth

Platform Audio Integration

Uses PortAudio for cross-platform audio support:

• Device Enumeration: Automatic microphone and speaker detection
• Format Negotiation: Optimal sample rate and bit depth selection
• Low Latency: Optimized for real-time audio processing
• Error Handling: Graceful handling of device conflicts and changes

Integration Points

• main.c: Audio subsystem lifecycle and initialization
• server.c: Audio packet transmission to server
• protocol.c: Incoming audio packet processing and dispatch
• lib/audio.c: Low-level PortAudio device management
• lib/mixer.c: Audio filtering and processing algorithms

Error Handling

Audio errors handled with graceful degradation:

• Device Unavailable: Continue without audio, log warnings
• Processing Errors: Skip problematic samples, maintain stream
• Network Errors: Continue processing, let connection management handle
• Resource Errors: Clean shutdown with proper resource release

Resource Management

Careful audio resource lifecycle:

• Context Management: Proper PortAudio context initialization/cleanup
• Thread Coordination: Clean thread shutdown and resource release
• Buffer Management: Efficient sample buffer allocation and reuse
• Device Release: Proper microphone and speaker device cleanup

Author

Zachary Fogg me@zf.nosp@m.o.gg

Date

2025

Definition in file src/client/audio.c.

Macro Definition Documentation

AUDIO_SEND_QUEUE_SIZE

#define AUDIO_SEND_QUEUE_SIZE   32

Ring buffer queue for async audio packets

Definition at line 194 of file src/client/audio.c.

AUDIO_VOLUME_BOOST

#define AUDIO_VOLUME_BOOST   1.0f

Audio volume boost multiplier for received samples

Definition at line 379 of file src/client/audio.c.

BATCH_TIMEOUT_NS

#define BATCH_TIMEOUT_NS   (40LL * NS_PER_MS_INT)

CAPTURE_READ_SIZE

#define CAPTURE_READ_SIZE   (OPUS_FRAME_SAMPLES * 4)

MAX_BATCH_FRAMES

#define MAX_BATCH_FRAMES   8

OPUS_FRAME_SAMPLES

#define OPUS_FRAME_SAMPLES   960

OPUS_MAX_PACKET_SIZE

#define OPUS_MAX_PACKET_SIZE   500