o y i#@sbddlZddlZddlZddlmZmZmZddlmZddl m Z ddl m Z GdddZ dS)N)OptionalListCallable)datetime)Config)Logc@seZdZdZddZdededdfdd Zd edefd d Z d ededdfddZ d ededdfddZ d ededdfddZ d ededdfddZ d ededdfddZdeddfddZd"ddZd#dededdfddZdefd d!ZdS)$VoiceActivityDetectorz Voice Activity Detection service for handling long user speech. Detects when user starts and stops speaking using volume-based analysis. Waits for natural silence before transcribing complete user input. c Cstj|_tj|_tj|_tj|_tj |_ d|_ d|_ d|_ d|_g|_d|_d|_d|_td|jd|jd|jddS)NFu 🎤 VAD initialized - Enabled: z, Silence threshold: z, Silence duration: s)rZ VAD_ENABLEDenabledZVAD_SILENCE_THRESHOLDsilence_thresholdZVAD_SILENCE_DURATIONsilence_durationZVAD_MAX_SPEECH_DURATIONmax_speech_durationZVAD_MIN_SPEECH_DURATIONmin_speech_duration is_speakingspeech_start_timelast_speech_timesilence_start_time audio_bufferprocessing_lockon_speech_start on_speech_endrinfoselfrservices/vad_service.py__init__s(zVoiceActivityDetector.__init__ audio_data session_idreturnNc Cs|jsdS|jrtd|dSzzd|_t|}||}t }|j |t |j dkrNt dt |j d|||WWd|_dS||jkrd|js]|||n|||n|jrn|||n||||jr|jr||j|jkrtd|jd |||Wnty}ztd |d |WYd}~n d}~wwWd|_dSWd|_dSd|_w) z Add audio chunk and analyze for voice activity. Args: audio_data: Base64 encoded audio data session_id: Session identifier for logging Nu7🎤 VAD processing locked, skipping chunk for session Tiu🎤 VAD buffer too large (z- chunks) - forcing transcription for session Fu"🎤 Max speech duration reached (z's) - forcing transcription for session u,❌ Error in VAD audio analysis for session z: )r rrdebugbase64Z b64decode_calculate_volumerZnowZ timestamprappendlenZwarning_force_transcriptionr r _start_speech_continue_speech_handle_silence_continue_silencerr r Exceptionerror)rrr audio_bytesvolume current_timeerrradd_audio_chunk)sL         " z%VoiceActivityDetector.add_audio_chunkr,c Cs~z#ddl}||d}t|dkr!||d}|d}t|dWSWdSty>}ztd|WYd}~dSd}~ww)z Calculate audio volume (RMS) from audio bytes. Args: audio_bytes: Raw audio data Returns: Volume level (0.0 to 1.0) rNg@g?gu!⚠️ Error calculating volume: )audioopZulaw2linr$rmsminr*rr )rr,r2Zpcm_datar3r-r/rrrr"es     z'VoiceActivityDetector._calculate_volumer.cCs@d|_||_||_d|_td||jr||dSdS)zHandle speech start detection.TNu 🎤 Speech started for session )rrrrrr rrr.rrrrr&sz#VoiceActivityDetector._start_speechcCs||_d|_dS)zHandle continuing speech.N)rrr5rrrr's z&VoiceActivityDetector._continue_speechcCs8|jdur||_||j}||jkr|||dSdS)zHandle silence during speech.N)rr _end_speech)rr.rr rrrr(s   z%VoiceActivityDetector._handle_silencecCsdS)zHandle continuing silence.Nrr5rrrr)sz'VoiceActivityDetector._continue_silencec Cs|jr|jsdS||j}||jkrAtd|d|ddt|j|jr;|jr;|j}| |||dS| dSt d|dd|| dS)zHandle speech end detection.Nu🎤 Speech ended for session z - Duration: z.1fzs, Buffer size: u🎤 Speech too short (zs) - ignoring for session ) rrrrrr$rrcopy _reset_stater )rr.rZspeech_duration buffer_copyrrrr6s   $    z!VoiceActivityDetector._end_speechcCsVtd|dt|j|jr%|jr%|j}||||dS|dS)z/Force transcription due to max speech duration.u'🎤 Forcing transcription for session z - Buffer size: N)rrr$rrr7r8)rrr9rrrr%s    z*VoiceActivityDetector._force_transcriptioncCs,d|_d|_d|_d|_|jd|_dS)zReset VAD state.FN)rrrrrclearrrrrrr8s   z"VoiceActivityDetector._reset_staterrcCs||_||_dS)z Set callback functions for speech events. Args: on_speech_start: Called when speech starts (session_id) on_speech_end: Called when speech ends (session_id, audio_buffer) N)rr)rrrrrr set_callbackss z#VoiceActivityDetector.set_callbacksc Cs*|j|j|j|j|jt|j|j|jdS)z$Get current VAD state for debugging.)r rrrrZ buffer_sizer r ) r rrrrr$rr r rrrr get_stateszVoiceActivityDetector.get_state)rN)NN)__name__ __module__ __qualname____doc__rstrr0bytesfloatr"r&r'r(r)r6r%r8rr;dictr<rrrrr s<     r)ZasyncioZnumpyZnpr!typingrrrrZconfigrZservices.log_utilsrrrrrrs