U Hi2@sddlZddlZddlmZmZmZddlmZddlm Z ddl m Z eGdddZ Gdd d Z Gd d d ZGd d d ZGdddZdS)N)OptionalDictAny) dataclass)Config)Logc@sbeZdZUdZdZeeed<dZee ed<dZ ee ed<dZ ee ed<dZ ee ed<dS) AudioMetadataz Represents metadata for a single audio chunk, including timing, item, and stream information. Used to track and annotate audio data as it flows through the processing pipeline. N timestampitem_id stream_idpayload format_type) __name__ __module__ __qualname____doc__r rint__annotations__r strr r r rr;/var/www/html/live_calls/homebook/services/audio_service.pyr s rc@s<eZdZdZdZeeedddZeee dddZ d S) AudioFormatConverterz Converts audio payloads for Mcube format. Ensures compatibility and provides a single place to update format logic if requirements change. audio/x-mulaw) wav_bytesreturnc CszVddl}ddl}|t|d}||}|}|| || }|WSt k r}z |WYSd}~XYnXdS)u Convert WAV audio bytes to μ-law format for MCube. Args: wav_bytes: Raw WAV audio data Returns: μ-law encoded audio bytes rNrb) waveaudioopopenioBytesIOZ readframesZ getnframesZ getframeratecloselin2ulawZ getsampwidth Exception)rrrZwav_ioframesZ sample_rateZ mulaw_dataerrr wav_to_mulaw!s z!AudioFormatConverter.wav_to_mulaw)r rcCs,zt|WdStk r&YdSXdS)z Validate that an audio payload is properly formatted base64. Args: payload: Audio payload to validate Returns: True if payload is valid base64, False otherwise TFN)base64 b64decoder#)r rrrvalidate_audio_payload?s  z+AudioFormatConverter.validate_audio_payloadN) rrrrZ MCUBE_FORMAT staticmethodbytesr&rboolr)rrrrrs rc@szeZdZdZddZeddddZeddd d Ze ed d d Z dd ddZ ee dddZ e ed ddZdS)AudioTimingManagerz Tracks and manages audio timing for responses and interruptions. Responsible for calculating durations, tracking the start of responses, and supporting precise interruption logic. cCsd|_d|_d|_dS)Nr)current_timestampresponse_start_timestamp last_item_idselfrrr__init__WszAudioTimingManager.__init__N)r rcCs ||_dS)z#Update the current audio timestamp.N)r.)r2r rrrupdate_timestamp\sz#AudioTimingManager.update_timestamp)r rcCs0|j|_||_tjr,td|d|jddS)z Start tracking a new response for timing calculations. Args: item_id: ID of the response item to track z$Starting response tracking for item z at msN)r.r/r0rSHOW_TIMING_MATHprintr2r rrrstart_response_tracking`sz*AudioTimingManager.start_response_trackingrcCsD|jdkrdS|j|j}tjr@td|jd|jd|d|S)z Calculate the duration of the current response. Returns: Duration in milliseconds, or None if no response is being tracked NzResponse duration: z - z = r5)r/r.rr6r7)r2durationrrrcalculate_response_durationms    z.AudioTimingManager.calculate_response_durationcCsd|_d|_dS)zReset response tracking state.N)r/r0r1rrrreset_response_tracking~sz*AudioTimingManager.reset_response_trackingcCs ||jkS)z Determine if a new item should start being tracked. Args: item_id: ID of the item to check Returns: True if item should be tracked (is different from current) r0r8rrrshould_item_be_trackeds z)AudioTimingManager.should_item_be_trackedcCs|jS)z)Get the ID of the currently tracked item.r>r1rrrget_current_item_idsz&AudioTimingManager.get_current_item_id)rrrrr3rr4rr9rr<r=r,r?r@rrrrr-Qs  r-c@seZdZdZddZdeddddZeed d d Zdd d d Z e d ddZ ee ddddZ dd ddZed ddZdS)AudioBufferManagerz Handles buffering of audio chunks and synchronization marks. Maintains queues for both audio data and marks, supporting smooth streaming and interruption handling. cCsg|_g|_dSN) mark_queue audio_bufferr1rrrr3szAudioBufferManager.__init__ responsePartN) mark_namercCs|j|dS)z Add a synchronization mark to the queue. Args: mark_name: Name of the mark for identification N)rCappend)r2rFrrradd_markszAudioBufferManager.add_markr:cCs|jr|jdSdS)z Remove and return the oldest mark from the queue. Returns: The removed mark name, or None if queue is empty rN)rCpopr1rrr remove_markszAudioBufferManager.remove_markcCs|jdS)zClear all marks from the queue.N)rCclearr1rrr clear_marksszAudioBufferManager.clear_markscCst|jdkS)z.Check if there are pending marks in the queue.r)lenrCr1rrrhas_pending_markssz$AudioBufferManager.has_pending_marks)chunkmetadatarcCs|j|||jddS)z Add an audio chunk to the buffer with metadata. Args: chunk: Audio data chunk metadata: Associated metadata )rOrPr N)rDrGr )r2rOrPrrradd_audio_chunks z"AudioBufferManager.add_audio_chunkcCs|jdS)zClear the audio buffer.N)rDrKr1rrrclear_audio_buffersz%AudioBufferManager.clear_audio_buffercCs t|jS)z)Get the current size of the audio buffer.)rMrDr1rrrget_buffer_sizesz"AudioBufferManager.get_buffer_size)rE)rrrrr3rrHrrJrLr,rNrrQrRrrSrrrrrAs  rAc@seZdZdZddZeeeeee fdddZ eeeee fddd Z eeee fd d d Z ed dddZ eedddZedddZd dddZeedddZeeedddZeeedddZd S) AudioServicez Coordinates all audio processing operations for the application. Uses the format converter, timing manager, and buffer manager to process audio, manage synchronization, and handle interruptions for Service Type 4 (ElevenLabs). cCst|_t|_t|_dSrB)rZformat_converterr-timing_managerrAbuffer_managerr1rrrr3szAudioService.__init__) audio_bytesr rcCs|std|ddS|s8tdt|ddSzddlm}ddl}d}z|j||dd }d}Wntk rD}zz|j||d d }d }Wntk r2}zrz|||}d }WnTtk r } z4t d |d |d| WYWYWY*WdSd} ~ XYnXW5d}~XYnXW5d}~XYnXt j } | |  dd}|j} ddl} | | d} ddl}t| d}ddt j |dt|ddd}|WStk r}z6ddl}t d|t d|WYdSd}~XYnXdS)a# Process raw audio bytes (e.g., from Sarvam TTS) for MCube. Args: audio_bytes: Raw audio data in bytes stream_id: Mcube stream identifier Returns: Processed audio message for Mcube, or None if invalid u:⚠️ No audio bytes provided for processing (stream_id: )Nu@⚠️ No stream_id provided for audio processing (audio_bytes: z bytes)r) AudioSegmentZmp3)formatZwavz auto-detectedu3❌ Failed to load audio in any format. MP3 error: z , WAV error: z, Auto error: zutf-8Z playAudiorZaudio_i) contentTypeZ sampleRater name)eventmediau&❌ Error processing raw audio bytes: u❌ Traceback: )rwarningrMZpydubrYr from_filer r#errorrMCUBE_SAMPLE_RATEZset_frame_rateZ set_channelsZset_sample_widthraw_datarr"timer' b64encodedecoder traceback format_exc)r2rWr rYrZoriginal_formatZ pcm_audioZ mp3_errorZ wav_error auto_errorZtarget_sample_rateZ pcm_bytesrZ mulaw_audiorfZ audio_base64Z audio_messager%rirrrprocess_raw_audio_bytessX  J  z$AudioService.process_raw_audio_bytes)r r^rcCs|j|d||dS)z Create a checkpoint message for audio synchronization. Args: stream_id: Mcube stream identifier name: Name of the audio segment Returns: Mcube checkpoint message checkpoint)r_streamIdr^)rVrH)r2r r^rrrcreate_checkpoint_message*s z&AudioService.create_checkpoint_message)r rcCs|jd|dS)z Create a clear message to clear audio buffer. Args: stream_id: Mcube stream identifier Returns: Mcube clearAudio message Z clearAudio)r_rn)rVrR)r2r rrrcreate_clear_message<s z!AudioService.create_clear_messageN)r^rcCs&|j}tjr"|r"td|dS)z'Handle a playedStream event from Mcube.zProcessed playedStream: N)rVrJrr6r7)r2r^Z removed_markrrrhandle_played_stream_eventLs  z'AudioService.handle_played_stream_eventr:cCs |jS)z Calculate timing for audio interruption. Returns: Elapsed time for truncation, or None if no response is tracked )rUr<r1rrrcalculate_interruption_timingRsz*AudioService.calculate_interruption_timingcCs"|jjdk o |jo |jjdk S)z Determine if an interruption should be processed. Returns: True if interruption should be handled N)rUr0rVrNr/r1rrrshould_handle_interruption[s   z'AudioService.should_handle_interruptioncCs|j|jdS)z%Reset all interruption-related state.N)rUr=rVrLr1rrrreset_interruption_statefs z%AudioService.reset_interruption_statecCs |jS)z/Get the ID of the currently tracked audio item.)rUr@r1rrrr@ksz AudioService.get_current_item_id)datarc Cs.z|ddWSttfk r(YdSXdS)z&Extract audio payload from Mcube data.r`r N)KeyError TypeErrorr2rurrr_extract_mcube_payloadosz#AudioService._extract_mcube_payloadc Cs4zt|ddWStttfk r.YdSXdS)z"Extract timestamp from Mcube data.r`r N)rrvrw ValueErrorrxrrr_extract_mcube_timestampvsz%AudioService._extract_mcube_timestamp)rrrrr3r+rrrrrlrorprqrrrr,rsrtr@dictryr{rrrrrTsN  rT)r'rtypingrrr dataclassesrconfigrservices.log_utilsrrrr-rArTrrrrs    ;C;