o i2@sddlZddlZddlmZmZmZddlmZddlm Z ddl m Z eGdddZ Gdd d Z Gd d d ZGd d d ZGdddZdS)N)OptionalDictAny) dataclass)Config)Logc@sbeZdZUdZdZeeed<dZee ed<dZ ee ed<dZ ee ed<dZ ee ed<dS) AudioMetadataz Represents metadata for a single audio chunk, including timing, item, and stream information. Used to track and annotate audio data as it flows through the processing pipeline. N timestampitem_id stream_idpayload format_type) __name__ __module__ __qualname____doc__r rint__annotations__r strr r r rr;/var/www/html/live_calls/homebook/services/audio_service.pyr s rc@s@eZdZdZdZededefddZedede fdd Z d S) AudioFormatConverterz Converts audio payloads for Mcube format. Ensures compatibility and provides a single place to update format logic if requirements change. audio/x-mulaw wav_bytesreturnc Csz+ddl}ddl}|t|d}||}|}|| || }|WSt y?}z|WYd}~Sd}~ww)u Convert WAV audio bytes to μ-law format for MCube. Args: wav_bytes: Raw WAV audio data Returns: μ-law encoded audio bytes rNrb) waveaudioopopenioBytesIO readframes getnframes getframeratecloselin2ulaw getsampwidth Exception)rrrwav_ioframes sample_rate mulaw_dataerrr wav_to_mulaw!s z!AudioFormatConverter.wav_to_mulawr cCs&zt|WdStyYdSw)z Validate that an audio payload is properly formatted base64. Args: payload: Audio payload to validate Returns: True if payload is valid base64, False otherwise TF)base64 b64decoder')r rrrvalidate_audio_payload?s   z+AudioFormatConverter.validate_audio_payloadN) rrrr MCUBE_FORMAT staticmethodbytesr-rboolr0rrrrrsrc@s|eZdZdZddZdeddfddZd eddfd d Zde efd d Z dddZ d ede fddZ de efddZdS)AudioTimingManagerz Tracks and manages audio timing for responses and interruptions. Responsible for calculating durations, tracking the start of responses, and supporting precise interruption logic. cCsd|_d|_d|_dS)Nr)current_timestampresponse_start_timestamp last_item_idselfrrr__init__Ws zAudioTimingManager.__init__r rNcCs ||_dS)z#Update the current audio timestamp.N)r6)r:r rrrupdate_timestamp\ z#AudioTimingManager.update_timestampr cCs4|j|_||_tjrtd|d|jddSdS)z Start tracking a new response for timing calculations. Args: item_id: ID of the response item to track z$Starting response tracking for item z at msN)r6r7r8rSHOW_TIMING_MATHprintr:r rrrstart_response_tracking`s z*AudioTimingManager.start_response_trackingcCsD|jdurdS|j|j}tjr td|jd|jd|d|S)z Calculate the duration of the current response. Returns: Duration in milliseconds, or None if no response is being tracked NzResponse duration: z - z = r>)r7r6rr?r@)r:durationrrrcalculate_response_durationms   z.AudioTimingManager.calculate_response_durationcCsd|_d|_dS)zReset response tracking state.N)r7r8r9rrrreset_response_tracking~s z*AudioTimingManager.reset_response_trackingcCs ||jkS)z Determine if a new item should start being tracked. Args: item_id: ID of the item to check Returns: True if item should be tracked (is different from current) r8rArrrshould_item_be_trackeds z)AudioTimingManager.should_item_be_trackedcCs|jS)z)Get the ID of the currently tracked item.rFr9rrrget_current_item_idsz&AudioTimingManager.get_current_item_idrN)rrrrr;rr<rrBrrDrEr4rGrHrrrrr5Qs  r5c@seZdZdZddZddeddfdd Zdeefd d Zdd d Z de fddZ dede ddfddZ dddZdefddZdS)AudioBufferManagerz Handles buffering of audio chunks and synchronization marks. Maintains queues for both audio data and marks, supporting smooth streaming and interruption handling. cCsg|_g|_dSN) mark_queue audio_bufferr9rrrr;s zAudioBufferManager.__init__ responsePart mark_namerNcCs|j|dS)z Add a synchronization mark to the queue. Args: mark_name: Name of the mark for identification N)rLappend)r:rOrrradd_markszAudioBufferManager.add_markcCs|jr |jdSdS)z Remove and return the oldest mark from the queue. Returns: The removed mark name, or None if queue is empty rN)rLpopr9rrr remove_markszAudioBufferManager.remove_markcC|jdS)zClear all marks from the queue.N)rLclearr9rrr clear_markszAudioBufferManager.clear_markscCst|jdkS)z.Check if there are pending marks in the queue.r)lenrLr9rrrhas_pending_marksrWz$AudioBufferManager.has_pending_markschunkmetadatacCs|j|||jddS)z Add an audio chunk to the buffer with metadata. Args: chunk: Audio data chunk metadata: Associated metadata )rZr[r N)rMrPr )r:rZr[rrradd_audio_chunks  z"AudioBufferManager.add_audio_chunkcCrT)zClear the audio buffer.N)rMrUr9rrrclear_audio_bufferrWz%AudioBufferManager.clear_audio_buffercCs t|jS)z)Get the current size of the audio buffer.)rXrMr9rrrget_buffer_sizer=z"AudioBufferManager.get_buffer_size)rNrI)rrrrr;rrQrrSrVr4rYrr\r]rr^rrrrrJs  rJc @seZdZdZddZdededeeee ffddZ ded edeee ffd d Z dedeee ffd d Z d eddfddZ deefddZdefddZdddZdeefddZdedeefddZdedeefddZdS) AudioServicez Coordinates all audio processing operations for the application. Uses the format converter, timing manager, and buffer manager to process audio, manage synchronization, and handle interruptions for Service Type 4 (ElevenLabs). cCst|_t|_t|_dSrK)rformat_converterr5timing_managerrJbuffer_managerr9rrrr;s zAudioService.__init__ audio_bytesr rcCs|s td|ddS|stdt|ddSzddlm}ddl}d}z|j||dd }d}Wnlty}z`z|j||d d }d }WnKty}z?z |||}d }Wn,ty} z t d |d |d| WYd} ~ WYd}~WYd}~WdSd} ~ wwWYd}~nd}~wwWYd}~nd}~wwt j } | |  dd}|j} ddl} | | d} ddl}t| d}ddt j |dt|ddd}|WSty }zddl}t d|t d|WYd}~dSd}~ww)a# Process raw audio bytes (e.g., from Sarvam TTS) for MCube. Args: audio_bytes: Raw audio data in bytes stream_id: Mcube stream identifier Returns: Processed audio message for Mcube, or None if invalid u:⚠️ No audio bytes provided for processing (stream_id: )Nu@⚠️ No stream_id provided for audio processing (audio_bytes: z bytes)r) AudioSegmentmp3)formatwavz auto-detectedu3❌ Failed to load audio in any format. MP3 error: z , WAV error: z, Auto error: zutf-8 playAudioraudio_i) contentType sampleRater name)eventmediau&❌ Error processing raw audio bytes: u❌ Traceback: )rwarningrXpydubrer from_filer r'errorrMCUBE_SAMPLE_RATEset_frame_rate set_channelsset_sample_widthraw_datarr%timer. b64encodedecoder traceback format_exc)r:rcr reroriginal_format pcm_audio mp3_error wav_error auto_errortarget_sample_rate pcm_bytesr mulaw_audior{ audio_base64 audio_messager,r~rrrprocess_raw_audio_bytessj  $   z$AudioService.process_raw_audio_bytesrocCs|j|d||dS)z Create a checkpoint message for audio synchronization. Args: stream_id: Mcube stream identifier name: Name of the audio segment Returns: Mcube checkpoint message checkpoint)rpstreamIdro)rbrQ)r:r rorrrcreate_checkpoint_message*s z&AudioService.create_checkpoint_messagecCs|jd|dS)z Create a clear message to clear audio buffer. Args: stream_id: Mcube stream identifier Returns: Mcube clearAudio message clearAudio)rpr)rbr])r:r rrrcreate_clear_message<s z!AudioService.create_clear_messageNcCs.|j}tjr|rtd|dSdSdS)z'Handle a playedStream event from Mcube.zProcessed playedStream: N)rbrSrr?r@)r:ro removed_markrrrhandle_played_stream_eventLs  z'AudioService.handle_played_stream_eventcC |jS)z Calculate timing for audio interruption. Returns: Elapsed time for truncation, or None if no response is tracked )rarDr9rrrcalculate_interruption_timingRs z*AudioService.calculate_interruption_timingcCs"|jjduo|jo|jjduS)z Determine if an interruption should be processed. Returns: True if interruption should be handled N)rar8rbrYr7r9rrrshould_handle_interruption[s  z'AudioService.should_handle_interruptioncCs|j|jdS)z%Reset all interruption-related state.N)rarErbrVr9rrrreset_interruption_statefs z%AudioService.reset_interruption_statecCr)z/Get the ID of the currently tracked audio item.)rarHr9rrrrHkr=z AudioService.get_current_item_iddatac Cs(z|ddWSttfyYdSw)z&Extract audio payload from Mcube data.rqr N)KeyError TypeErrorr:rrrr_extract_mcube_payloados z#AudioService._extract_mcube_payloadc Cs.z t|ddWStttfyYdSw)z"Extract timestamp from Mcube data.rqr N)rrr ValueErrorrrrr_extract_mcube_timestampvs z%AudioService._extract_mcube_timestamprI)rrrrr;r3rrrrrrrrrrr4rrrHdictrrrrrrr_s"N r_)r.rtypingrrr dataclassesrconfigrservices.log_utilsrrrr5rJr_rrrrs    ;C;