o y iZ @sdZddlZddlmZmZmZmZddlmZGdddZe dkrdd d dd d d dddd d dd ddd d ddddd d dd ddd d gZ e de e e Z e dee e dee e ee Ze ee ee Ze de dede dede dede e d eed!d"D]\ZZe d#ed$eqe e d%eed&d"D]\ZZe d#ed$eqdSdS)'zo Database utility to get clean conversation data Removes raw audio entries and returns only transcribed speech N)ListDictAnyOptional)datetimec@seZdZdZededefddZededefddZede e ee fde e ee ffd d Z ede e ee fdefd d Z ede e ee fde ee ffd dZdS)ConversationCleanerz(Utility class to clean conversation data message_textreturncCsttd|S)z$Check if a message is raw audio dataz&\[Audio (response|input) - \d+ chars\])boolresearchrr services/conversation_cleaner.pyis_raw_audio_entrysz&ConversationCleaner.is_raw_audio_entrycCs0|dr |ddS|dr|ddS|S)z*Extract actual speech content from messagez User said: NzAssistant said: ) startswithr rrrextract_speech_contents    z*ConversationCleaner.extract_speech_contentmessagescCs4g}|D]}|dd}t|rq||q|S)z7Clean conversation messages to remove raw audio entriesmessage)getrrappend)rcleaned_messagesrrrrrclean_conversation_messagess   z/ConversationCleaner.clean_conversation_messagesc Cs|sdSg}|d|d|d|dt|dD]O\}}|dd}|dd}|d d}t|}|rTzt|d d }|d } Wn |} Ynd } ||dd| d| d||dq|d|dt ||dd |S)z,Format cleaned conversation for easy readingzNo messages foundzP================================================================================zCLEAN CONVERSATIONrspeakerunknownr timestampZz+00:00z%H:%M:%Sz Unknown timeZ2dz. [z] z: Total Messages:  ) r enumeraterrrrZ fromisoformatreplacestrftimeupperlenjoin) rZformatted_linesirrcontentrspeech_contentZdtZformatted_timerrrformat_conversation_for_display.s2        &    z3ConversationCleaner.format_conversation_for_displaycCsvg}g}|D]&}|dd}|dd}t|}|dkr#||q|dkr,||qt|||t|t|dS)z#Get conversation summary statisticsrrruserbot)total_messages user_messages bot_messages user_count bot_count)rrrrr')rr0r1rrr*r+rrrget_conversation_summaryVs"     z,ConversationCleaner.get_conversation_summaryN)__name__ __module__ __qualname____doc__ staticmethodstrr rrrrrrr,r4rrrrr s , ',r__main__z\Assistant said: Hello there! I am an MCube Telephony AI voice assistant. How can I help you?r.z2025-10-07T18:45:06.137769L)rrrZ confidenceZ session_idz User said: Hello, are you there?r-z2025-10-07T18:45:14.584993z-Assistant said: [Audio response - 1068 chars]z2025-10-07T18:45:18.763029z>User said: I want IVRS, can you explain me briefly about IVRS?z2025-10-07T18:45:32.400683zAssistant said: Sure. IVRS stands for Interactive Voice Response system. It lets callers interact with a menu using their phone keypad or voice commands.z2025-10-07T18:45:36.355409zTesting ConversationCleaner...zOriginal messages: zCleaned messages: zCONVERSATION SUMMARY:r!r/zUser Messages: r2zBot Messages: r3zUser Messages:r0rz z. z Bot Messages:r1)r8r typingrrrrrrr5Zsample_messagesprintrrr'r, formattedr4Zsummaryr#r)msgrrrrsz f&   C