o 99j @sdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z e jdZeZidd d d d d ddddddddddddddddddd d!d"d#d$d%d&d'd(d)id*d+d,d-d.d/d0d1d2d3d4d5d6d7d8d9d:d;dd?d@dAdBdCdDdEdFdGdHdIdJdKdLdMdNdOdPdQdRdSdTZdmdXdYZdZd[eDZd\d]Zd^d_ZdndbdcZdodedfZdgdhZdidjZdodkdlZdS)puLokaler Daten-Layer: spiegelt ElevenLabs-Gespräche in SQLite + Vokabel-Tracking. Das ist das detaillierte Tracking (#3): jedes Gespräch, jeder Turn, jede gelernte Vokabel wird gespeichert und vom Eltern-Dashboard (#2/#6) gelesen. ) annotationsN)Path)configconvailearningz plappi.sqlitepasHundumačkaKatzepticaVogelribaFischkonjPferdkravaKuhzecHasemedveduBärlavuLöweslonElefantzdravoHalloućaouTschüsshvalaDankemolimBittedaJaneNeinmamaMamatataPapabakaOmadekaOpabebaBabycrvenorotplavoblauužutogelbzelenougrüncrnoschwarzbelouweißjedaneinsdvazweitridreiučetirivierpetufünfvodaWasserhlebBrotMilchApfelSonneMondBlumeHausAutoBall)mlekojabukasuncemeseccvetukućaautoloptasstrreturncCs$td|}ddd|DS)NNFKDcss|] }t|s|VqdSN) unicodedata combining).0cr[1/home/nk/hobo-godmode/plappi-mvp/backend/store.py #sz_norm..)rW normalizelowerjoin)rQr[r[r\_norm!sracCsi|]}t||qSr[)ra)rYkr[r[r\ 'srccCstt}tj|_|SrV)sqlite3connectDBRow row_factoryrZr[r[r\_conn*s rjcCs$t}|d||dS)Na CREATE TABLE IF NOT EXISTS conversations( id TEXT PRIMARY KEY, started_at INT, duration_secs INT, num_turns INT, synced_at INT); CREATE TABLE IF NOT EXISTS turns( conv_id TEXT, idx INT, role TEXT, text TEXT, PRIMARY KEY(conv_id, idx)); CREATE TABLE IF NOT EXISTS vocab( word_sr TEXT PRIMARY KEY, word_de TEXT, times_taught INT, times_practiced INT, first_seen INT, last_seen INT); )rj executescriptcommitcloserir[r[r\init0s  rntext list[str]cCsFt|}g}tD]\}}tdt|d|r ||q |S)Nz\b)ra _NORM_MAPitemsresearchescapeappend)ronfoundnksrr[r[r\ _find_words>s r{dictc Csdttjs dddSt}t}d}|D]}}|dp!|d}|s%qzt|}Wn ty5Yqwt |}t |t rF|dini}|dpS|dpSd}|d p_|d p_d} | d ||| t |ttf| d |ft|D]\} } | d || | d | dfq||d7}q|t|||tjtddd|dS)uVHolt neue/aktualisierte Gespräche von ElevenLabs, speichert Turns, baut Vokabeln neu.Fzkein ELEVENLABS_AGENT_ID)okerrorrconversation_ididmetadatastart_time_unix_secscall_duration_secsz6INSERT OR REPLACE INTO conversations VALUES(?,?,?,?,?)z!DELETE FROM turns WHERE conv_id=?z,INSERT OR REPLACE INTO turns VALUES(?,?,?,?)rolerorT)targetdaemon)r} conversations)rnrELEVENLABS_AGENT_IDrjrlist_conversationsgetget_conversation Exceptiontranscript_turns isinstancer|executeleninttime enumeraterl_rebuild_vocabrm threadingThread_background_scorestart) rZconvspulledmetacidfullturnsmstartedduritr[r[r\syncGs>     rc CstjddsdSztt}|d}dd|D}|d}|D]P\}}t}dd|d |fD}|zt||pFd|}| d rW| d sW|d 7}Wq&t yv} zt d |d| ddWYd} ~ q&d} ~ ww|rzd dl m } | | t d |dddWn"t y} zt d| ddWYd} ~ nd} ~ wwWtdSWtdSWtdStw)uBewertet noch nicht ausgewertete Gespräche (begrenzt) und aktualisiert danach den Agent-Prompt mit den neuen Fokus-Wörtern. Läuft asynchron, mit Lock gegen Parallelläufe.F)blockingNa(SELECT conv.id AS id, conv.started_at AS started_at FROM conversations conv LEFT JOIN scored_convs s ON s.conv_id = conv.id WHERE s.conv_id IS NULL ORDER BY conv.started_at ASC LIMIT 8cSsg|] }|d|dfqS)r started_atr[rYrr[r[r\ vsz%_background_score..rcSg|] }|d|ddqSrro)rror[rYrr[r[r\r{s9SELECT role, text FROM turns WHERE conv_id=? ORDER BY idxr}skippedrz[score] z fehlgeschlagen: Tflush)profileu2 Gespräch(e) bewertet, Agent-Prompt aktualisiert.z.[score] Prompt-Aktualisierung fehlgeschlagen: ) _score_lockacquirerrnrjrfetchallrmapply_conversationrrprintrUr push_to_agent get_profilerelease) rZrowstodonewlyrrc2rreserr[r[r\risR  $   rc Cs|di}|d}|D]N}|dpd}t|dD]?}||dd|p(d|p+dg}|ddkr=|dd7<n|dd7<|r]t|d pM|||d <t|d pX|||d <qq|D]\}}|d |t|d |d|d|d |d fqcdS) NzDELETE FROM vocabzSELECT t.role, t.text, conv.started_at FROM turns t JOIN conversations conv ON conv.id=t.conv_id ORDER BY conv.started_at, t.idxrrrorplappirz0INSERT OR REPLACE INTO vocab VALUES(?,?,?,?,?,?)rU) rrr{ setdefaultminmaxrr VOCAB_SR_DEr)rZaggrrtsrzar[r[r\rs,    &rc Cs<tt}|d}|d}tdd|D}g}|ddD]%}|d|df}||d|d|d |d d d |Dd q%|zt}Wn"t yw}zt d|ddddigd}WYd}~nd}~wwt |t |ddtdd|Dtdd|Dd|dd |D|dS)Nz4SELECT * FROM conversations ORDER BY started_at DESCzDSELECT * FROM vocab ORDER BY times_practiced DESC, times_taught DESCcss|] }|dp dVqdS) duration_secsrNr[rr[r[r\r]sz!dashboard_data..rrrr num_turnscSrrr[rr[r[r\rsz"dashboard_data..)rrrrrz$[dashboard] mastery_summary failed: Trrzpre-A1)levelcefrcountswords<rcs |] }|ddkrdVqdS) times_taughtrrNr[rYvr[r[r\r]csr)times_practicedrrNr[rr[r[r\r]r)rminutes words_taughtwords_practicedcSs*g|]}|d|d|d|ddqS)word_srword_derr)rzdetaught practicedr[rr[r[r\rs  )statsmasteryvocabr) rnrjrrsumrvrmrmastery_summaryrrrround) rZrr total_secs out_convscvrrrr[r[r\dashboard_datas>   r)rQrRrSrR)rorRrSrp)rSr|)__doc__ __future__rrsrdrrrWpathlibrrUrrrDATA_DIRrfLockrrrarqrjrnr{rrrrr[r[r[r\s       "&