-idZddlZddlmZddlmZddlmZddlmZddlZddl Z GddZ d Z e d kr e dSdS) z Syntaxic Analysis N)analex)stemnode) stemmedwordcdeZdZdZddZdZdZddZdZd Z d Z dd Z d Z d Z ddZddZdS) Lemmatizerz Arabic Lemmatizer FcFtj||_d|_dS) FN)rAnalexanalexervocalized_lemma)self cache_paths P/var/www/html/speakWrite/venv/lib/python3.11/site-packages/qalsadi/lemmatizer.py__init__zLemmatizer.__init__#s# j11 $cdS)Nrs r__del__zLemmatizer.__del__)s rcrg}g}|D]/}|tj||j0|S)a1 lemmatization of stemming results. morphological Result is a list of stemmedword objects @param detailed_stemming_dict: detailed stemming dict. @type detailed_stemming_dict:list of list of stemmedword objects @return: lemmas. @rtype: list lemmas. )appendrStemNoder )rdetailed_stemming_dictstemmedsynwordlistlist stemnode_list stemming_lists ranalyzezLemmatizer.analyze,sQ"$ 4 Y YM  !2=$BV!W!W X X X Xrcg}|D]V}|r(||,||||W|S)z9 Generate all lemmas from stemnode_list )pos return_pos)r get_lemmas get_lemma)rrr!r"alllemmasstnds rr#zLemmatizer.get_lemmasAsn ! N ND N doo//0000 dnnnLLMMMM rc\tjtj|}d|D}|S)a/ Decode objects result from analysis. helps to display result. @param stemmed_synwordlistlist: list of list of StemmedSynWord. @type word_result: list of list of StemmedSynWord @return: the list of list of dict to display. @rtype: list of list of dict cg|] }|j Sr)__dict__).0xs r z%Lemmatizer.decode..Zs333AQZ333r) functoolsreduceoperatorconcatrstemmed_synwordlistlist flat_lists rdecodezLemmatizer.decodeQs2$X_6MNN 33333 rc d}|D]X}|dz }|D]I}|dz }|j}t|D]}|d|d||dz }|dz }J|dz }Y|d z }|S) z display objects result from analysis @param stemmed_synwordlistlist: list of list of StemmedSynWord. @type word_result: list of list of StemmedSynWord [z [z {z u'z' = u'z',z }z ]z ])r*sortedkeys)rr3textrlistitemstmwordkeys rdisplayzLemmatizer.display]s ,  E GOD " " !-!',,..11IICDccc73<<<HHDD ! GODD   rcX||}tj|dS)z print objects result from analysis @param stemmed_synwordlistlist: list of list of StemmedSynWord. @type word_result: list of list of StemmedSynWord N)r5pprintr2s rrAzLemmatizer.pprintps, KK 788  i     rcd|j|}||}|S)zg Text Analysis syntacticly @param text: input text @type text: unicode )r check_textr)rr:r result stemnodelists r analyze_textzLemmatizer.analyze_textys0 ))$//||F++ rcd|_dS)k set output lemma as vocalized @param text: input text @type text: unicode TNr rs rset_vocalized_lemmazLemmatizer.set_vocalized_lemmas $rcd|_dS)rHFNrIrs runset_vocalized_lemmaz Lemmatizer.unset_vocalized_lemmas %rc|j|}||}|||||}|S)\ Lemmatize text @param text: input text @type text: unicode r"r!r%)r rCrr#)rr:r"r!r%rDrEr&s rlemmatize_textzLemmatizer.lemmatize_textsI))$//||F++ *#SVWW rcT|||||}|r|dS|rdSdS)rNrOrrr)rP)rwordr"r!r%lemmasListOfLists r lemmatizezLemmatizer.lemmatizesJ  ..t PSY\.]]  #A& &  rrrN)F)rFF)FrF)__name__ __module__ __qualname____doc__rrrr#r5r?rArFrJrLrPrTrrrrrs%%%%    *   &!!!$$$%%%    rrcd}g}t}||}||}tj|dS)z main test uإلى البيتN)rrFmorphrA)r:rDlemmers rmainlyr\sQ D F \\F   & &F \\$  F M&r__main__) rXrApyarabic.arabyarabyrrrrr.r0rr\rUrrrr`s WWWWWWWWt    z FHHHHHr