tni' 2ddlmZddlZddlmZddlmZddlmZmZm Z ddl m Z ddl m Z mZddlmZdd lmZerdd lmZmZdd lmZ ddlZn#e$r e d wxYwddZddZ ddZd ddeddddddf dZGddeZdS)) TYPE_CHECKINGN)consts)record_token_usage)get_start_span_functionset_data_normalizedtruncate_and_annotate_messages)SPANDATA) DidNotEnable Integration)should_send_default_pii)event_from_exception)AnyDict)datetimezLiteLLM not installedkwargsDict[str, Any]returncn|di}|d}|i}||d<|S)z,Get the metadata dictionary from the kwargs.litellm_paramsmetadata) setdefaultget)rrrs \/var/www/html/gpu-tools/venv/lib/python3.11/site-packages/sentry_sdk/integrations/litellm.py_get_metadata_dictrsG&&'7<xu U U  ,' 8%$ .48$D%F:.F!,,..88Y 3   i 7 7 7JJz**zz-00%zz*?@@N %**,,FF U   &=&=&=u E E EFFsA!!A21A2completion_responser start_timerend_timec t|d}|dStjt }|dS t |dr t|tj |j tr\|j rTt |drCg}|j D]}t |drt |jdr-||jVt |jdr-||ji}t |jdr|jj|d<t |jd r|jj|d <t |jd r|jj|d <|||rt|tj|t |d rG|j} t/|t1| d dt1| d dt1| dd|ddddS#|dddwxYw)zHandle successful completion.r(Nrchoicesmessage model_dumpdictrolecontent tool_callsusage prompt_tokenscompletion_tokens total_tokens) input_tokens output_tokensrm)rrr5r6r7r8hasattrrr GEN_AI_RESPONSE_MODELrr rBrcrdappendrerfrgrhriGEN_AI_RESPONSE_TEXTrjrgetattr__exit__) rr_r`rarUrPresponse_messageschoicemsgrjs r_success_callbackrys f % % ) ). 9 9D |'))99:LMMK-( & 0 0  h46I6O    # $ $ )D *I66 $&!19::Fvy11:"6><@@ :-44V^5N5N5P5PQQQQ$V^V<< :-44V^5H5H5J5JKKKK#%C&v~v>>B.4n.AF &v~yAAH171GI&v~|DDN4:N4ML 1-44S999$'h;=N & 0 0 '-E $UOTBB%e-@$GG$UNDAA      dD$''''' dD$''''s G2I""I; exceptioncvt|d}|dS t|tjjddd\}}tj|||t||ddS#|t||dwxYw)zHandle request failure.r(Nr9F)typehandled)client_options mechanism)hint) rrr r5r6options capture_eventrur|)rrzr`rarUeventrs r_failure_callbackrs f % % ) ). 9 9D | 8* %022:(U;;   t  T2222 d9ooy$77777 d9ooy$7777s AB&B8cNeZdZdZdZdeZd dddeddfd Zed d Z dS) r8a" LiteLLM integration for Sentry. This integration automatically captures LiteLLM API calls and sends them to Sentry for monitoring and error tracking. It supports all 100+ LLM providers that LiteLLM supports, including OpenAI, Anthropic, Google, Cohere, and many others. Features: - Automatic exception capture for all LiteLLM calls - Token usage tracking across all providers - Provider detection and attribution - Input/output message capture (configurable) - Streaming response support - Cost tracking integration Usage: ```python import litellm import sentry_sdk # Initialize Sentry with the LiteLLM integration sentry_sdk.init( dsn="your-dsn", send_default_pii=True integrations=[ sentry_sdk.integrations.LiteLLMIntegration( include_prompts=True # Set to False to exclude message content ) ] ) # All LiteLLM calls will now be monitored response = litellm.completion( model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}] ) ``` Configuration: - include_prompts (bool): Whether to include prompts and responses in spans. Defaults to True. Set to False to exclude potentially sensitive data. r9zauto.ai.TselfrBrNc||_dS)N)rB)rrBs r__init__zLiteLLMIntegration.__init__s.rctjpgt_ttjvr$tjttjpgt_t tjvr$tjt tjpgt_ttjvr&tjtdSdS)z(Set up LiteLLM callbacks for monitoring.N)r9input_callbackr^rrsuccess_callbackryfailure_callbackrrr setup_oncezLiteLLMIntegration.setup_onces")!7!=2 '"8 8 8  " ) )/ : : :#*#;#Ar G$< < <  $ + +,= > > >#*#;#Ar G$< < <  $ + +,= > > > > > = rs+ 777777 '&&&&&========444444111111"        !!!!!!0NNNN000 ,. / //0    bFbFbFbFJ=( =(=(=( =(  =(=(=(=(@8 888 8  88880@?@?@?@?@?@?@?@?@?@?s AA"