tni{$dZddlZddlmZmZmZddlZddlmZm Z ddl m Z m Z m Z mZGddZGdd ZGd d ZdS) z# Runpod | Python | Endpoint Runner N)AnyDictOptional) HTTPAdapterRetry)API_KEY_NOT_SET_MSG FINAL_STATESUNAUTHORIZED_MSG is_completedc ~eZdZdZd deefdZ ddededeed efd Z ddeded efd Z dded efd Z dS) RunPodClientz$A client for running endpoint calls.Napi_keyc:ddlm}m}|p||_|jttt j|_tddddg}|j d t| d d |jd |_ ||_dS)z Initialize a RunPodClient instance. Args: api_key: Optional API key. If not provided, uses global api_key. Raises: RuntimeError: If the API key has not been initialized. r)rendpoint_url_baseNii)totalbackoff_factorstatus_forcelistzhttp://) max_retrieszapplication/jsonzBearer )z Content-Type Authorization) runpodrr RuntimeErrorrrequestsSession rp_sessionrmountrheaders)selfrglobal_api_keyrretriess S/var/www/html/gpu-tools/venv/lib/python3.11/site-packages/runpod/endpoint/runner.py__init__zRunPodClient.__init__s        0. < 233 3"*,,aS#JOOO i)I)I)IJJJ/5t|55   "3 methodendpointdatatimeoutc|jd|}|j|||j||}|jdkrt t ||S)a Make a request to the specified endpoint using the given HTTP method. Args: method: The HTTP method to use ('GET' or 'POST'). endpoint: The endpoint path to which the request will be made. data: The JSON payload to send with the request. timeout: The number of seconds to wait for the server to send data before giving up. Returns: The JSON response from the server. Raises: RuntimeError: If the response returns a 401 Unauthorized status. requests.HTTPError: If the response contains an unsuccessful status code. /)rjsonr)i) rrrequestr status_coderr raise_for_statusr,)rr&r'r(r)urlresponses r"_requestzRunPodClient._request9s('44(44?** CD'+    3 & &/00 0!!###}}r$c2|d|||S)zPost to the endpoint.POSTr2)rr'r(r)s r"postzRunPodClient.postXs}}VXtW===r$c2|d||S)zGet from the endpoint.GETr)r5)rr'r)s r"getzRunPodClient.get\s}}UHg}>>>r$N)Nr%)r%) __name__ __module__ __qualname____doc__rstrr#dictintr2r6r:r$r"r r s..33 3333BBF%(08>>>S>>s>>>>??C?#??????r$r c~eZdZdZdededefdZddedeeeffd Z d Z dd e defd Z defdZ dd e defdZdS)Jobz1Represents a job to be run on the Runpod service. endpoint_idjob_idclientcL||_||_||_d|_d|_dS)a Initialize a Job instance with the given endpoint ID and job ID. Args: endpoint_id: The identifier for the endpoint. job_id: The identifier for the job. client: An instance of the RunPodClient to make requests with. N)rFrG rp_client job_status job_output)rrFrGrHs r"r#z Job.__init__gs,' r$statussourcereturnc|jd|d|j}|j|}t |dr(|d|_|dd|_|S)zBReturns the raw json of the status, raises an exception if invalidr+)r'rMoutputN)rFrGrJr:r rKrL)rrN status_url job_states r" _fetch_jobzJob._fetch_jobwsv(AA6AADKAA N&& &;;  (+ , , <'1DO'mmHd;;DOr$cR|j|jS|dS)z&Returns the status of the job request.NrM)rKrT)rs r"rMz Job.statuss' ? &? "  **r$rr)cZ|dkrpt|sOtjd|dz}|dkrt dt|O|j|jS|ddS)z Returns the output of the job request. Args: timeout: The number of seconds to wait for the server to send data before giving up. rrzJob timed out.NrQ)r rMtimesleep TimeoutErrorrLrTr:rr)s r"rQz Job.outputs Q;;"4;;==11 9 1 1 a<<&'7888 #4;;==11 9 ? &? "  $$Xt444r$c#K tjd|d}|dtvst |ddkr$|dgD] }|dV n|dtvrdS) z>Returns a generator that yields the output of the job request.Trstream)rNrMrrQN)rWrXrTr lenr:)rstream_partialchunks r"r\z Job.streams  JqMMM!__H_==Nx( <<~h/00144+//"==**E/))))*)\99 r$cZ|j|jd|jd|S)z Cancels the job and returns the result of the cancellation request. Args: timeout: The number of seconds to wait for the server to respond before giving up. z/cancel/Nr(r))rJr6rFrGrZs r"cancelz Job.cancels?~"" 6 6 6 6#   r$N)rM)rr`)r<r=r>r?r@r r#rrrTrMrBrQr\rcrCr$r"rErEds;;Cl   DcN    +++55c5#5555&        c  #       r$rEc eZdZdZddedeefdZdeeefde fdZ ddeeefd e deeeffd Z dd e deeeffd Z dd e deeeffdZdS)Endpointz6Manages an endpoint to run jobs on the Runpod service.NrFrc>||_t||_dS)a Initialize an Endpoint instance with the given endpoint ID. Args: endpoint_id: The identifier for the endpoint. api_key: Optional API key for this endpoint instance. Example: >>> endpoint = runpod.Endpoint("ENDPOINT_ID") >>> run_request = endpoint.run({"your_model_input_key": "your_model_input_value"}) >>> print(run_request.status()) >>> print(run_request.output()) )rN)rFr rJ)rrFrs r"r#zEndpoint.__init__s"'%g666r$ request_inputrOc|dsd|i}|j|jd|}t |j|d|jS)z Run the endpoint with the given input. Args: request_input: The input to pass into the endpoint. Returns: A Job instance for the run request. inputz/runid)r:rJr6rFrE)rrh job_requests r"runz Endpoint.runsk  )) 5$m4Mn)) % % %   4#[%6GGGr$Qr)c2|dsd|i}|j|jd||}|dtvr|ddSt |j|d|j|S)z Run the endpoint with the given input synchronously. Args: request_input: The input to pass into the endpoint. timeout: Maximum time to wait for the job to complete. rjz/runsyncr9rMrQNrk)r:rJr6rFr rErQ)rrhr)rls r"run_synczEndpoint.run_syncs  )) 5$m4Mn)) ) ) ) *  x L 0 0??8T22 2  k$/  && ! ! "r$r`cJ|j|jd|S)z Check the health of the endpoint (number/state of workers, number/state of requests). Args: timeout: The number of seconds to wait for the server to respond before giving up. z/healthr9)rJr:rFrZs r"healthzEndpoint.healths5~!! ( ( ("   r$cL|j|jdd|S)z Purges the endpoint's job queue and returns the result of the purge request. Args: timeout: The number of seconds to wait for the server to respond before giving up. z /purge-queueNrb)rJr6rFrZs r" purge_queuezEndpoint.purge_queues8~"" - - -#   r$r;)rnrd)r<r=r>r?r@rr#rrrErmrBrprrrtrCr$r"rfrfs@@77C7(3-7777"Hc3hHCHHHH(=B""!#s(^"69" c3h""""4   c  $sCx.        3  tCH~       r$rf)r?rWtypingrrrrrequests.adaptersrrrunpod.endpoint.helpersrr r r r rErfrCr$r"rxs3 &&&&&&&&&&00000000H?H?H?H?H?H?H?H?\Q Q Q Q Q Q Q Q nX X X X X X X X X X r$