tni^dZddlZddlZddlZddlZddlZddlZddlmZm Z ddl m Z ddl mZddlmZdd lmZgd ZeZejd d Zededdeddddeddddededdededdededdededd d!efd"Zd!efd#Zd!efd$Zd%Zd&e eeffd'ZdS)(z Contains the main entrypoint for the Runpod Serverless Worker. Arguments can be passed in when the worker is started, and will be passed to the worker. N)AnyDict) __version__)worker) RunPodLogger)progress_update)startr runpod_versionrunpodz#Runpod Serverless Worker Arguments.)prog descriptionz--rp_log_levelzrControls what level of logs are printed to the console. Options: ERROR, WARN, INFO, and DEBUG.)typedefaulthelpz --rp_debugger store_truezFlag to enable the Debugger.)actionrrz--rp_serve_apizFlag to start the API server.z --rp_api_porti@z$Port to start the FastAPI server on.z--rp_api_concurrencyz%Number of concurrent FastAPI workers.z --rp_api_host localhostz$Host to start the FastAPI server on.z --test_inputz-Test input for the worker, formatted as JSON.returnct\}}tjdg|zt_t ||d<|ddr)t j|dd|dd<|dddr)t j|dd|dd<|ddr&t |dd|S)zg Sets the config rp_args, removing any recognized arguments from sys.argv. Returns: config rrp_args test_input test_outputN rp_log_level) parserparse_known_argssysargvvarsjsonloadsgetlog set_level)configargsunknowns W/var/www/html/gpu-tools/venv/lib/python3.11/site-packages/runpod/serverless/__init__.py_set_config_argsr*Ss ++--MD' }w&CHT F9i&V*.*VI5F|5T*U*Uy,'i]D11X+/:fY6G 6V+W+Wy-(i(9 fY'7888 Mc\ttjddS)zK Get the realtime port from the environment variable if it exists. RUNPOD_REALTIME_PORT0intosenvironr#r+r)_get_realtime_portr4ms# rz~~4c:: ; ;;r+c\ttjddS)zR Get the realtime concurrency from the environment variable if it exists. RUNPOD_REALTIME_CONCURRENCY1r/r3r+r)_get_realtime_concurrencyr8ts# rz~~;SAA B BBr+cf~~tdtjddS)z$ Handles the SIGINT signal. zSIGINT received. Shutting down.rN)r$inforexit)sigframes r)_signal_handlerr>{s- UHH .///HQKKKKKr+r&ctdtdtjtjtt j|d<t|}t}t}|ddrst dddl m }||}||dd |dd |dd  d S|rSt d|dddl m }||}|d|| d St!j|d S)a Starts the serverless worker. config (Dict[str, Any]): Configuration parameters for the worker. config["handler"] (Callable): The handler function to run. config["rp_args"] (Dict[str, Any]): Arguments for the worker, populated by runtime arguments. z*--- Starting Serverless Worker | Version z ---reference_counter_startr rp_serve_apizStarting API server.r) rp_fastapi rp_api_host rp_api_portrp_api_concurrency)api_hostapi_portapi_concurrencyNz)Starting API server for realtime on port .z0.0.0.0)printr signalSIGINTr>time perf_counterr*r4r8r$r:modulesrB WorkerAPI start_uvicornrmain)r& realtime_portrealtime_concurrencyrB api_servers r)r r s K~ K K KLLL M&-111(,(9(;(;F $% f % %F&((M466 i(  '(((''''''))&11   I&}5I&}5"9-.BC !     M]MMMNNN''''''))&11   "0 !    K Fr+) __doc__argparser!r1rKrrMtypingrrversionrr rmodules.rp_loggerr modules.rp_progressr __all__r$ArgumentParserr add_argumentstrr0dictr*r4r8r>r r3r+r)rbs  333333++++++000000    lnn ! D     >    '    (  #t2X 0    /   8 4