tni=8dZddlZddlZddlZddlmZddlZddlmZmZmZm Z ddl m Z m Z m Z mZmZddlmZmZmZddlmZdd lmZd d lmZmZmZmZmZejej e!d Z"d Z# ddZ$dZ%dZ&dS)z$ Runpod | CLI | Project | Functions N)datetime)commentdocumentnltable) __version__create_endpointcreate_templateget_podupdate_endpoint_template)BASE_DOCKER_IMAGEENV_VARS GPU_TYPES) SSHConnection)sync_directory)attempt_pod_launchcopy_template_filesget_project_endpointget_project_podload_project_configstarter_templatesc`t}tdd|ddi}|ddiD]}|dd|||<|ddg}|dddr!||ddt ||}|td dStd d t j|d ddks|dDt|d}|d ddk/|dD|d}td|ddd|dd |S)zLaunch a development pod.z&Deploying development pod on Runpod...RUNPOD_PROJECT_IDprojectuuidenv_vars gpu_typesgpuNzHSelected GPU types unavailable, try again later or use a different type.z"Waiting for pod to come online... )end desiredStatusRUNNINGruntimeidzProject namez pod (z ) created.z ) rprintgetappendrsysstdoutflushr )configenvironment_variablesvariableselected_gpu_typesnew_podproject_pod_ids `/var/www/html/gpu-tools/venv/lib/python3.11/site-packages/runpod/cli/groups/project/functions.py_launch_dev_podr5#s " "F 23331&2CF2KL9%))*b99RR*0*;J*G*Qh'' *..{B?? iUD))<!!&"3E":;;;!)>??G V   t .B7777J  OT**i77 ;;y ! ! )'$-((  OT**i77 ;;y ! ! )T]N N6)$V,NNNNNN  FcB |s.tjtj|}tj|stj||d}tjt |}t||tj|d} t| dd5} | } dddn #1swxYwYdtvr| dd } n| dd t} t| d d5} | | dddn #1swxYwY|rtj|d } t| dd5} | }| d |}dddn #1swxYwYt| d d5} | |dddn #1swxYwYntj}ttjdd}t!}|t%d|t'|d|t)}|d||d||dt+j||dt.|dd|d||dd|dd|dd|dt0|d |t)}|d!t||d"t||d#|t)}|d$||d%d |d&d|d'|ttj|d(d d)5}t3j||ddddS#1swxYwYdS)*zCreate a new project.Ndefaultzbuilder/requirements.txtrzutf-8)encodingdevz <>z/git+https://github.com/runpod/runpod-python.gitzrunpod==wzsrc/handler.pyz<>zRunpod Project Configurationtitlerr' base_image) cuda_versionr gpu_countr storage_idvolume_mount_pathz/runpod-volumeportsz8080/http, 22/tcpcontainer_disk_size_gb rr model_type model_nametemplatepython_version handler_pathrequirements_pathr%z runpod.tomlzUTF-8)ospathjoingetcwdexistsmakedirsSTARTER_TEMPLATESropenreadrreplacewritestrruuid4raddrrrr formatrrtomlkitdump) project_namerunpod_volume_idr@rJrGrHinit_current_dirproject_folder template_dirrLrequirements_filerequirements_contentrKfilehandler_content project_uuid toml_config project_tabletemplate_table runtime_table config_files r4create_new_projectrmOs '%bikk<@@w~~n-- ( K ' ' '  "Jw||$5zBB L.999GLL9STT #S7 ; ; ; /dev/null sleep 1 if ps -p $1 > /dev/null; then echo "Graceful kill failed, attempting SIGKILL..." kill -9 $1 2>/dev/null sleep 1 if ps -p $1 > /dev/null; then echo "Failed to kill process with PID: $1" exit 1 else echo "Killed process with PID: $1 using SIGKILL" fi else echo "Killed process with PID: $1" fi } function cleanup { echo "Cleaning up..." force_kill $last_pid } trap cleanup EXIT SIGINT if source z/venv/bin/activate; then echo -e "- Activated virtual environment." else echo "Failed to activate virtual environment." exit 1 fi if cd a; then echo -e "- Changed to project directory." else echo "Failed to change directory." exit 1 fi exclude_pattern='(__pycache__|\.pyc$)' function update_exclude_pattern { exclude_pattern='(__pycache__|\.pyc$)' if [[ -f .runpodignore ]]; then while IFS= read -r line; do line=$(echo "$line" | tr -d '[:space:]') [[ "$line" =~ ^#.*$ || -z "$line" ]] && continue # Skip comments and empty lines exclude_pattern="${exclude_pattern}|(${line})" done < .runpodignore echo -e "- Ignoring files matching pattern: $exclude_pattern" fi } update_exclude_pattern # Start the API server in the background, and save the PID python a --rp_serve_api --rp_api_host="0.0.0.0" --rp_api_port=8080 --rp_api_concurrency=1 & last_pid=$! echo -e "- Started API server with PID: $last_pid" && echo "" echo "Connect to the API server at:" echo "> https://$RUNPOD_POD_ID-8080.proxy.runpod.net" && echo "" while true; do if changed_file=$(inotifywait -q -r -e modify,create,delete --exclude "$exclude_pattern" a --format '%w%f'); then echo "Detected changes in: $changed_file" else echo "Failed to detect changes." exit 1 fi force_kill $last_pid if [[ $changed_file == *"requirements"* ]]; then echo "Installing new requirements..." python -m pip install --upgrade pip && python -m pip install -r z fi if [[ $changed_file == *".runpodignore"* ]]; then update_exclude_pattern fi python z --rp_serve_api --rp_api_host="0.0.0.0" --rp_api_port=8080 --rp_api_concurrency=1 & last_pid=$! echo "Restarted API server with PID: $last_pid" done z(Starting project development endpoint...) rr(rr5rrMrNrO run_commandsrsyncrPr)r. config_itemr3ssh_connproject_path_uuidproject_path_uuid_devproject_path_uuid_prodremote_project_path venv_pathcommandsr^ pip_req_pathrKlaunch_api_servers r4 start_projectrs# ! " "Fi(HH  F{FFfY&7 &DFFGGGG "III$VI%6v%>??N +(** ~ & &Q1(i !45 S Sy8I&8Q S S !# -> F F!#.?!H!H gll !6)#4V#<    Y,? Y Y Y Y     G, G G/E G G H   6n66777ry{{$9:::GLL!6??  Yi Y Y Y Y    UVI&'78 T T T T _i _ _% _ _7=Y6GH[6\ _ _  h''' x.CDDDi(0 w||  !23F!G  w||  !2>!B  [ >-?[ [ L)M[ [ L,8M[ [ x!y[ [ Hk~I[ [ ^Vb_[ [ l%m[ [ [ ] ~ b  8999/000cQ1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1Q1sH?KKKc t}t|dd}|st}|dSt|5}|ddd|dd}tj|d}tj||dd}|d|gtd |d | t j |tj|d }td |d |d|ddd|d|d|d|ddg}||| dddn #1swxYwYi}|ddD]} |dd| || <d|ddd} d|ddd|ddd|dd} d| zdz| zdz} t|ddd|ddd tj|dd!|dd"| |d#$} t|dd}|sBt!|ddd|dd| d%|dd&'}nt#|d%| d%(}|d%S))zCreate a project endpoint. - Move code in dev to prod folder - TODO: git commit the diff from current state to new state - Create a serverless template for the project - Create a new endpoint using the template rrNrCrorpr'rrrtz prodrurvrqrwr%rJz -m venv rxryrzrLrz. /runpod-volume/z/prod/venv/bin/activatezpython -u /runpod-volume/z/prod/rKz bash -c "z && "z -endpoint | z | r?rET)r' image_namecontainer_disk_in_gbdocker_start_cmdenv is_serverlessr&rB)r' template_idnetwork_volume_id) endpoint_idr)rrr5rrMrNrOr{r(r|rPcloser rnowrr r )r.r3r~rrrrrr/r0 activate_cmd python_cmdrproject_endpoint_templatedeployed_endpoints r4create_project_endpointr\s ! " "F$VI%6v%>??N +(**t ~ & &(i !45 S Sy8I&8Q S S "$.?!H!H gll "F9$5f$=   @+>@@ABBB ;n;;;<<<ry{{$:;;;GLL!7@@  Yi Y Y Y Y    OVI&'78 N N9 N N _i _ _% _ _7=Y6GH[6\ _ _  h'''7:9%j1RR*0*;J*G*Qh'' OF9-f5NNNNVI->v-FNNfU^N_`fNgNNjpqzj{}KkLNNJ"\1F:ZG#M /y!&) e evi7H7P e eU]UaUcUc e e)$\2#I./GH) ! !!!-VI->v-FGG   +9%f-VV6);LV;TVV1$7$Y/ =    5)$/1$7    T ""s EF!!F%(F%)NNF)'__doc__rMr+rrr\rrrrrunpodrr r r r runpod.clir rrrunpod.cli.utils.ssh_cmdr utils.rp_syncrhelpersrrrrrrNrOdirname__file__rSr5rmrrr6r4rs 000000000000>=========222222++++++GLL!:!: