• Stefy Lanza (nextime / spora )'s avatar
    runpod: a region and a warm-pod schedule per model, spend over the API (v0.2.82) · c6c1017c
    Stefy Lanza (nextime / spora ) authored
    Three gaps, all configurable from the model page:
    
    - data_center pins a model's pods to one RunPod region. Precedence is
      volume > model > account: a pod in another region cannot attach the
      volume, so the volume still decides.
    
    - schedule_enabled/start/end/days/tz gate the WARM FLOOR only. Outside
      the window the floor is 0 and the warm pod is released without waiting
      out idle_timeout_s; a request arriving out of hours still cold-starts
      one, exactly as min_pods=0 always has. An end before the start runs
      overnight and belongs to the day it started on. An incomplete or
      unparseable window is treated as no schedule rather than a floor of
      zero, and an unknown time zone falls back to local, not UTC.
    
    - GET /v1/runpod/spend serves the pods, ledger, caps and schedule status
      to an API key marked admin, so an external monitor can poll spend
      without an admin session. Opt-in per token; an ordinary key gets 403.
    
    pools_schedule_status() reports in_window/next_change/effective_min_pods
    on /admin/api/runpod/stats and on the new endpoint.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    c6c1017c
Name
Last commit
Last update
..
test_admin_auth.py Loading commit data...
test_admin_remote_ui.py Loading commit data...
test_audio_ml_backends.py Loading commit data...
test_audio_ml_endpoints.py Loading commit data...
test_broker_config.py Loading commit data...
test_broker_dispatch.py Loading commit data...
test_broker_protocol.py Loading commit data...
test_broker_streaming.py Loading commit data...
test_burst_placement.py Loading commit data...
test_character_studio_fetch.py Loading commit data...
test_compose.py Loading commit data...
test_front_ocr_swap_gate.py Loading commit data...
test_image_has_c_compiler.py Loading commit data...
test_longcat_avatar_layout.py Loading commit data...
test_longcat_bsa.py Loading commit data...
test_longcat_cancellable.py Loading commit data...
test_longcat_checkpoint_resolve.py Loading commit data...
test_longcat_component_quant.py Loading commit data...
test_longcat_config_ui.py Loading commit data...
test_longcat_external_training.py Loading commit data...
test_longcat_int8_load.py Loading commit data...
test_longcat_lora.py Loading commit data...
test_longcat_orchestration.py Loading commit data...
test_longcat_packaging.py Loading commit data...
test_longcat_placement.py Loading commit data...
test_longcat_prompt_cache.py Loading commit data...
test_longcat_quantize.py Loading commit data...
test_longcat_scale.py Loading commit data...
test_longcat_tasks.py Loading commit data...
test_longcat_variants.py Loading commit data...
test_longcat_vendored_source.py Loading commit data...
test_longcat_venv_env.py Loading commit data...
test_longcat_vram_estimate.py Loading commit data...
test_longcat_worker.py Loading commit data...
test_manual_multimodal_test_client.py Loading commit data...
test_model_scan_cache.py Loading commit data...
test_ocr_olmocr.py Loading commit data...
test_ocr_vram_share_and_fallback.py Loading commit data...
test_remote_execution.py Loading commit data...
test_runpod_ocr_remotization.py Loading commit data...
test_runpod_schedule_region_spend.py Loading commit data...
test_studio_composed_surfaces.py Loading commit data...
test_township_api_key.py Loading commit data...
test_township_longcat.py Loading commit data...
test_township_page_js.py Loading commit data...
test_township_templates.py Loading commit data...
test_township_video_dataset.py Loading commit data...
test_upgrade_launcher.py Loading commit data...
test_video_as_b64_scope.py Loading commit data...
test_vllm_share_self_tuning.py Loading commit data...
test_vram_releasers.py Loading commit data...
test_weight_stores.py Loading commit data...
test_whisper_server_local_models.py Loading commit data...