• Stefy Lanza (nextime / spora )'s avatar
    move RunPod REST calls to API v2, which has its own quota (v0.4.57) · d958a11e
    Stefy Lanza (nextime / spora ) authored
    Verified against RunPod's v2 OpenAPI spec and live headers on 2026-10-20.
    GraphQL quota is 180/min, 3,600/h, 43,200/day; ours read
    x-ratelimit-remaining-day 0 with Retry-After 3939. REST v2 has a separate
    per-user quota (180/min, 7,200/h, 86,400/day) and read "day";r=86399 at the
    same moment. v2 then terminated a pod (204) that REST v1 (500) and GraphQL
    (429) could not. v1 is deprecated and retires 2026-11-15.
    
    - All REST traffic now goes to https://api.runpod.io/v2: get/list pods
      (with pagination), terminate (DELETE, 404 counts as gone), create
      (POST /v2/pods with gpu{id,count}, cloud, disk, ports, env, entrypoint/cmd,
      dataCenterIds, mounts persistent/network/global), network volumes, and the
      priced GPU catalogue.
    - v2-first with GraphQL as fallback for the high-volume reads (status,
      listing, boot polling) and for terminate. GraphQL stays primary for create
      and the catalogue because only it offers spot bidding and spot prices. They
      switch to v2 during a GraphQL ban. v2 refuses spot rather than renting it
      on-demand.
    - v2 phases map to the pool's words (PROVISIONING/STARTING -> RUNNING,
      ERROR -> FAILED). Runtime memory and CPU utilisation are kept per pod.
    - v2's own 429 and Retry-After are honoured, and its live RateLimit header
      is kept.
    - The global volume is the documented mounts.global on v2. A refused one is
      retried without it, the same guard as the GraphQL path.
    Co-Authored-By: 's avatarClaude Opus 5.5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01KnfkxBpcZ1v6ypRFFyhrVM
    d958a11e
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...