e93507a09c
Lockfile supply-chain audit / lockfile supply-chain audit (push) Has been cancelled
Windows Studio GGUF CI / GPU prebuilt resolves without Visual Studio (push) Has been cancelled
Windows Studio GGUF CI / setup.ps1 unit tests (VS 2026 / CMake guard) (push) Has been cancelled
Windows Studio GGUF CI / real-VS detection (VS 2022) (push) Has been cancelled
Windows Studio GGUF CI / real-VS detection (VS 2026) (push) Has been cancelled
Windows Studio GGUF CI / VC++ runtime detect + install round-trip (windows-2025-vs2026) (push) Has been cancelled
Windows Studio GGUF CI / VC++ runtime detect + install round-trip (windows-latest) (push) Has been cancelled
Windows Studio Update CI / Studio Updating Tests (push) Has been cancelled
Wheel CI / Wheel build + content sanity + import smoke (push) Has been cancelled
Lint CI / Source lint (Python + shell + YAML + JSON + safety nets) (push) Has been cancelled
MLX CI on Mac M1 / dispatch (push) Has been cancelled
Security audit / advisory audit (pip + npm + cargo) (push) Has been cancelled
Security audit / pip scan-packages :: extras (push) Has been cancelled
Security audit / pip scan-packages :: studio (push) Has been cancelled
Security audit / pip scan-packages :: hf-stack (push) Has been cancelled
Security audit / npm scan-packages (Studio frontend tarballs) (push) Has been cancelled
Security audit / workflow-trigger lint (pull_request_target / cache-poisoning) (push) Has been cancelled
Security audit / pytest tests/security (push) Has been cancelled
Security audit / npm provenance + new install-script diff (push) Has been cancelled
Studio API CI / Studio API & Auth Tests (push) Has been cancelled
Backend CI / (Python 3.10) (push) Has been cancelled
Backend CI / (Python 3.11) (push) Has been cancelled
Backend CI / (Python 3.12) (push) Has been cancelled
Backend CI / (Python 3.13) (push) Has been cancelled
Backend CI / Repo tests (CPU) (push) Has been cancelled
Frontend CI / Frontend build + bundle sanity (push) Has been cancelled
Studio GGUF CI / OpenAI, Anthropic API tests (push) Has been cancelled
Studio GGUF CI / Tool calling Tests (push) Has been cancelled
Studio GGUF CI / JSON, images (push) Has been cancelled
Mac Studio GGUF CI / OpenAI, Anthropic API tests (push) Has been cancelled
Mac Studio GGUF CI / Tool calling Tests (push) Has been cancelled
Mac Studio GGUF CI / JSON, images (push) Has been cancelled
Mac Studio Install Matrix CI / Install + load (macos-14) (push) Has been cancelled
Mac Studio Install Matrix CI / Install + load (macos-15) (push) Has been cancelled
Mac Studio Install Matrix CI / Install + load (macos-26) (push) Has been cancelled
Mac Studio Install Matrix CI / Install + load (macos-15-intel) (push) Has been cancelled
Mac Studio API CI / Studio API & Auth Tests (push) Has been cancelled
Mac Studio Install Matrix CI / Install + load (macos-26-intel) (push) Has been cancelled
Mac Studio UI CI / Chat UI Tests (push) Has been cancelled
Studio Tauri CI / Tauri Linux debug build (no codesign) (push) Has been cancelled
Mac Studio Update CI / Studio Updating Tests (push) Has been cancelled
Studio UI CI / Chat UI Tests (push) Has been cancelled
Windows Studio API CI / Studio API & Auth Tests (push) Has been cancelled
Windows Studio UI CI / Chat UI Tests (push) Has been cancelled
Studio Update CI / Studio Updating Tests (push) Has been cancelled
Core / Core (HF=default + TRL=default) (push) Has been cancelled
Core / Core (HF=4.57.6 + TRL<1) (push) Has been cancelled
Core / Core (HF=latest + TRL=latest) (push) Has been cancelled
Core / llama.cpp build + smoke (push) Has been cancelled
Windows Studio GGUF CI / OpenAI, Anthropic API tests (push) Has been cancelled
Windows Studio GGUF CI / Tool calling Tests (push) Has been cancelled
Windows Studio GGUF CI / JSON, images (push) Has been cancelled
Windows Studio GGUF CI / Studio install + inference without Visual Studio (push) Has been cancelled
Studio export capability / capability (macos-latest) (push) Has been cancelled
Studio export capability / capability (ubuntu-latest) (push) Has been cancelled
Studio export capability / capability (windows-latest) (push) Has been cancelled
Cross-platform parity / parity (macos-latest) (push) Has been cancelled
Cross-platform parity / parity (windows-latest) (push) Has been cancelled
Scorecard supply-chain security / Scorecard analysis (push) Has been cancelled
Studio load-orchestrator CI / test (push) Has been cancelled
260 lines
9.4 KiB
Python
260 lines
9.4 KiB
Python
# SPDX-License-Identifier: AGPL-3.0-only
|
|
# Copyright 2026-present the Unsloth AI Inc. team. All rights reserved. See /studio/LICENSE.AGPL-3.0
|
|
|
|
"""Error-envelope helpers for the OpenAI/Anthropic-compatible ``/v1/*`` API surface.
|
|
|
|
FastAPI's defaults emit ``{"detail": ...}`` bodies (status 422 for validation,
|
|
``exc.status_code`` for ``HTTPException``). Real OpenAI/Anthropic clients expect
|
|
provider-specific error envelopes instead, so this module re-wraps Unsloth's own
|
|
client-error responses on the ``/v1/*`` surface:
|
|
|
|
- OpenAI surface (``/v1/chat/completions``, ``/v1/completions``, ``/v1/models``,
|
|
``/v1/responses``, ``/v1/embeddings``, ...)::
|
|
|
|
{"error": {"message": str, "type": str, "param": None|str, "code": None|str}}
|
|
|
|
- Anthropic surface (any path starting with ``/v1/messages``)::
|
|
|
|
{"type": "error", "error": {"type": str, "message": str}}
|
|
|
|
CRITICAL: the exception handlers installed by :func:`install_api_error_handlers`
|
|
are global, but they ONLY transform responses for paths that start with ``/v1/``.
|
|
For every other path (``/api/...``, frontend routes) they reproduce FastAPI's
|
|
default behavior byte-for-byte, because the Studio frontend depends on the
|
|
``{"detail": ...}`` shape for ``/api/*``.
|
|
|
|
Public contract (other modules depend on these):
|
|
|
|
- ``OPENAI_TYPE_BY_STATUS`` / ``ANTHROPIC_TYPE_BY_STATUS``: status -> type maps.
|
|
- ``openai_error_body(message, *, status=400, err_type=None, code=None, param=None)``
|
|
- ``anthropic_error_body(message, *, status=400, err_type=None)``
|
|
- ``is_anthropic_path(path)``
|
|
- ``error_body_for_path(path, message, *, status, err_type=None, code=None, param=None)``
|
|
- ``install_api_error_handlers(app)``
|
|
"""
|
|
|
|
from fastapi.encoders import jsonable_encoder
|
|
from fastapi.responses import JSONResponse, Response
|
|
from fastapi.exceptions import RequestValidationError
|
|
from fastapi.utils import is_body_allowed_for_status_code
|
|
from starlette.exceptions import HTTPException as StarletteHTTPException
|
|
|
|
|
|
# Status-code -> error ``type`` string for the OpenAI error envelope.
|
|
OPENAI_TYPE_BY_STATUS = {
|
|
400: "invalid_request_error",
|
|
401: "authentication_error",
|
|
403: "permission_error",
|
|
404: "not_found_error",
|
|
409: "conflict_error",
|
|
413: "invalid_request_error",
|
|
422: "invalid_request_error",
|
|
429: "rate_limit_error",
|
|
500: "api_error",
|
|
502: "api_error",
|
|
503: "api_error",
|
|
}
|
|
|
|
# Status-code -> error ``type`` string for the Anthropic error envelope.
|
|
ANTHROPIC_TYPE_BY_STATUS = {
|
|
400: "invalid_request_error",
|
|
401: "authentication_error",
|
|
403: "permission_error",
|
|
404: "not_found_error",
|
|
409: "conflict_error",
|
|
413: "request_too_large",
|
|
422: "invalid_request_error",
|
|
429: "rate_limit_error",
|
|
500: "api_error",
|
|
502: "api_error",
|
|
503: "api_error",
|
|
529: "overloaded_error",
|
|
}
|
|
|
|
|
|
def openai_error_body(
|
|
message,
|
|
*,
|
|
status = 400,
|
|
err_type = None,
|
|
code = None,
|
|
param = None,
|
|
) -> dict:
|
|
"""Build an OpenAI-style error envelope.
|
|
|
|
Returns ``{"error": {"message", "type", "param", "code"}}``. The ``param``
|
|
and ``code`` keys are always present (value may be ``None``). ``err_type``
|
|
defaults to :data:`OPENAI_TYPE_BY_STATUS` for ``status`` (``"api_error"``
|
|
fallback).
|
|
"""
|
|
return {
|
|
"error": {
|
|
"message": str(message),
|
|
"type": err_type or OPENAI_TYPE_BY_STATUS.get(status, "api_error"),
|
|
"param": param,
|
|
"code": code,
|
|
}
|
|
}
|
|
|
|
|
|
def anthropic_error_body(
|
|
message,
|
|
*,
|
|
status = 400,
|
|
err_type = None,
|
|
) -> dict:
|
|
"""Build an Anthropic-style error envelope.
|
|
|
|
Returns ``{"type": "error", "request_id": None, "error": {"type", "message"}}``.
|
|
``request_id`` is a required (nullable) field on the spec's ErrorResponse;
|
|
Studio has no request-id system, so it is null. ``err_type`` defaults to
|
|
:data:`ANTHROPIC_TYPE_BY_STATUS` for ``status`` (``"api_error"`` fallback).
|
|
"""
|
|
return {
|
|
"type": "error",
|
|
"request_id": None,
|
|
"error": {
|
|
"type": err_type or ANTHROPIC_TYPE_BY_STATUS.get(status, "api_error"),
|
|
"message": str(message),
|
|
},
|
|
}
|
|
|
|
|
|
def is_anthropic_path(path: str) -> bool:
|
|
"""True iff ``path`` belongs to the Anthropic surface (``/v1/messages*``)."""
|
|
return path.startswith("/v1/messages")
|
|
|
|
|
|
def wants_api_error_envelope(path: str) -> bool:
|
|
"""True for the OpenAI/Anthropic-compatible surfaces: the ``/v1/*`` mount and
|
|
the preview ``/p/<run>[/<ckpt>]/v1/*`` mount."""
|
|
return path.startswith("/v1/") or (path.startswith("/p/") and "/v1/" in path)
|
|
|
|
|
|
def error_body_for_path(
|
|
path,
|
|
message,
|
|
*,
|
|
status,
|
|
err_type = None,
|
|
code = None,
|
|
param = None,
|
|
) -> dict:
|
|
"""Dispatch to the correct envelope builder based on ``path``.
|
|
|
|
Anthropic surface paths use :func:`anthropic_error_body` (``code``/``param``
|
|
are not part of that envelope and are ignored); all other ``/v1/*`` paths use
|
|
:func:`openai_error_body`.
|
|
"""
|
|
if is_anthropic_path(path):
|
|
return anthropic_error_body(message, status = status, err_type = err_type)
|
|
return openai_error_body(message, status = status, err_type = err_type, code = code, param = param)
|
|
|
|
|
|
def _summarize_validation_errors(errors) -> tuple:
|
|
"""Derive a readable one-line message and (optional) body param from ``exc.errors()``.
|
|
|
|
Returns ``(summary, param)``. ``summary`` is a human-readable string like
|
|
``"messages: Field required"``. ``param`` is the offending body field name when
|
|
one can be extracted (used as the OpenAI envelope ``param``), else ``None``.
|
|
|
|
Malformed-JSON bodies surface here as ``type == "json_invalid"`` and get a
|
|
dedicated message.
|
|
"""
|
|
if not errors:
|
|
return "Invalid request", None
|
|
|
|
first = errors[0]
|
|
if first.get("type") == "json_invalid":
|
|
return "Invalid JSON in request body", None
|
|
|
|
loc = first.get("loc", ()) or ()
|
|
msg = first.get("msg", "Invalid request")
|
|
|
|
# Extract the body field name (the loc element after a leading "body").
|
|
param = None
|
|
loc_parts = [p for p in loc if p not in ("body",)]
|
|
if loc and loc[0] == "body" and loc_parts:
|
|
# First non-"body" element that is a field name (string).
|
|
for part in loc_parts:
|
|
if isinstance(part, str):
|
|
param = part
|
|
break
|
|
|
|
label = ".".join(str(p) for p in loc_parts) if loc_parts else ".".join(str(p) for p in loc)
|
|
summary = f"{label}: {msg}" if label else str(msg)
|
|
return summary, param
|
|
|
|
|
|
def install_api_error_handlers(app) -> None:
|
|
"""Register validation + HTTPException handlers that emit ``/v1/*`` envelopes.
|
|
|
|
Both handlers are global but only transform responses for OpenAI/Anthropic-
|
|
compatible surfaces (see :func:`wants_api_error_envelope`: the ``/v1/*`` mount
|
|
and the preview ``/p/.../v1/*`` mount). Every other path reproduces FastAPI's
|
|
default ``{"detail": ...}`` behavior exactly so the Studio frontend keeps working.
|
|
"""
|
|
|
|
@app.exception_handler(RequestValidationError)
|
|
async def _handle_validation_error(request, exc):
|
|
path = request.url.path
|
|
if wants_api_error_envelope(path):
|
|
summary, param = _summarize_validation_errors(exc.errors())
|
|
return JSONResponse(
|
|
status_code = 400,
|
|
content = error_body_for_path(path, summary, status = 400, param = param),
|
|
)
|
|
# Default FastAPI behavior for every other path.
|
|
return JSONResponse(
|
|
status_code = 422,
|
|
content = {"detail": jsonable_encoder(exc.errors())},
|
|
)
|
|
|
|
@app.exception_handler(StarletteHTTPException)
|
|
async def _handle_http_exception(request, exc):
|
|
path = request.url.path
|
|
headers = getattr(exc, "headers", None)
|
|
# Statuses like 204/304/1xx must not carry a body — mirror FastAPI's
|
|
# default http_exception_handler, which returns a bodiless Response.
|
|
if not is_body_allowed_for_status_code(exc.status_code):
|
|
return Response(status_code = exc.status_code, headers = headers)
|
|
if wants_api_error_envelope(path):
|
|
detail = exc.detail
|
|
# Already a fully-formed envelope: pass through untouched.
|
|
if isinstance(detail, dict) and ("error" in detail or detail.get("type") == "error"):
|
|
return JSONResponse(
|
|
status_code = exc.status_code,
|
|
content = detail,
|
|
headers = headers,
|
|
)
|
|
# A dict carrying our individual fields.
|
|
if isinstance(detail, dict):
|
|
message = detail.get("message", detail)
|
|
err_type = detail.get("type")
|
|
code = detail.get("code")
|
|
param = detail.get("param")
|
|
else:
|
|
# Plain message string (the common HTTPException case).
|
|
message = detail
|
|
err_type = None
|
|
code = None
|
|
param = None
|
|
return JSONResponse(
|
|
status_code = exc.status_code,
|
|
content = error_body_for_path(
|
|
path,
|
|
message,
|
|
status = exc.status_code,
|
|
err_type = err_type,
|
|
code = code,
|
|
param = param,
|
|
),
|
|
headers = headers,
|
|
)
|
|
# Default FastAPI behavior for every other path.
|
|
return JSONResponse(
|
|
status_code = exc.status_code,
|
|
content = {"detail": exc.detail},
|
|
headers = headers,
|
|
)
|