.. _llm-ref:

Large Language Model (LLM) API
==============================

.. currentmodule:: ray.data.llm

LLM processor builder
---------------------

.. autosummary::
    :nosignatures:
    :toctree: doc/

    ~build_processor

Processor
---------

.. autosummary::
    :nosignatures:
    :toctree: doc/

    ~Processor

Processor configs
-----------------

.. autosummary::
    :nosignatures:
    :template: autosummary/class_without_autosummary_noinheritance.rst
    :toctree: doc/

    ~ProcessorConfig
    ~HttpRequestProcessorConfig
    ~vLLMEngineProcessorConfig
    ~SGLangEngineProcessorConfig

.. _stage-configs-ref:

Stage configs
-------------

.. autosummary::
    :nosignatures:
    :template: autosummary/class_without_autosummary_noinheritance.rst
    :toctree: doc/

    ~ChatTemplateStageConfig
    ~TokenizerStageConfig
    ~DetokenizeStageConfig
    ~PrepareMultimodalStageConfig