wehub-resource-sync
53 lines
904 B
ReStructuredText
53 lines
904 B
ReStructuredText
.. _llm-ref:
|
|
|
|
Large Language Model (LLM) API
|
|
==============================
|
|
|
|
.. currentmodule:: ray.data.llm
|
|
|
|
LLM processor builder
|
|
---------------------
|
|
|
|
.. autosummary::
|
|
:nosignatures:
|
|
:toctree: doc/
|
|
|
|
~build_processor
|
|
|
|
Processor
|
|
---------
|
|
|
|
.. autosummary::
|
|
:nosignatures:
|
|
:toctree: doc/
|
|
|
|
~Processor
|
|
|
|
Processor configs
|
|
-----------------
|
|
|
|
.. autosummary::
|
|
:nosignatures:
|
|
:template: autosummary/class_without_autosummary_noinheritance.rst
|
|
:toctree: doc/
|
|
|
|
~ProcessorConfig
|
|
~HttpRequestProcessorConfig
|
|
~vLLMEngineProcessorConfig
|
|
~SGLangEngineProcessorConfig
|
|
|
|
.. _stage-configs-ref:
|
|
|
|
Stage configs
|
|
-------------
|
|
|
|
.. autosummary::
|
|
:nosignatures:
|
|
:template: autosummary/class_without_autosummary_noinheritance.rst
|
|
:toctree: doc/
|
|
|
|
~ChatTemplateStageConfig
|
|
~TokenizerStageConfig
|
|
~DetokenizeStageConfig
|
|
~PrepareMultimodalStageConfig
|