Commit 4d4d8f59 authored by chenzk's avatar chenzk
Browse files

v1.0

parents
Pipeline #2741 canceled with stages
# LLM Gallery
This section contains the existing [`LLM`][distilabel.models.llms] subclasses implemented in `distilabel`.
::: distilabel.models.llms
options:
filters:
- "!^LLM$"
- "!^AsyncLLM$"
- "!typing"
\ No newline at end of file
# Pipeline
This section contains the API reference for the `distilabel` pipelines. For an example on how to use the pipelines, see the [Tutorial - Pipeline](../../sections/how_to_guides/basic/pipeline/index.md).
::: distilabel.pipeline.base
::: distilabel.pipeline.local
# Routing batch function
::: distilabel.pipeline.routing_batch_function
# Step Wrapper
::: distilabel.pipeline.step_wrapper._StepWrapper
::: distilabel.pipeline.step_wrapper._StepWrapperException
# @step
This section contains the reference for the `@step` decorator, used to create new [`Step`][distilabel.steps.Step] subclasses without having to manually define the class.
For more information check the [Tutorial - Step](../../sections/how_to_guides/basic/step/index.md) page.
::: distilabel.steps.decorator
# GeneratorStep
This section contains the API reference for the [`GeneratorStep`][distilabel.steps.base.GeneratorStep] class.
For more information and examples on how to use existing generator steps or create custom ones, please refer to [Tutorial - Step - GeneratorStep](../../sections/how_to_guides/basic/step/generator_step.md).
::: distilabel.steps.base.GeneratorStep
::: distilabel.steps.generators.utils.make_generator_step
# GlobalStep
This section contains the API reference for the [`GlobalStep`][distilabel.steps.base.GlobalStep] class.
For more information and examples on how to use existing global steps or create custom ones, please refer to [Tutorial - Step - GlobalStep](../../sections/how_to_guides/basic/step/global_step.md).
::: distilabel.steps.base.GlobalStep
# Step
This section contains the API reference for the `distilabel` step, both for the [`_Step`][distilabel.steps.base._Step] base class and the [`Step`][distilabel.steps.Step] class.
For more information and examples on how to use existing steps or create custom ones, please refer to [Tutorial - Step](../../sections/how_to_guides/basic/step/index.md).
::: distilabel.steps.base
options:
members:
- _Step
- Step
- StepInput
# StepResources
::: distilabel.steps.base.StepResources
# Argilla
This section contains the existing steps integrated with `Argilla` so as to easily push the generated datasets to Argilla.
::: distilabel.steps.argilla.base
::: distilabel.steps.argilla.preference
::: distilabel.steps.argilla.text_generation
# Columns
This section contains the existing steps intended to be used for common column operations to apply to the batches.
::: distilabel.steps.columns.expand
::: distilabel.steps.columns.keep
::: distilabel.steps.columns.merge
::: distilabel.steps.columns.group
::: distilabel.steps.columns.utils
# Extra
::: distilabel.steps
options:
filters:
- "!Argilla"
- "!Columns"
- "!From(Disk|FileSystem)"
- "!Hub"
- "![Ss]tep"
- "!typing"
# Hugging Face
This section contains the existing steps integrated with `Hugging Face` so as to easily push the generated datasets to Hugging Face.
::: distilabel.steps.LoadDataFromDisk
::: distilabel.steps.LoadDataFromFileSystem
::: distilabel.steps.LoadDataFromHub
::: distilabel.steps.PushToHub
\ No newline at end of file
# GeneratorTask
This section contains the API reference for the `distilabel` generator tasks.
For more information on how the [`GeneratorTask`][distilabel.steps.tasks.GeneratorTask] works and see some examples, check the [Tutorial - Task - GeneratorTask](../../sections/how_to_guides/basic/task/generator_task.md) page.
::: distilabel.steps.tasks.base.GeneratorTask
# ImageTask
This section contains the API reference for the `distilabel` image generation tasks.
For more information on how the [`ImageTask`][distilabel.steps.tasks.ImageTask] works and see some examples, check the [Tutorial - Task - ImageTask](../../sections/how_to_guides/basic/task/generator_task.md) page.
::: distilabel.steps.tasks.base.ImageTask
# Task
This section contains the API reference for the `distilabel` tasks.
For more information on how the [`Task`][distilabel.steps.tasks.Task] works and see some examples, check the [Tutorial - Task](../../sections/how_to_guides/basic/task/index.md) page.
::: distilabel.steps.tasks.base
options:
members:
- _Task
- Task
# Task Gallery
This section contains the existing [`Task`][distilabel.steps.tasks.Task] subclasses implemented in `distilabel`.
::: distilabel.steps.tasks
options:
filters:
- "!Task"
- "!_Task"
- "!GeneratorTask"
- "!ImageTask"
- "!ChatType"
- "!typing"
\ No newline at end of file
# Types
This section contains the different types used accross the distilabel codebase.
::: distilabel.typing.base
::: distilabel.typing.steps
::: distilabel.typing.models
::: distilabel.typing.pipeline
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment