> ## Documentation Index
> Fetch the complete documentation index at: https://studio-docs.prem.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Get Started With Datasets

> Learn how to upload, generate, manage, and use datasets in Prem.

# Creating a Dataset

In Prem, you can build datasets in two ways:

* **Upload an existing dataset** in `JSONL` format.
* **Generate synthetic datasets** directly from different input sources such as files, YouTube videos, websites, or a mix of sources.

## Uploading a Dataset

<Steps>
  <Step title="Create a Dataset">
    Click the **+ Create Dataset** button in the top-right corner of the page.

    <img src="https://static.premai.io/prem-saas-docs/datasets/get-started/step-0-createDataset.gif" alt="GIF of clicking the create a dataset button" />
  </Step>

  <Step title="Upload a File">
    * Enter a name for your dataset.
    * Upload your `JSONL` file.
    * Click **Confirm** to create the dataset.

    <img src="https://static.premai.io/prem-saas-docs/datasets/get-started/step-2-upload-dataset.gif" alt="GIF of uploading a file" />

    <Tip>
      Refer to our [Datasets](/datasets/overview) documentation for more information on the `JSONL` file format.
    </Tip>
  </Step>
</Steps>

## Generate a Dataset with Synthetic Data Generation

Synthetic data generation lets you create datasets from various input sources beyond JSONL. You can import documents, scrape websites, process YouTube videos, or combine multiple sources into one dataset.

<Steps>
  <Step title="Step 1: Define Dataset and Sources">
    * Enter a descriptive dataset name.
    * Choose one or more data sources:
      * **Files Only**: PDF, DOCX, TXT, HTML, PPTX
      * **YouTube Videos**: individual videos or playlists
      * **Web Scraping**: one or more website URLs
      * **Mixed Sources**: combine multiple input types
    * Set the number of QA pairs to generate from each source.

    <img src="https://static.premai.io/prem-saas-docs/datasets/get-started/synthetic-gen/step-1-input-sources.gif" alt="Synthetic Dataset Generation - Input sources selection" />
  </Step>

  <Step title="Step 2: Set Optional Guidance (Optional)">
    Get control of the generation process by setting additional parameters:

    * **Rules & Constraints** – add conditions for the generated content (e.g., enforce style, define tone, restrict scope).
    * **QA Guidance** – provide example pairs or specify output formats.
    * **Creativity Level** – adjust the model’s temperature to balance consistency vs. variety.

    <img src="https://static.premai.io/prem-saas-docs/datasets/get-started/synthetic-gen/step-2-advanced-settings.gif" alt="Synthetic Dataset Generation - Define advanced settings" />
  </Step>

  <Step title="Step 3: Review and Create Dataset">
    Review a recap of your settings from the previous steps.
    Click **Create Dataset** to start the generation process.

    <img src="https://static.premai.io/prem-saas-docs/datasets/get-started/synthetic-gen/step-3-summary.png" alt="Synthetic Dataset Generation - Summary" />
  </Step>
</Steps>

### Options for Synthetic Data Generation

When generating synthetic datasets, you can configure:

* **Data Sources** – files, YouTube videos, websites, or a mix.
* **Synthetic Pairs Configuration** – number of QA pairs per input.
* **Rules & Constraints** – optional rules to shape the outputs.
* **QA Guidance** – add examples or output specifications.
* **Creativity Level** – control the randomness of the generation.

For deeper explanations and advanced usage, see our user guide on how to [Generate Dataset from Text Files](/guides/datasets/synthetic-data).

***

# Next Steps

<CardGroup cols={2}>
  <Card title="Enrich a Dataset" icon="sparkles" href="/datasets/enrich-dataset">
    Start a data augmentation job to add synthetic data to your dataset.
  </Card>

  <Card title="Create a Snapshot" icon="camera" href="/datasets/create-snapshot">
    Create a snapshot of your dataset to save your current state.
  </Card>
</CardGroup>

<CardGroup cols={2}>
  <Card title="Autosplit a Dataset" icon="split" href="/datasets/autosplit-dataset">
    Automatically split your dataset into training, validation, and test sets.
  </Card>

  <Card title="Fine-Tune a Model" icon="robot" href="/finetuning/overview">
    Fine-tune a model on your dataset.
  </Card>
</CardGroup>