> ## Documentation Index
> Fetch the complete documentation index at: https://docs.reelevant.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Learn about each data source connector available for importing data into the DataHub

<img src="https://mintcdn.com/reelevant/10tXeCE_biVlzX8s/images/datahub/source-types-v2.png?fit=max&auto=format&n=10tXeCE_biVlzX8s&q=85&s=81da004347be484f20839a04828c4940" alt="Source type selection showing available connectors" width="1280" height="800" data-path="images/datahub/source-types-v2.png" />

## Overview

When [creating a datasource](/product-guide/datahub/creating-a-datasource), you select a **source type** that defines how Reelevant retrieves the data. Each source type has its own configuration fields and capabilities.

## Available Connectors

<CardGroup cols={3}>
  <Card title="URL" icon="link" href="/advanced-guide/datahub/source-types/url">
    Fetch data from any HTTP/HTTPS endpoint — APIs, hosted files, or data feeds. Supports custom methods, headers, pagination, OAuth, and runtime variables.
  </Card>

  <Card title="File Upload" icon="file-arrow-up" href="/advanced-guide/datahub/source-types/file">
    Upload a data file directly from your computer. Supports CSV, JSON, XML, Parquet, Avro, and XLSX.
  </Card>

  <Card title="FTP & SFTP" icon="server" href="/advanced-guide/datahub/source-types/ftp-sftp">
    Connect to FTP or SFTP servers. Supports password and private key authentication, wildcard paths, and multiple file processing modes.
  </Card>

  <Card title="BigQuery" icon="database" href="/advanced-guide/datahub/source-types/bigquery">
    Synchronize data from Google BigQuery. Supports service account and OAuth authentication, custom SQL queries, and incremental sync.
  </Card>

  <Card title="Snowflake" icon="snowflake" href="/advanced-guide/datahub/source-types/snowflake">
    Synchronize tables from Snowflake. Supports password and key-pair authentication, custom SQL queries, and incremental sync.
  </Card>

  <Card title="Google Cloud Storage" icon="cloud" href="/advanced-guide/datahub/source-types/gcs">
    Retrieve files from GCS buckets. Supports wildcard paths, multiple file processing modes, and all common file formats.
  </Card>

  <Card title="Amazon S3" icon="bucket" href="/advanced-guide/datahub/source-types/s3">
    Retrieve files from S3 or S3-compatible storage (MinIO, DigitalOcean Spaces, etc.). Supports wildcard paths and all common file formats.
  </Card>

  <Card title="Kafka" icon="bolt" href="/advanced-guide/datahub/source-types/kafka">
    Stream data from Apache Kafka topics. Supports SASL authentication, Schema Registry (Avro), and batch or continuous consumption.
  </Card>

  <Card title="Datasource Reference" icon="arrows-rotate" href="/advanced-guide/datahub/source-types/datasource-reference">
    Reference another existing datasource as a data source for derived computations (merge, best products, cross-sell).
  </Card>
</CardGroup>

## Supported File Formats

File-based connectors (URL, File Upload, FTP/SFTP, GCS, S3) automatically detect the file format. The following formats are supported across all file-based sources:

| Format      | Description                                                                                                                                                                    |
| ----------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **CSV**     | Comma-separated values. Delimiter is auto-detected (comma, semicolon, tab, pipe). Supports [explicit column names](/advanced-guide/datahub/csv-options) for header-less files. |
| **JSON**    | Standard JSON files with a root array or object.                                                                                                                               |
| **NDJSON**  | Newline-delimited JSON (one JSON object per line).                                                                                                                             |
| **XML**     | XML files — the root element path is auto-detected.                                                                                                                            |
| **Parquet** | Apache Parquet columnar format.                                                                                                                                                |
| **Avro**    | Apache Avro serialization format.                                                                                                                                              |
| **XLSX**    | Microsoft Excel files.                                                                                                                                                         |

<Info>
  Compressed files (`.gz`, `.zip`) are automatically decompressed before parsing for all file-based sources.
</Info>

<Info>
  File-based connectors (URL, FTP/SFTP, GCS, S3) also support [PGP decryption](/advanced-guide/datahub/pgp-decryption) — encrypted files (`.asc`, `.pgp`, `.gpg`) are decrypted transparently during import when `pgpPrivateKey` is configured.
</Info>

## Multiple Sources

Some datasource types support **multiple sources**. You can add several source configurations (e.g., multiple URLs or FTP paths) to a single datasource using the **Add a source** button. Each source is processed independently, and the results are combined.

Use **Delete the source** to remove individual source configurations.

## Comparison Table

| Feature                                                  | URL | File | FTP/SFTP | BigQuery | Snowflake | GCS | S3  | Kafka | Datasource Ref |
| -------------------------------------------------------- | --- | ---- | -------- | -------- | --------- | --- | --- | ----- | -------------- |
| Auto-format detection                                    | Yes | Yes  | Yes      | —        | —         | Yes | Yes | —     | —              |
| Wildcard paths                                           | —   | —    | Yes      | —        | —         | Yes | Yes | —     | —              |
| Custom SQL queries                                       | —   | —    | —        | Yes      | Yes       | —   | —   | —     | —              |
| Incremental sync                                         | —   | —    | —        | Yes      | Yes       | —   | —   | Yes   | —              |
| Pagination                                               | Yes | —    | —        | —        | —         | —   | —   | —     | —              |
| OAuth support                                            | Yes | —    | —        | Yes      | —         | —   | —   | —     | —              |
| Key-pair auth                                            | —   | —    | Yes      | —        | Yes       | —   | —   | —     | —              |
| Multiple sources                                         | Yes | —    | Yes      | —        | —         | Yes | Yes | —     | —              |
| [PGP decryption](/advanced-guide/datahub/pgp-decryption) | Yes | —    | Yes      | —        | —         | Yes | Yes | —     | —              |