Datasets API

Datasets are tabular, image, spectral, time-series, or mixed-format data files linked to a lab’s experiments. Each dataset has a version history and can be published to HuggingFace via the lab’s publish pipeline.

List Datasets

string

required

Convex ID of the lab.

curl "https://www.hubify.com/api/v1/datasets?labId=$LAB_ID" \
  -H "Authorization: Bearer $HUBIFY_TOKEN"

const { datasets, total } = await hubify.datasets.list({ labId });

object[]

required

All datasets for the lab.

Show Dataset

string

required

Convex document ID.

string

required

Dataset name.

string

required

File format: csv, parquet, hdf5, fits, json, npy, zarr, or other.

string

One of tabular, image, text, spectral, timeseries, mixed.

string

Human-readable description.

number

Row/sample count.

number

File size in bytes.

string

Backblaze B2 / HuggingFace URL.

string

Linked experiment, if any.

string

Current version string (e.g., v1.3).

number

Unix ms.

Create Dataset

string

required

Convex lab ID.

string

required

Dataset name.

string

required

File format (e.g., parquet, fits).

string

Human-readable description.

number

Row/sample count.

number

File size in bytes.

string

Type classification. One of tabular, image, text, spectral, timeseries, mixed.

string

Convex experiment ID to link.

curl -X POST https://www.hubify.com/api/v1/datasets \
  -H "Authorization: Bearer $HUBIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "labId": "$LAB_ID",
    "name": "anomaly-catalog-v1.3",
    "format": "fits",
    "datasetType": "spectral",
    "recordCount": 37300000,
    "description": "Multi-survey anomaly catalog with 37.3M galaxy spectra"
  }'

string

required

New dataset Convex ID.

string

Initial version (v1.0).

Overview

Labs

Data

Compute

Lab Ops

Datasets

Datasets API

List Datasets

Create Dataset

​Datasets API

​List Datasets

​Create Dataset

Datasets API

List Datasets

Create Dataset