Dataset to HuggingFace

Overview

This actor transfers data from an Apify dataset to a Hugging Face dataset. It bridges Apify's web scraping ecosystem with Hugging Face's machine learning platform, enabling you to move scraped data directly into an environment with access to thousands of pre-trained models, collaborative tools, and streamlined ML pipelines.

The actor preserves the dataset ID, so your Hugging Face dataset identifier matches your original Apify dataset ID, making it easy to track data across platforms.

Key Features

• Direct Data Transfer: Moves data from any Apify dataset to a new or existing Hugging Face dataset.
• Transfer Limits: Control the volume of data transferred using a configurable maxItems parameter.
• Seamless Integration: Designed to chain directly after web scraping actors, using the default dataset ID as input to automate the workflow from data collection to ML-ready dataset.
• Detailed Logging: Provides transparency and debugging information throughout the transfer process.

How to Use

1. Configure Input: Set the required parameters in the actor's input.
2. Run the Actor: Start the actor on the Apify platform.
3. Access Data: Once finished, your data will be available in the specified Hugging Face dataset.

Input

Configure the actor using the following input fields.

{
  "apifyDatasetId": "your-apify-dataset-id",
  "huggingFaceDatasetName": "your-huggingface-dataset-name",
  "huggingFaceToken": "your-huggingface-api-token",
  "maxItems": 1000
}

• apifyDatasetId (required): The ID of the Apify dataset to transfer data from.
• huggingFaceDatasetName (required): The name for the target dataset on Hugging Face.
• huggingFaceToken (required): Your Hugging Face API token for authentication.
• maxItems (optional): The maximum number of items to transfer. Use 0 to transfer all items.

Output

The actor's primary output is the dataset created on Hugging Face. You can find it at https://huggingface.co/datasets/{huggingFaceDatasetName}. The run log will confirm the transfer's success and item count.

Integration & Workflow

This actor is typically used in a pipeline following a web scraper. For example:
1. A web scraper actor runs and stores its results in an Apify dataset.
2. This actor takes that dataset's ID as input (apifyDatasetId).
3. It transfers the scraped data to Hugging Face, making it immediately available for machine learning tasks.

The actor can also be integrated with other services via the Apify platform, including Make, Zapier, Slack, Airbyte, GitHub, Google Sheets, and Google Drive.

Feedback

For suggestions or issues, please create an issue on the actor's GitHub repository or contact Apify support.