GCP Uploader

GCP Uploader

by circ_le

Need to get your Apify datasets or key-value store records into Google Cloud Storage without the usual hassle? This actor does exactly that. Think of...

167,117 runs
44 users
Try This Actor

Opens on Apify.com

About GCP Uploader

Need to get your Apify datasets or key-value store records into Google Cloud Storage without the usual hassle? This actor does exactly that. Think of it as your automated bridge between Apify and GCS. You run a scraper, it collects data into a dataset, and then this actor picks it up and pushes it straight to your specified Google Cloud Storage bucket. The same goes for individual records you've stored in the key-value store. It handles the authentication and transfer so you don't have to write the integration scripts yourself. I use it mainly for two things: creating reliable backups of my scraped data outside of Apify, and preparing datasets for analysis in other Google Cloud Platform services like BigQuery. It saves a ton of time, especially when you're managing multiple crawlers and want a consistent way to archive or pipeline the results. Setup is straightforward—just configure your GCP service account credentials and target bucket, and you're good to go. If your workflow involves moving data from Apify into the Google Cloud ecosystem for storage, backup, or further processing, this uploader is a simple, set-and-forget solution.

What does this actor do?

GCP Uploader is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.

Key Features

  • Cloud-based execution - no local setup required
  • Scalable infrastructure for large-scale operations
  • API access for integration with your applications
  • Built-in proxy rotation and anti-blocking measures
  • Scheduled runs and webhooks for automation

How to Use

  1. Click "Try This Actor" to open it on Apify
  2. Create a free Apify account if you don't have one
  3. Configure the input parameters as needed
  4. Run the actor and download your results

Documentation

Google cloud platform storage uploader Actor allowing upload of both datasets and Key-value store records to the GCP Storage. ## Input ### key The service account key in a JSON format. You can generate this key in the Google Cloud console for each service account. ### bucketName Name of the bucket data will be uploaded to. ### Dataset upload inputs: - dataset ID - ID of the dataset to be uploaded - fileName - the name of uploaded file, if not specified, the ID will be used ### Key-value store records upload inputs: - key value store ID - ID of the store to upload records from - kvStoreRegex - if provided, only records with keys matching this regex will be uploaded to the storage - transformFileNameFunction - javascript function, allowing transformation of the records key in the storage. The function takes one parameter - the records key and should return the new name.

Common Use Cases

Market Research

Gather competitive intelligence and market data

Lead Generation

Extract contact information for sales outreach

Price Monitoring

Track competitor pricing and product changes

Content Aggregation

Collect and organize content from multiple sources

Ready to Get Started?

Try GCP Uploader now on Apify. Free tier available with no credit card required.

Start Free Trial

Actor Information

Developer
circ_le
Pricing
Paid
Total Runs
167,117
Active Users
44
Apify Platform

Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.

Learn more about Apify

Need Professional Help?

Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.

Find a Specialist

Trusted by millions | Money-back guarantee | 24/7 Support