GCP Uploader
by circ_le
Need to get your Apify datasets or key-value store records into Google Cloud Storage without the usual hassle? This actor does exactly that. Think of...
Opens on Apify.com
About GCP Uploader
Need to get your Apify datasets or key-value store records into Google Cloud Storage without the usual hassle? This actor does exactly that. Think of it as your automated bridge between Apify and GCS. You run a scraper, it collects data into a dataset, and then this actor picks it up and pushes it straight to your specified Google Cloud Storage bucket. The same goes for individual records you've stored in the key-value store. It handles the authentication and transfer so you don't have to write the integration scripts yourself. I use it mainly for two things: creating reliable backups of my scraped data outside of Apify, and preparing datasets for analysis in other Google Cloud Platform services like BigQuery. It saves a ton of time, especially when you're managing multiple crawlers and want a consistent way to archive or pipeline the results. Setup is straightforward—just configure your GCP service account credentials and target bucket, and you're good to go. If your workflow involves moving data from Apify into the Google Cloud ecosystem for storage, backup, or further processing, this uploader is a simple, set-and-forget solution.
What does this actor do?
GCP Uploader is a web scraping and automation tool available on the Apify platform. It's designed to help you extract data and automate tasks efficiently in the cloud.
Key Features
- Cloud-based execution - no local setup required
- Scalable infrastructure for large-scale operations
- API access for integration with your applications
- Built-in proxy rotation and anti-blocking measures
- Scheduled runs and webhooks for automation
How to Use
- Click "Try This Actor" to open it on Apify
- Create a free Apify account if you don't have one
- Configure the input parameters as needed
- Run the actor and download your results
Documentation
Google cloud platform storage uploader Actor allowing upload of both datasets and Key-value store records to the GCP Storage. ## Input ### key The service account key in a JSON format. You can generate this key in the Google Cloud console for each service account. ### bucketName Name of the bucket data will be uploaded to. ### Dataset upload inputs: - dataset ID - ID of the dataset to be uploaded - fileName - the name of uploaded file, if not specified, the ID will be used ### Key-value store records upload inputs: - key value store ID - ID of the store to upload records from - kvStoreRegex - if provided, only records with keys matching this regex will be uploaded to the storage - transformFileNameFunction - javascript function, allowing transformation of the records key in the storage. The function takes one parameter - the records key and should return the new name.
Categories
Common Use Cases
Market Research
Gather competitive intelligence and market data
Lead Generation
Extract contact information for sales outreach
Price Monitoring
Track competitor pricing and product changes
Content Aggregation
Collect and organize content from multiple sources
Ready to Get Started?
Try GCP Uploader now on Apify. Free tier available with no credit card required.
Start Free TrialActor Information
- Developer
- circ_le
- Pricing
- Paid
- Total Runs
- 167,117
- Active Users
- 44
Related Actors
Video Transcript Scraper: Youtube, X, Facebook, Tiktok, etc.
by invideoiq
Linkedin Profile Details Scraper + EMAIL (No Cookies Required)
by apimaestro
Twitter (X.com) Scraper Unlimited: No Limits
by apidojo
Content Checker
by jakubbalada
Apify provides a cloud platform for web scraping, data extraction, and automation. Build and run web scrapers in the cloud.
Learn more about ApifyNeed Professional Help?
Couldn't solve your problem? Hire a verified specialist on Fiverr to get it done quickly and professionally.
Trusted by millions | Money-back guarantee | 24/7 Support