What is Bulk Run?
Bulk Run allows you to execute multiple data extraction tasks simultaneously by processing a list of URLs.
This feature is particularly useful when you need to extract data from many similar pages, such as product details or business listings. You can extract data from up to 50,000 URLs at once using the Bulk Run feature.
Prerequisites
Before using Bulk Run, ensure you have:
A robot trained to extract data from detail pages
A CSV file containing the URLs you want to process
You can generate this list of URLs manually through your own internal process, or
You can generate this list of URLs by creating a robot to extract a list of URLs
Sufficient credits for your extraction needs
How to create a Bulk Run
Navigate to your detail page robot
Click the "Bulk Run" button
Upload your CSV file containing URLs
Map your CSV columns to the robot's parameters
Review and start the bulk run
Working with integrations
When using Bulk Run with integrations:
Maintain consistent column headers in connected spreadsheets
Recalibrate integrations if column names need to change
Test your integration setup with a small batch first
Managing Bulk Run tasks
You can manage your Bulk Run tasks from the History tab:
Monitor progress in real-time
Pause or stop runs as needed
Download results when complete
Troubleshooting
Common issues and solutions:
Mismatched URL formats: Ensure URLs match the robot's training format
Integration errors: Verify column mappings are correct
Failed runs: Check individual URL results for specific errors