What is a Bulk Run?
A Bulk Run allows you to run your robot on multiple URLs or with different parameters in a single operation, saving you the time of setting up each task individually. You can import up to 500,000 URLs through a CSV file, making it perfect for:
Scraping large numbers of product detail pages.
Extracting data from multiple search results.
Performing deep scraping across many pages.
Batch processing with different parameters.
Importing a CSV to your Table to trigger a Bulk Run
Step 1. Creating your CSV file
Before importing, you'll need a properly formatted CSV file with URLs and any other parameters your robot requires. Here are three ways to create this file:
Option 1: Download and modify a sample template
The simplest approach for first-time users:
Navigate to your robot's Table view and click Import CSV.
Find the Download Sample CSV Input button in the sidebar.
Open the downloaded template in Excel, Google Sheets, or another spreadsheet program.
Add your list of URLs in the "originUrl" column.
Add values for any other input parameters your robot requires.
Save the file as CSV format.
Option 2: Export from another robot (for deep scraping)
Perfect for multi-page scraping workflows:
Run your first robot to collect a list of URLs (e.g., from a category page).
Go to that robot's Table and select the tab containing the URL data.
Click "Export" and select CSV format.
Download the exported file.
If needed, modify the file to match the format required by your second robot.
This method is particularly useful for "deep scraping" - where one robot collects URLs and another extracts detailed information from each URL.
See:
Option 3: Create a CSV manually
For advanced users or when integrating with other tools:
Create a spreadsheet with columns for each input parameter your robot needs.
Ensure at least one column contains the URLs to scrape.
Additional columns should match the names of your robot's input parameters.
Save as CSV format.
Important CSV formatting tips:
Include a header row with column names.
Make sure URLs include the full address (including http:// or https://).
Avoid special characters in your CSV.
Ensure the file is properly encoded (UTF-8 recommended).
Step 2: Upload your CSV
Once your CSV file is ready, follow these steps to import it:
Navigate to your robot's Table view.
Click the Import CSV button at the top of your Table.
Click the "Click to upload" area in the sidebar that appears.
Select your prepared CSV file from your computer.
The system will preview your file to confirm it contains the correct data.
Step 3: Configure your import
Select which column contains the URLs to scrape.
Map any additional columns to the appropriate input parameters.
Review the data before proceeding.
Step 4: Start your Bulk Run
Click Start Bulk Run to begin processing.
Your tasks will be queued and processed sequentially.
Results will appear in your Table as they complete.
Monitoring your Bulk Run
After starting your Bulk Run:
The run will appear in your Table with a unique Bulk Run name.
Tasks will process sequentially according to your plan limits.
You can filter your Table by the Bulk Run name to see only these results.
Progress indicators will show how many tasks are complete vs. pending.
Common use cases
E-commerce product research
Import URLs of multiple product pages to extract pricing, features, and availability across competitors.
Real estate market analysis
After scraping property listings from search results, use Bulk Run to get detailed information about each property.
Content aggregation
Import URLs of articles or blog posts to extract and compile content from multiple sources.
Lead generation
Scrape contact details from a list of company pages or professional profiles.
Watch & learn
In the comprehensive video below, skip to 7:36 or use the Chapters feature on the video and choose Import the CSV.
Troubleshooting
If you encounter issues with your Bulk Run:
Verify your CSV is properly formatted with the correct column names.
Check that all URLs are valid and accessible.
Ensure you have sufficient credits for the number of tasks.
For large imports, be patient as processing may take time.
Contact our support team if you need assistance with complex imports.