Browse AI offers multiple ways to run your robots, from simple manual operations to fully automated solutions. This flexibility allows you to choose the best method based on your needs, whether you're running a one-time extraction or setting up ongoing data monitoring.
Manual running a task
Running a single task
The most straightforward way to run your robot is through the Run Task tab:
Navigate to your robot's detail page.
Select the Run Task tab.
Click the Run a Task button in the bottom right corner.
Your robot will execute and add the new data to your table.
This method is ideal for quick, one-off data extractions or when testing your robot.
Using bulk run for multiple URLs
When you need to extract data from multiple URLs at once, use the Bulk Run feature:
Method 1: From the Run Task tab
Navigate to your robot's detail page.
Select the Run Task tab.
Click the Bulk Run Tasks button in the bottom right corner.
Upload a CSV file containing the URLs you want to scrape.
Confirm to start the bulk operation.
Method 2: From the robot's table
Navigate to your robot's detail page.
Go to the Table tab.
Click the Import CSV button above the data table.
In the sidebar that opens, click to upload your CSV file.
Confirm to start the bulk operation.
Your CSV file should contain a column with URLs. Make sure the URLs are formatted correctly and accessible to your robot. There is a sample CSV you can download from this screen if you're unsure of the format.
Automating tasks in Browse AI
Using scheduled monitors
Set your robot to run automatically on a regular schedule:
Navigate to your robot's detail page.
Select the Monitor tab.
Click Create a Monitor.
Set your preferred schedule (hourly, daily, weekly, etc.).
Configure any additional settings like notifications.
Save your monitor.
Scheduled runs are perfect for ongoing data monitoring, price tracking, or any situation where you need regular updates without manual intervention.
Running through Workflows
Connect multiple robots together with Browse AI's Workflow feature:
Create a primary robot (Robot A) to extract initial data.
Create a secondary robot (Robot B) to trigger based on inputs from Robot A.
Set up a workflow that automatically triggers Robot B after Robot A completes.
This approach is ideal for deep scraping scenarios where you need to extract data across multiple linked pages.
Automating tasks using an Integration
Using automation platforms
Connect Browse AI with popular automation platforms:
Zapier: create Zaps that trigger robot runs based on events in other apps.
Make.com: build scenarios that include Browse AI robot runs.
Pabbly Connect: create automated workflows that trigger robot runs.
These integrations allow you to incorporate web data extraction into your broader business processes and systems. Read our integration guide to learn more.
Using the REST API
For developers and technical users, Browse AI offers a comprehensive REST API that provides programmatic control over robots, tasks, monitors, webhooks, and bulk runs:
Authentication: all API requests require your secret API key for authentication.
Running robots: use the API to run robots with custom parameters.
Managing robots: retrieve, update, and manage your robots.
Bulk operations: run up to 50,000 tasks at once with different parameters.
Scheduling monitors: create and manage automated monitoring schedules.
Real-time updates: configure webhooks to receive notifications when tasks complete.
The API gives you complete control over your data extraction processes and integrates seamlessly with your existing systems and workflows.
