Custom search bulk run

This guide combines two of Browse AI's powerful features: Bulk Run, and the ability to add custom input parameters to your robots. Together, they unlock a new level of efficiency for large-scale data extraction, and this powerful functionality allows you to run a single robot across a massive list of URLs and search terms, automating data extraction at scale and saving you countless hours of manual work.

When you train a custom robot, any text inputs you interact with can be set as input parameters, which you can later adjust for different tasks without the need to create new robots. And you can upload a list of addresses to your robot via a CSV file to look it up on the target website/Origin URL. Here's how:

Phase 1: Building Your Robot

The first step is to create a custom robot for your chosen Origin URL and manually demonstrate the search you want it to perform, and then proceed to capture your desired data:

1. Go to your dashboard > click on Build New Robot.
2. Enter the URL of the webpage from which you want to extract data.
3. Click on Start Training Robot.
4. Start training your robot by performing the necessary actions on the webpage, such as searching, clicking, typing, etc.,
5. Click on the robot and choose between capturing a list or capturing text on the page. (See: Capture List vs. Capture Text)
6. Once you have captured all the necessary data, click on the robot and select Finish recording.
7. Name your robot and click Save.

After the robot has been built, you should have another parameter apart from your Origin URL and data limit, like so:

Phase 2: Modifying your CSV file

After building your robot with input search parameters, do a bulk run with the sample CSV you'll get from your newly trained robot:

1. Click on the "Run Task" tab and hit the "Bulk run tasks" button, located on the lower-right bit.

2. Download the Sample CSV file to help you fine-tune the links and your search keywords:

   

3. In the CSV file, add a column for your search terms or parameters. Each row should represent a different search you want to perform.
4. Ensure your CSV file is correctly formatted with a header row and one search term per row.

Phase 3: Run the Bulk Task

1. Go to the "Run Task" tab of your robot's dashboard and click the "Bulk Run Tasks" button.
2. Upload the same CSV file you modified.

3. Select the column header that corresponds to your search input parameter. Here's an example:

   

5. Optionally, choose an integration to send the extracted data to another tool (e.g., Google Sheets, etc.).

   Click on "Run <x amount> Tasks" on the lower-right bit to begin the process. Here's a sample:

   

   1. X amount denotes the numbers of rows of data you are to extract.
   2. Make sure you have enough credits for it. To compute how much you may need, check this guide out:
      • How are credits calculated?
      • If there's not enough credits, you can run the task with lesser data limit.

Browse AI will then automatically run your robot on each search term in your CSV file, extracting the data and compiling it into a single output. You can also preview the data or result holistically on Tables. (See: How to Use the Tables Feature)

We're here to help you succeed with Browse AI! If you have any questions or need guidance, feel free to reach out to our support team.

🤖💪