Skip to main content

How to reuse your robot for similar web pages

One robot can extract data from multiple pages with the same structure - just change the URL to save time and streamline your workflow.

M
Written by Melissa Shires

Why reuse robots?

When websites maintain consistent layouts across different sections (like product categories, blog archives, or directory listings), you can use a single robot to extract data from all of them. This saves you time and eliminates the need to build and maintain multiple robots for the same website.

QUICK TIP: Browse AI robots are designed to be flexible. When dealing with a website with consistent structures across different categories or sections (e.g., product pages, blog posts, directory listings), you can often use a single robot to extract data from all of them. This saves you time and effort, streamlining your data extraction process.

Three ways to reuse your robot

Method 1: Change the origin URL for a single run

Best for: quick, one-time extraction from a different page with the same structure.

  1. Open your robot and go to the Run Task tab

  2. In the Origin URL field, paste the new category or section URL

  3. Choose whether to keep or update the default URL:

    1. Don't click Save as default for a one-time change

    2. Click Save as default (it appears in the field once you change the URL) to permanently update the robot's origin URL

  4. Click Run a Task. The task opens in the History tab

Method 2: Use a bulk run for multiple pages

Best for: extracting data from multiple pages with the same structure in one bulk run.

  1. Open your robot and go to the Run Task tab

  2. Click the Bulk Run Tasks button

  3. Click Download Sample CSV Input to get the sample CSV file (this file provides a template for how to structure your input data, including URLs and any other variables)

  4. Add the URLs of all sections you want to scrape to the CSV file

  5. Upload your modified CSV

  6. Check that your URL column is mapped under Origin URL. It maps automatically when the CSV header matches; if not, pick the column from the dropdown

  7. Results appear in the robot's Tables tab. To send them to another app, set up an integration in the Integrate tab

  8. Click Run N Tasks (N is the number of rows), then Yes, I'm sure to confirm the credits

Method 3: Create monitors with different origin URLs

Best for: ongoing extraction and monitoring of specific categories or sections of a specific page on a schedule.

  1. Open your robot's Monitor tab and click Create New Monitor for each section or category you want to track

  2. Give the monitor a name and enter the page's Origin URL

  3. Configure your desired monitoring frequency

  4. Click Save

Did this answer your question?