Browse AI

Melissa Shires

Train robots to scrape or monitor data from any website.

Robots

Robots scrape, extract, and monitor website data with no coding required.

What are robots and what can they do?

Choose between creating your own robot, using prebuilt robots, or using our managed services.

Type of robots: custom, prebuilt and managed

Get started with scraping data in minutes using Robot Studio's point and click interface.

Building your first robot

Getting started

Train a robot to scrape or monitor web data from any website.

How to train a robot to scrape or monitor data

Learn how to extract data 'From a list'. This is typically used to scrape data that repeats on a page in a pattern, ex: a list of search results.

How to extract data 'From a list'

Capture 'Just text' to scrape, extract or monitor specific text or elements from a page.

How to extract and structure specific data from a page using 'Just text'

You can train a robot to scrape or monitor screenshots (full or partial) on any web page.

How to train your robot to capture screenshots

After approving your robot, you can set up monitoring, use it in workflows for deep scraping, or run it on up to 500,000 pages

How to approve a robot

Learn when to use "From a list" for repeating data on pages versus "Just text" to extract and structure specific datapoints.

Decision guide: "From a list" vs. "Just text"

The starting URL for robot training and a parameter for scaling robots across multiple similar pages after they're created.

What is the 'Origin URL'?

Browse AI robots can handle pagination by clicking "next" buttons, "load more" buttons, or scrolling to automatically collect data from multiple pages or infinite scroll listings.

How do I handle pagination and scrolling?

Train robots faster with AI-recommended datasets that automatically detect and label data points in lists, saving you valuable setup time.

How do recommended datasets work in Robot Studio?

Learn about how to train a robot to extract, scrape, and monitor data.

Basic building and configuration

Connect multiple Browse AI robots through linked workflows to extract data from multi-level data sources.

How to chain more than two robots together

Extract data from up to 500,000 URLs simultaneously by uploading a CSV file through Browse AI's bulk run feature.

How to use bulk runs to extract data from multiple URLs

Use Bulk Run to process multiple URLs simultaneously, saving time when extracting data from numerous pages across websites.

Bulk Run: How to execute bulk tasks

Perform deep scraping by using the Workflows feature.

How can I create a workflow connecting two robots?

Deep scraping uses workflows to connect multiple robots: one to gather lists of items, another to get details from subpage(s).

How can I extract data from lists and their associated details pages? (deep scraping)

Learn how to scrape data across multiple pages.

Extracting data from multiple pages

Input parameters let you adjust your robot's behavior without creating new robots. You can modify URLs, search terms, and form fields to make your robots more versatile.

How to use Input Parameters

Yes, set your robot's data limit higher than expected to capture all items, and Browse AI will return unused credits after completion.

Can I extract all items from a list without knowing the count?

Yes, robots can fill forms and perform actions like clicking buttons, entering text, and navigating pages before extracting any data.

Can my robot fill out a form or perform an action before extracting data?

Your robot can log into websites to extract data using either session cookies or credentials for direct login.

How to scrape and monitor data behind a login

We provide specialized solutions to address challenges, ensuring your robots extract data even when faced with security verification systems

How Browse AI handles CAPTCHA challenges

While Browse AI doesn't directly support iFrames, you can extract data by finding and using the iFrame's source URL in most cases.

How to extract data from iFrames

Advanced capabilities

Transfer robots between workspaces quickly to improve team collaboration and resource sharing with just a few simple steps.

How to transfer robots between workspaces

Download your robot's scraped data directly from the History tab in CSV or JSON format, with options to include or exclude previous changes.

How to download the results of a Robot's task (non-Tables method)

Click on your image and use the slider to compare versions. Use the Highlight Changes toggle to make it more clear.

How to see what changed in a captured screenshot

Delete a robot from your account permanently by accessing the Settings tab and scrolling to the Danger Zone section.

How to delete a robot

Run your robots manually with single or Bulk Tasks, or automate with monitors, workflows, integration platforms, and our REST API.

How to run your robot

Tasks are the core way your robots extract data.

How to set up and run tasks

Easily update your robot by retraining it through the Settings tab - modify data points and list names without starting from scratch.

How to retrain (or 'edit') a robot

Once they're built, learn how to manage your robots.

Managing robots

When your robot stops working, try retraining it or updating cookies - our platform adapts to most website changes but occasional maintenance is needed.

What to do if your robot suddenly stops working

Cookie notices can disrupt your robots - learn to work around them without complex setup.

How to fix robot failures caused by cookie pop-ups

Troubleshooting

Home

About

Terms

Privacy

Company

Videos

Webinars

Pricing

Find answers and get help from Intercom Support and Community Experts

This site employs cookies and other technologies that we and our third party vendors use to monitor and record personal information about you and your interactions with the site (including content viewed, cursor movements, screen recordings, and chat contents) for the purposes described in our Cookie Policy. By continuing to visit our site, you agree to our {websiteTermsLink}, {privacyPolicyLink} and {cookiePolicyLink}.

This site uses cookies and similar technologies ("cookies") as strictly necessary for site operation. We and our partners also would like to set additional cookies to enable site performance analytics, functionality, advertising and social media features. See our {cookiePolicyLink} for details. You can change your cookie preferences in our Cookie Settings.

We use cookies to make our site work and also for analytics and advertising purposes. You can enable or disable optional cookies as desired. See our {cookiePolicyLink} for more details.

Advertising cookies are set by our advertising partners to collect information about your use of the site, our communications, and other online services over time and with different browsers and devices. They use this information to show you ads online that they think will interest you and measure the ads' performance. Social media cookies are set by social media platforms to enable you to share content on those platforms, and are capable of tracking information about your activity across other online services for use as described in their privacy policies.

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

These cookies are necessary for the website to function and cannot be switched off in our systems.

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

You have the right to opt out of the sale of your personal information. See our {cookiePolicyLink} for more details about how we use your data.

Your Privacy Choices

We use cookies to enhance your experience. You can customize your cookie preferences below. See our {cookiePolicyLink} for more details.

Cookie Settings

Link, Press control-option-right-arrow to exit

Empty Help Center

Uh oh. That page doesn’t exist.

Disappointed

Neutral

Smiley

Thinking...

Searching through sources...

Analyzing...

Tickets submitted through the messenger or by a support agent in your conversation will appear here.