'From a list' is best for extracting repeating information like product listings or search results. By training your robot to scrape or extract the data from a list, it will automatically structure the data into a table as well as trigger pagination options.
Note that when training a robot to extract data from a web page you can train a single robot to extract data "From a list", "Just text", as well as take a screenshot.
Common examples include:
Product category pages with multiple items in a grid
Search results pages showing multiple listings
Directory pages listing multiple businesses
Scraping data 'From a list' is great for extracting and structuring listed data from a page including:
Product names
Prices
Image URLs
Star ratings
Short descriptions
Product URLs
Step 1: Start training your robot
To start training your robot, all you'll need is the URL you'd like to scrape or monitor.
From your Browse AI dashboard, click "Build New Robot".
Select either:
Extract structure data - if you'd like to scrape data from a web page
Monitor site changes - if you want to create a web monitor.
Enter the Origin URL you would like to scrape or monitor.
Click Start Training Robot.
Select Use Robot Studio and wait for your web page to load.
Step 2: How to scrape data from a page 'From a list'
Click on Capture Text, and select From a list.
Hover over the list of items on the page until you see a dotted outline around the elements you want to capture.
Click to select the list when the outline matches your desired data set.
Robot studio will automatically structure that data into a recommended dataset (you can customize this if needed, see below).
Give your list a descriptive name.
Select the number of items you'd like the robot to capture.
Configure the pagination settings to capture additional list items. These include:
Clicking through 'next' buttons.
Click "load more items"
Infinite scroll (i.e. scroll up or down to load additional items)
No more items to load.
Click 'Save Captured List'.
Click 'Finish' to finish recording your robot if you've captured all of the data you need, or keep capturing text or screenshots.
Name your robot to run it, review the data and approve it.
[arcade id="PiYeOnjDEaRTDTGGEzid" title="How to extract data 'as a list'" padding-bottom="0"]
How to customize what and how the robot structures the list data
If you're not happy with how the robot automatically structured the list data - you can customize it.
From the extracted list, click 'Select Manually Instead'.
Click 'Cancel Edits'.
Hover over each item you'd like to extract, and click to select them.
When finished, click Confirm.
Label each data point (press Enter after each one to move to the next).
Give your list a descriptive name.
Select the number of items you'd like the robot to capture.
Configure the pagination settings to capture additional list items. These include:
Clicking through 'next' buttons.
Click "load more items"
Infinite scroll (i.e. scroll up or down to load additional items)
No more items to load.
Click 'Save Captured List'.
Click 'Finish' to finish recording your robot if you've captured all of the data you need, or keep capturing text or screenshots.
Name your robot to run it, review the data and approve it.
[arcade id="xSu63FmvvmdiXmjKuzgO" title="Extracting data 'From a list' - customizing the list output" padding-bottom="0%"]