How to extract unlimited items from a list
When extracting data from websites using our Capture List feature, you might not always know how many items are in the list beforehand.
Here's how to make sure you get everything:
When configuring your robot in Robot Studio, set the data limit to a number higher than you expect (such as 1,000 or 2,000)
Your robot will continue extracting until it reaches either the limit or the end of the list
Browse AI automatically refunds unused credits if your limit was higher than the actual number of items
Managing your credits efficiently
The system initially reserves the full amount of credits based on your set limit, but don't worry - any unused credits are automatically returned to your account after the run completes.
Pro tip: If you're unsure about list size, start with a small test run before scaling up. This helps you estimate the actual number for future runs.
When to use this approach
This technique works best for:
E-commerce category pages with varying product counts
Search results with unknown numbers of listings
Business directories with multiple pages of listings
Any scenario where the total count might change between runs