Skip to main content

How to filter your data

Filters help you quickly find exactly what you need, whether that's tracking down failed extractions, or segmenting data based on extracted data or input parameters.

M
Written by Melissa Shires

You can filter your Table data in two ways:

  1. Quick filtering to drill down on a specific extraction.

  2. Adding a custom filter.

💡 Applied filters are automatically applied to extracted data.

Drill down on a single extraction

When your robot has multiple extractions, you can quickly filter to see data from just one specific run:

  1. In your Main tab, hover over a row in your Table.

  2. Look for the arrow that appears on the list count in that row, for example 10 Products.

  3. Click it. The list tab opens with a Task ID filter, showing only the data from that run, and Show historical data is turned on.

💡 This creates a Task ID filter. Clear it by clicking the X next to 1 Filter applied.

Adding a custom filter

Click Add filter above your Table, pick a field and a value, then click Apply.

✅ Filter options will depend on the data you've extracted.

Filter by Origin URL

Filter by the specific Origin URL. Enter the full URL exactly as it appears in the Origin URL column. This is useful when:

  • Analyze performance on particular sites.

  • Compare data across different sources.

  • Troubleshoot issues with specific URLs.

Filter by Extract Date

Pick a start and end date to find data from a specific time period:

  • View yesterday's extractions

  • Analyze weekly trends

  • Find historical data from specific dates

💡 By default, your Table shows only the latest data extracted. Click Show historical data next to Add filter to see earlier runs too.

Filter by Status

Quickly identify successes and failures:

  • Successful - data is ready to be exported.

  • Failed - troubleshoot issues and re-run extractions.

💡 Filter by "Failed" status and click to re-run or use bulk actions to re-run all failed extractions at once.

Filter by Created by

Track how extractions were initiated:

  • User - manually triggered runs

  • Monitor - scheduled automatic extractions

  • API - webhook or integration triggers

  • System - optimization tasks (no credit usage)

[List Name] Limit filter

If your robot extracts lists (like products, properties, or articles), you can filter by how many items you chose to extract:

  • Filter to see only your comprehensive data sets (higher limits).

  • Focus on smaller, more targeted extractions.

  • Compare different sampling sizes.

✅ This filter only appears if your robot extracts data from a list.

Bulk Run name filter

Filtering by Bulk Run you can:

  • Isolate specific bulk operations.

  • Track progress of large extraction jobs.

✅ This filter only appears if you've executed bulk run(s).

Input parameter filtering

When your robot uses input parameters (like search terms), they appear as filterable columns:

  • Filter by specific search keywords

  • Isolate results from particular form inputs

  • Compare different parameter combinations

Example: In an Amazon search robot, filter by Search Keyword = "laptop" to see only laptop search results.

Combining multiple filters

Apply multiple filters for custom views. Common combinations include:

  • Status = "Failed" + Extract date from today to today → Today's issues to fix

  • Origin URL = the page's full URL + Created by = "Monitor" → Automated monitoring results for a specific page

  • Status = "Successful" + Show Historical Data unchecked → Latest clean data for export

Managing your filters

Active filters

  • Active filters are counted above your Table, for example 2 Filters applied

  • Click it to see each filter, change it, or remove one with the trash icon

Clear all filters

  • Click the X next to Filters applied to clear them all

  • Returns you to seeing all available data

Working with historical data

The Show Historical Data toggle works alongside filters to control your view.

Understanding historical data

  • Show historical data on (it shows an X) - Displays ALL extractions, including multiple runs with identical input parameters, such as the same Origin URL and list limit

  • Show historical data off (the default) - Shows only the LATEST extraction for each unique parameter combination

When to hide historical data

Perfect for:

  • Preparing clean exports with only current data

  • Monitoring dashboards showing latest status

  • Reducing clutter when you run the same extraction daily

Example: If you monitor prices daily, unchecking this shows only today's prices instead of the entire price history.

Combining with filters

Historical data toggle + filters = powerful data control:

  • Hide historical + Status filter = Latest successful data only

  • Hide historical + Date filter = Most recent data within a date range

  • Show historical + Origin URL filter = Complete history for specific pages

How filters affect your exports

💡 Whatever you see in your filtered Table is exactly what exports.

  • Applied filters carry through to every export: Download CSV, Download JSON, and export to Amazon S3

  • Hidden columns also exclude from exports

  • Historical data toggle affects what's included

Export examples

Scenario 1: Export only successful extractions

  1. Filter by Status = "Successful"

  2. Click Export

  3. Result: CSV contains only successful runs

Scenario 2: Export latest data without duplicates

  1. Make sure Show historical data is off (the default)

  2. Add any additional filters

  3. Click Export

  4. Result: Only the most recent unique data

Scenario 3: Export this week's monitoring results

  1. Filter by Created by = "Monitor"

  2. Filter by Extract Date = this week

  3. Click Export

  4. Result: Only automated extractions from this week

Related Articles
Did this answer your question?