Skip to main content

How to filter your data

Filters help you quickly find exactly what you need, whether that's tracking down failed extractions, or segmenting data based on extracted data or input parameters.

M
Written by Melissa Shires
Updated yesterday

You can filter your Table data in two ways:

  1. Quick filtering to drill down on a specific extraction.

  2. Adding a custom filter.

πŸ’‘ Applied filters are automatically applied to extracted data.

Drill down on a single extraction

When your robot has multiple extractions, you can quickly filter to see data from just one specific run:

  1. In your Main tab, hover over a row in your Table.

  2. Look for the eye icon that appears in the list column.

  3. Click the eye icon to filter the list tab to show only data from that specific task.

πŸ’‘ This creates a Task ID filter that you can clear later by clicking the X on the filter badge.

Adding a custom filter

Click Add Filter above your Table to access all filtering options.

βœ… Filter options will depend on the data you've extracted.

Filter by Origin URL

Filter by the specific Origin URL. This is useful when:

  • Analyze performance on particular sites.

  • Compare data across different sources.

  • Troubleshoot issues with specific URLs.

Filter by Extract Date

Find data from specific time periods:

  • View yesterday's extractions

  • Analyze weekly trends

  • Find historical data from specific dates

πŸ’‘ If you just want to see the latest data extracted, uncheck Show Historical Data at the top right.

Filter by Status

Quickly identify successes and failures:

  • Successful - data is ready to be exported.

  • Failed - troubleshoot issues and re-run extractions.

πŸ’‘ Filter by "Failed" status and click to re-run or use bulk actions to re-run all failed extractions at once.

Filter by Created by

Track how extractions were initiated:

  • User - manually triggered runs

  • Monitor - scheduled automatic extractions

  • API - webhook or integration triggers

  • System - optimization tasks (no credit usage)


[List Name] Limit filter

If your robot extracts lists (like products, properties, or articles), you can filter by how many items you chose to extract:

  • Filter to see only your comprehensive data sets (higher limits).

  • Focus on smaller, more targeted extractions.

  • Compare different sampling sizes.

βœ… This filter only appears if your robot extracts data from a list.

Bulk Run name filter

Filtering by Bulk Run you can:

  • Isolate specific bulk operations.

  • Track progress of large extraction jobs.

βœ… This filter only appears if you've executed bulk run(s).

Input parameter filtering

When your robot uses input parameters (like search terms), they appear as filterable columns:

  • Filter by specific search keywords

  • Isolate results from particular form inputs

  • Compare different parameter combinations

Example: In an Amazon search robot, filter by Search Keyword = "laptop" to see only laptop search results.

Combining multiple filters

Apply multiple filters for custom views. Common combinations include:

  • Status = "Failed" + Extract Date = "Today" β†’ Today's issues to fix

  • Origin URL = "example.com" + Created by = "Monitor" β†’ Automated monitoring results for a specific site

  • Status = "Successful" + Show Historical Data unchecked β†’ Latest clean data for export

Managing your filters

Active filters

  • All active filters appear as badges above your Table

  • Each badge shows the filter type and value

  • Click the X on any badge to remove that filter

Clear all filters

  • Click Clear all filters to reset your view

  • Returns you to seeing all available data

Working with historical data

The Show Historical Data toggle works alongside filters to control your view.

Understanding historical data

  • β˜‘ Show Historical Data - Displays ALL extractions, including multiple runs with identical parameters

  • ☐ Show Historical Data - Shows only the LATEST extraction for each unique parameter combination

When to hide historical data

Perfect for:

  • Preparing clean exports with only current data

  • Monitoring dashboards showing latest status

  • Reducing clutter when you run the same extraction daily

Example: If you monitor prices daily, unchecking this shows only today's prices instead of the entire price history.

Combining with filters

Historical data toggle + filters = powerful data control:

  • Hide historical + Status filter = Latest successful data only

  • Hide historical + Date filter = Most recent data within a date range

  • Show historical + Origin URL filter = Complete history for specific pages

How filters affect your exports

πŸ’‘ Whatever you see in your filtered Table is exactly what exports.

  • Applied filters carry through to all export formats (CSV, JSON, AWS)

  • Hidden columns also exclude from exports

  • Historical data toggle affects what's included

Export examples

Scenario 1: Export only successful extractions

  1. Filter by Status = "Successful"

  2. Click Export

  3. Result: CSV contains only successful runs

Scenario 2: Export latest data without duplicates

  1. Uncheck "Show Historical Data"

  2. Add any additional filters

  3. Click Export

  4. Result: Only the most recent unique data

Scenario 3: Export this week's monitoring results

  1. Filter by Created by = "Monitor"

  2. Filter by Extract Date = this week

  3. Click Export

  4. Result: Only automated extractions from this week

Did this answer your question?