Skip to main content

Extracting data that appears on click

How to extract dynamic data from a web page that appears after a 'click' interaction.

M
Written by Melissa Shires
Updated this week

Many websites hide content behind clickable elements to keep pages clean and load faster. Browse AI can extract this hidden content by recording your clicks and learning to reveal the data during extraction.

Types of click-to-reveal content

  • Expand/collapse sections: "Read more" links that reveal full text.

  • Hidden details: Product specifications that appear when clicked.

  • Dynamic panels: Content that switches in the same space when different options are clicked.

  • Tooltips and info boxes: Information that appears near the clicked element.

  • Hidden form fields: Additional inputs that appear based on previous selections.

  • Load on demand: Content that only loads from the server when requested.

Basic click-to-reveal extraction

Training your robot to click and extract

Train your robot to click and capture the dynamic content. The robot learns to click before extracting.

  1. Start training your robot in Robot Studio

  2. Click the element that reveals hidden content (button, link, icon)

  3. Wait for content to appear (the robot records this pause)

  4. Use Capture Text or Capture List on the revealed content

Example: "Read more" expansion

Scenario: Product descriptions with "Read more" links

  1. Navigate to the product page

  2. Find the truncated description with "Read more" link

  3. Click "Read more"

  4. Wait for full text to expand

  5. Click Capture Text and select the full description

  6. Label it appropriately

  7. The robot will always click "Read more" before extracting

Multiple click-to-reveal sections

Sequential clicking

When a page has multiple expandable sections:

  1. Click to expand the first section

  2. Capture the revealed content

  3. Click to expand the second section

  4. Capture that content

  5. Continue for all sections

  6. The robot will click each in sequence

Example: FAQ pages with collapsible answers

  1. Click the first question to reveal its answer

  2. Capture the answer text

  3. Click the second question

  4. Capture its answer

  5. Repeat for all FAQs you need

  6. Label each clearly (e.g., "FAQ_1_Answer", "FAQ_2_Answer")

Note: If sections auto-collapse when opening another, that's fine - the robot will handle them one at a time.

Dynamic content panels

Content that replaces other content

Some sites show different content in the same space based on clicks:

  1. Click the first option (e.g., "Description" tab)

  2. Capture the content

  3. Click the second option (e.g., "Specifications" tab)

  4. Capture that content

  5. Repeat until all content is captured.

Example: Product information tabs

  1. Click "Overview" tab β†’ Capture overview text

  2. Click "Features" tab β†’ Capture features list

  3. Click "Reviews" tab β†’ Capture review data

  4. Each click replaces previous content

  5. Robot learns to click each tab and extract

Show/hide toggles

Binary toggles

For simple show/hide switches:

  1. Click the toggle or switch to "show" position

  2. Capture the revealed content

  3. If needed, click again to hide

  4. Robot learns the toggle state needed

Example: "Show technical details" toggle

  1. Find the "Show technical details" toggle or checkbox

  2. Click to enable it

  3. Technical specifications appear below

  4. Capture the specifications

  5. Robot will always enable before extracting

Extracting from multiple click combinations

Dependent clicking

When one click reveals options for another:

  1. Click the first element to reveal options

  2. Click a revealed option to show more content

  3. Capture the final revealed content

  4. Robot learns the complete click sequence

Example: Size charts

  1. Click "Size Guide" link

  2. Size chart panel appears

  3. Click "International Sizes" within the panel

  4. Conversion table appears

  5. Capture the conversion data

  6. Robot performs both clicks in sequence

Advanced tips

Efficiently handling many expandables

For pages with dozens of expandable sections:

  • Identify if there's a "Expand All" option first

  • If not, consider if you really need all sections

  • Train with most important sections

  • Use monitoring to detect changes

When clicking changes the URL

Some clicks navigate to new pages which is training your robot to navigate. While in come cases this might work, you should likely consider:

Did this answer your question?