DEV Community

Cover image for How to Extract a Web Table with Infinite Scrolling Using UiPath?
Jhanvi
Jhanvi

Posted on • Originally published at dev.to

How to Extract a Web Table with Infinite Scrolling Using UiPath?

Hi everyone!

Welcome back to Quick Automation Talk, Today, we are looking at something many of you struggle with when scraping websites. How do you extract a web table that keeps loading new rows only when you scroll?

If you tried scraping it the normal way, you already know that UiPath grabs only the visible part. The rest stays hidden behind the infinite scroll. The good news is that you can still extract the full table if you follow the right setup. Here is a clear and practical way to do it so you can collect complete data without missing any row.

Process of Extracting a Web Table with Infinite Scrolling Using UiPath

Before you jump into UiPath Studio, it helps to know what flow you are about to follow. Once you understand this flow, the steps below become very easy to follow.

Step 1: Understand How the Page Loads More Rows

Before you open UiPath Studio, visit the website and check how the page behaves. Scroll down slowly and watch how new rows appear. If more rows load after a small scroll, it means the page uses infinite scrolling. UiPath will not capture those rows unless you scroll through the entire table during automation.

Step 2: Use the Data Scraping Wizard for the Basic Pattern

Open UiPath Studio and start with the Data Scraping Wizard. Select two rows from the table so UiPath can understand the structure. The wizard collects the visible data first. Once the preview looks correct, save the activity. This gives you the extraction pattern that UiPath will follow on the full page.

Step 3: Add a Loop and Scroll Action

To capture new rows, you need UiPath to scroll the page again and again. You can do this with a simple loop.
A common approach is:

  • Use a While loop
  • Add a Send Hotkey activity inside the loop
  • Use Page Down or End key to move the scroll
  • Each time the page scrolls, new rows load and UiPath can scrape more data.

Keep the scroll smooth so the website has enough time to load the next set of rows.

Step 4: Detect When the Table Reaches the End

Your loop should stop only when there are no more new rows. To do this, you can check the row count after each extraction. If the row count does not increase after a scroll, it means you reached the bottom. This small check prevents endless scrolling and saves time.

Step 5: Combine All Extracted Data

Each scroll round generates fresh data. Merge all these results into a single DataTable. UiPath lets you use Merge Data Table to combine the results. When the merge finishes, you get the complete dataset from the start of the table to the end of the table.

Step 6: Export the Data

Once your DataTable is ready, save it as Excel, CSV, or any other format your project needs. This is a simple step with Write Range. Your file will now have all the rows that were hidden behind the infinite scroll.

Helpful Tips to Make the Extraction Smooth

  • Add a short delay after each scroll so the website can load new rows
  • Scroll small steps instead of jumping directly to the bottom
  • Make sure the selector for the table is stable and does not break when new rows load
  • Test your workflow with fewer scrolls first to avoid long run times

Final Thoughts

You can extract a web table with infinite scrolling in UiPath if you guide the robot through the full length of the page. All you need is a simple pattern. First, scrape what is visible, then scroll in a loop, merge all the data, and export it.

you can always choose to hire UiPath developers who can build this workflow quickly and make it reliable for large datasets. With the right approach, you get smooth automation and complete data every time.

Top comments (0)