Since the similarweb response the request of these code without the ranking list, the list of similarweb will not appear. I've check the resp.text:
<html>
<head>
<title>Pardon Our Interruption</title>
....
<div class="Title">Pardon Our Interruption...</div>
<div class="Paragraph">As you were browsing similarweb.com something about your browser made us think you were a bot. There are a few reasons this might happen:</div>
<ul class="ListContainer">
<li class="ListItem">You're a power user moving through this website with super-human speed.</li>
<li class="ListItem">You've disabled JavaScript in your web browser.</li>
</ul>
And I have no idea to solve this interruption. Any idea?
Since the similarweb response the request of these code without the ranking list, the list of similarweb will not appear. I've check the resp.text:
And I have no idea to solve this interruption. Any idea?
Someone provide a method that add a header with
"authority": "similarweb.com"
and help to get result from similarweb.com. (already update the code repl.it/@timhuangt/GlobalTopSite )