The latest articles on DEV Community by Subhan Ali (@subhan_ali_98aee435d4dfe3). https://dev.to/subhan_ali_98aee435d4dfe3 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3172862%2Fce248f11-3a29-4177-bfd8-ae4e9b5ac431.png https://dev.to/subhan_ali_98aee435d4dfe3 en Subhan Ali Sat, 17 May 2025 07:47:54 +0000 https://dev.to/subhan_ali_98aee435d4dfe3/scraping-youtube-channel-data-using-python-no-api-needed-1g0j https://dev.to/subhan_ali_98aee435d4dfe3/scraping-youtube-channel-data-using-python-no-api-needed-1g0j <p>Recently, I built a Python-based scraper that collects public video data from YouTube channels — without using the official API. This was a fun and insightful project where I explored how YouTube structures its data and how to extract information efficiently.</p> <h2> 🔧 What It Does </h2> <p>The script can extract the following:</p> <ul> <li>Video Titles </li> <li>View Counts </li> <li>Publish Dates </li> <li>Video URLs </li> <li>Thumbnails </li> </ul> <p>It works directly from channel pages by sending requests and parsing the HTML with <code>BeautifulSoup</code>.</p> <h2> 🎥 Demo Video </h2> <p>I recorded a short demo of the scraper in action:<br><br> 👉 <a href="https://youtu.be/u4PV3uRqpR0?si=yU71RPgLIsonKr3L" rel="noopener noreferrer">Watch on YouTube</a></p> <h2> 💻 Source Code on GitHub </h2> <p>The complete Python code is open-source and available here:<br><br> 👉 <a href="https://github.com/subhanalii/youtube-scraper" rel="noopener noreferrer">View GitHub Repository</a></p> <h2> 🔍 Libraries Used </h2> <ul> <li> <code>requests</code> </li> <li> <code>BeautifulSoup</code> (from <code>bs4</code>) </li> <li> <code>re</code> for regex </li> <li> <code>json</code> for parsing dynamic data blocks</li> </ul> <h2> 📌 Why No API? </h2> <p>YouTube's official Data API has:</p> <ul> <li>Quota limitations</li> <li>Requires API key setup</li> <li>More overhead for small-scale scrapers</li> </ul> <p>So I challenged myself to build a solution that works purely via scraping — lightweight and fast.</p> <h2> 💡 Next Steps </h2> <p>I’m considering adding:</p> <ul> <li>CLI flags for custom inputs </li> <li>CSV/JSON export support </li> <li>Playlist/channel crawler </li> <li>Error handling &amp; logging</li> </ul> <p>Would love feedback and suggestions from the community!</p> <h2> 🤝 Let’s Connect </h2> <p>If you've worked on similar projects or want to collaborate, feel free to reach out. Also open to contributors or testers!</p>