<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Mike Alex</title>
    <description>The latest articles on DEV Community by Mike Alex (@its_mike_alex).</description>
    <link>https://dev.to/its_mike_alex</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4168742%2F1bed5dc5-ca69-436d-90e9-3c034a27cb02.jpg</url>
      <title>DEV Community: Mike Alex</title>
      <link>https://dev.to/its_mike_alex</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/its_mike_alex"/>
    <language>en</language>
    <item>
      <title>Is GitHub Trending Just AI Agents Now? 🤖</title>
      <dc:creator>Mike Alex</dc:creator>
      <pubDate>Wed, 28 Oct 2026 10:47:36 +0000</pubDate>
      <link>https://dev.to/its_mike_alex/is-github-trending-just-ai-agents-now-2i8a</link>
      <guid>https://dev.to/its_mike_alex/is-github-trending-just-ai-agents-now-2i8a</guid>
      <description>&lt;p&gt;I opened GitHub Trending this morning, like I do most days.&lt;/p&gt;

&lt;p&gt;And I noticed something.&lt;/p&gt;

&lt;p&gt;Every single repo on the list was about AI.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fgj62m8jwc96ptrqtb35x.gif" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fgj62m8jwc96ptrqtb35x.gif" alt="github trending filofinder" width="800" height="420"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Not most of them. All of them.&lt;/p&gt;

&lt;p&gt;Agent frameworks. Agent skills. Agent workspaces. An AI tutor. Even an IDE built around vibe coding.&lt;/p&gt;

&lt;h2&gt;
  
  
  Here's what was trending today
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Repo&lt;/th&gt;
&lt;th&gt;What it does&lt;/th&gt;
&lt;th&gt;Stars today&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/Nutlope/hallmark" rel="noopener noreferrer"&gt;Nutlope/hallmark&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Anti-AI-slop design skill for coding agents&lt;/td&gt;
&lt;td&gt;2,830&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/HKUDS/DeepTutor" rel="noopener noreferrer"&gt;HKUDS/DeepTutor&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Personalized AI tutoring&lt;/td&gt;
&lt;td&gt;1,598&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/makecindy/cindy" rel="noopener noreferrer"&gt;makecindy/cindy&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Open-source AI agent that works out of the box&lt;/td&gt;
&lt;td&gt;1,465&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/pbakaus/impeccable" rel="noopener noreferrer"&gt;pbakaus/impeccable&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Design vocabulary for your coding agent&lt;/td&gt;
&lt;td&gt;1,449&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/elayadesign/ai-design-skills" rel="noopener noreferrer"&gt;elayadesign/ai-design-skills&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Design skills for AI agents&lt;/td&gt;
&lt;td&gt;1,395&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/JetBrains/thinkrail" rel="noopener noreferrer"&gt;JetBrains/thinkrail&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;A lightweight IDE for vibe coding&lt;/td&gt;
&lt;td&gt;1,204&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/affaan-m/ECC" rel="noopener noreferrer"&gt;affaan-m/ECC&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Performance system for agent harnesses&lt;/td&gt;
&lt;td&gt;1,165&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/nightly-labs/openbot" rel="noopener noreferrer"&gt;nightly-labs/openbot&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Local-first workspace for AI teammates&lt;/td&gt;
&lt;td&gt;777&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://github.com/obra/superpowers" rel="noopener noreferrer"&gt;obra/superpowers&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Agentic skills framework&lt;/td&gt;
&lt;td&gt;617&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;&lt;em&gt;(From GitHub Trending on Oct 28, 2026. These numbers change fast.)&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;11 out of 11 repos were about AI.&lt;/p&gt;

&lt;p&gt;That's not a trend anymore. That's the whole page.&lt;/p&gt;

&lt;h2&gt;
  
  
  The part that made me laugh
&lt;/h2&gt;

&lt;p&gt;Look at the top of that list again.&lt;/p&gt;

&lt;p&gt;The #1 repo today is an &lt;strong&gt;anti-AI-slop&lt;/strong&gt; design skill. Two more in the top five exist to stop coding agents from shipping generic, ugly UIs.&lt;/p&gt;

&lt;p&gt;So we're now building AI tools… to fix what other AI tools build.&lt;/p&gt;

&lt;p&gt;Honestly? I think that's a good sign. It means people are moving past "look, the AI made a website" and starting to care whether it's actually &lt;em&gt;good&lt;/em&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Is an all-AI trending page a bad thing?
&lt;/h2&gt;

&lt;p&gt;I'm not sure.&lt;/p&gt;

&lt;p&gt;On one hand, it's exciting. A huge amount of open-source energy is going into one idea, and things are moving incredibly fast.&lt;/p&gt;

&lt;p&gt;On the other hand, I keep wondering:&lt;/p&gt;

&lt;p&gt;How many of these will still be maintained in six months?&lt;/p&gt;

&lt;p&gt;A lot of repos get thousands of stars in a week. Fewer get issues closed, docs written, and versions released.&lt;/p&gt;

&lt;p&gt;Stars show interest.&lt;br&gt;
Commits show commitment.&lt;/p&gt;

&lt;h2&gt;
  
  
  What I've started doing
&lt;/h2&gt;

&lt;p&gt;Before I star or try a trending repo now, I check three things:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Last commit date.&lt;/strong&gt; Is anyone still working on it?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Open issues vs closed issues.&lt;/strong&gt; Are problems actually getting fixed?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;The README.&lt;/strong&gt; Does it explain what it solves, or just how impressive it is?&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;It takes about 30 seconds. And it has saved me from a lot of abandoned projects.&lt;/p&gt;

&lt;h2&gt;
  
  
  Meanwhile, what's getting missed?
&lt;/h2&gt;

&lt;p&gt;This is the part I'm most curious about.&lt;/p&gt;

&lt;p&gt;When one topic takes over the entire page, great projects in other areas get buried. Databases, dev tools, accessibility, games, plain useful libraries.&lt;/p&gt;

&lt;p&gt;So I'd love to hear from you:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;What's a non-AI repo you found recently that deserves more stars?&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Do you trust GitHub Trending to show what's actually good?&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Have you ever starred something trending and regretted it?&lt;/strong&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Drop your hidden gems in the comments.&lt;/p&gt;

&lt;p&gt;I'll try every single one and share the best ones in a follow-up post 👀&lt;/p&gt;

</description>
      <category>discuss</category>
      <category>github</category>
      <category>ai</category>
      <category>opensource</category>
    </item>
    <item>
      <title>What Should Beginners Learn First in 2026: Fundamentals or AI Tools? 🤔</title>
      <dc:creator>Mike Alex</dc:creator>
      <pubDate>Tue, 27 Oct 2026 07:06:55 +0000</pubDate>
      <link>https://dev.to/its_mike_alex/what-should-beginners-learn-first-in-2026-fundamentals-or-ai-tools-12d8</link>
      <guid>https://dev.to/its_mike_alex/what-should-beginners-learn-first-in-2026-fundamentals-or-ai-tools-12d8</guid>
      <description>&lt;p&gt;A beginner asked me something last week that I haven't stopped thinking about.&lt;/p&gt;

&lt;p&gt;"Should I learn JavaScript properly first, or just start building with AI?"&lt;/p&gt;

&lt;p&gt;I didn't have a clean answer.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fk4rrcopfkefk3a2jhln0.gif" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fk4rrcopfkefk3a2jhln0.gif" alt="thinking" width="500" height="345"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Because both sides make sense.&lt;/p&gt;

&lt;h2&gt;
  
  
  The case for fundamentals first
&lt;/h2&gt;

&lt;p&gt;If you don't understand what the code does, you can't tell when AI gets it wrong.&lt;/p&gt;

&lt;p&gt;And AI gets things wrong in quiet ways. The code runs. The tests pass. But the logic is off, or there's a security hole, or it breaks the moment real users show up.&lt;/p&gt;

&lt;p&gt;Someone has to notice that.&lt;/p&gt;

&lt;p&gt;Fundamentals are what let you notice.&lt;/p&gt;

&lt;h2&gt;
  
  
  The case for AI tools first
&lt;/h2&gt;

&lt;p&gt;On the other hand, motivation matters.&lt;/p&gt;

&lt;p&gt;A lot of beginners quit during the "build a to-do list for the fifth time" phase. They never get to the part where coding feels exciting.&lt;/p&gt;

&lt;p&gt;With AI, a beginner can build something real in a weekend. Something they actually care about.&lt;/p&gt;

&lt;p&gt;And that excitement might be what keeps them learning long enough to &lt;em&gt;get&lt;/em&gt; to the fundamentals.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where I've landed (for now)
&lt;/h2&gt;

&lt;p&gt;I'm a product manager who builds with AI every day. I'm not a classically trained developer.&lt;/p&gt;

&lt;p&gt;Here's my honest experience:&lt;/p&gt;

&lt;p&gt;AI made me fast.&lt;br&gt;
Understanding the basics made me useful.&lt;/p&gt;

&lt;p&gt;The times I got stuck weren't when I couldn't write code. They were when I couldn't read it. When something broke and I didn't know where to look.&lt;/p&gt;

&lt;p&gt;So maybe the question isn't "fundamentals &lt;em&gt;or&lt;/em&gt; AI."&lt;/p&gt;

&lt;p&gt;Maybe it's: &lt;strong&gt;build with AI, but never accept code you can't explain.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Ask the AI why. Break things on purpose. Rewrite small parts by hand.&lt;/p&gt;

&lt;p&gt;Use AI as a teacher, not just a shortcut.&lt;/p&gt;

&lt;h2&gt;
  
  
  But I want to hear from you
&lt;/h2&gt;

&lt;p&gt;This is one of those questions where experience really changes the answer.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;If you're a beginner:&lt;/strong&gt; Are you learning with AI or without it? How's it going?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;If you're experienced:&lt;/strong&gt; If you were starting from zero in 2026, what would you do first?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;If you hire developers:&lt;/strong&gt; Does it matter to you how someone learned?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;I don't think there's one right answer.&lt;/p&gt;

&lt;p&gt;But I'm pretty sure the comments will be better than the post 😄&lt;/p&gt;

</description>
      <category>ai</category>
      <category>career</category>
      <category>discuss</category>
      <category>beginners</category>
    </item>
    <item>
      <title>If AI Can Build an App in an Hour, What Makes a Developer Valuable Now? 🤔</title>
      <dc:creator>Mike Alex</dc:creator>
      <pubDate>Sat, 10 Oct 2026 13:01:07 +0000</pubDate>
      <link>https://dev.to/its_mike_alex/if-ai-can-build-an-app-in-an-hour-what-makes-a-developer-valuable-now-5324</link>
      <guid>https://dev.to/its_mike_alex/if-ai-can-build-an-app-in-an-hour-what-makes-a-developer-valuable-now-5324</guid>
      <description>&lt;p&gt;&lt;strong&gt;If AI Can Build an App in an Hour, What Makes a Developer Valuable Now?&lt;/strong&gt; 🤔&lt;/p&gt;

&lt;p&gt;A thought I've been having lately.&lt;/p&gt;

&lt;p&gt;With AI tools, you can build a website, create an app, or turn an idea into a working prototype in just a few hours.&lt;/p&gt;

&lt;p&gt;Things that once took days can now take much less time.&lt;/p&gt;

&lt;p&gt;So here's something I'm curious about.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fsdzbvnqqucep0ytr1ywo.gif" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fsdzbvnqqucep0ytr1ywo.gif" alt="thinking" width="480" height="270"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;If almost anyone can build an app with AI, what actually makes a developer valuable now?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Is it still how well you write code?&lt;/p&gt;

&lt;p&gt;Or is it something else?&lt;/p&gt;

&lt;p&gt;Maybe it's knowing what to build in the first place. Understanding the problem, making the right technical decisions, debugging when things go wrong, or building something people actually want to use.&lt;/p&gt;

&lt;p&gt;Because getting an app to work is one thing.&lt;/p&gt;

&lt;p&gt;Making it reliable, useful, maintainable, and worth using is another.&lt;/p&gt;

&lt;p&gt;I'm not saying coding skills don't matter anymore. But I do wonder how the definition of a &lt;em&gt;good developer&lt;/em&gt; is changing as AI gets better.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;I'd love to hear your thoughts:&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;What skill makes a developer stand out in the age of AI?&lt;/li&gt;
&lt;li&gt;Would you hire someone who can build quickly with AI but doesn't understand the underlying code?&lt;/li&gt;
&lt;li&gt;What are you focusing on learning to stay valuable as a developer?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;I don't think there's one right answer, and that's what makes this interesting.&lt;/p&gt;

</description>
      <category>discuss</category>
      <category>ai</category>
      <category>webdev</category>
      <category>programming</category>
    </item>
    <item>
      <title>I Tested 16 Job Sources With a Scraping API, here's What Worked!</title>
      <dc:creator>Mike Alex</dc:creator>
      <pubDate>Fri, 09 Oct 2026 12:14:05 +0000</pubDate>
      <link>https://dev.to/spicrawl/i-tested-16-job-sources-with-a-scraping-api-heres-what-worked-4m51</link>
      <guid>https://dev.to/spicrawl/i-tested-16-job-sources-with-a-scraping-api-heres-what-worked-4m51</guid>
      <description>&lt;p&gt;&lt;strong&gt;I Tested 16 Job Sources With a Scraping API. Here's What Worked&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Job hunting can get messy quickly.&lt;/p&gt;

&lt;p&gt;You find a role on LinkedIn, another on a startup's career page, and a few more on remote job boards. Soon, you have dozens of tabs open and no single place to track everything 😅&lt;/p&gt;

&lt;p&gt;I started thinking about building a small tool that collects job listings from different sources and organizes them in one place.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fvm7c3gmic3mx5y4m9zb3.gif" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fvm7c3gmic3mx5y4m9zb3.gif" alt="coding" width="480" height="270"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;As a product manager working with Spicrawl, I wanted to explore how its web scraping API could help.&lt;/p&gt;

&lt;p&gt;In our October 2026 tests, &lt;strong&gt;15 out of 16 job sources returned usable listings.&lt;/strong&gt; Here's what we learned.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Not every website needs a browser
&lt;/h2&gt;

&lt;p&gt;Some job sources provide data through public APIs or RSS feeds. Others rely on JavaScript to display listings.&lt;/p&gt;

&lt;p&gt;Here's a snapshot of our results:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Source&lt;/th&gt;
&lt;th&gt;What worked&lt;/th&gt;
&lt;th&gt;Credits&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Remote OK API&lt;/td&gt;
&lt;td&gt;100 job items&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Remotive API&lt;/td&gt;
&lt;td&gt;Structured job data&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;LinkedIn single posting&lt;/td&gt;
&lt;td&gt;Full job description&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;LinkedIn job search&lt;/td&gt;
&lt;td&gt;Rendered listings&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Y Combinator jobs&lt;/td&gt;
&lt;td&gt;Rendered listings&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Glassdoor jobs&lt;/td&gt;
&lt;td&gt;Rendered listings&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Indeed search&lt;/td&gt;
&lt;td&gt;Listings after scrolling&lt;/td&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;These are results from our tests, not guaranteed results for every request.&lt;/p&gt;

&lt;p&gt;The takeaway? &lt;strong&gt;Start with the simplest request and only add browser rendering when you need it.&lt;/strong&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Collect job listings with Spicrawl
&lt;/h2&gt;

&lt;p&gt;You'll need a Spicrawl API key, which you can get through &lt;a href="https://spicrawl.com/" rel="noopener noreferrer"&gt;Spicrawl&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;For a JavaScript-rendered job page, you can use:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl https://api.spicrawl.com/v1/scrape &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;-H&lt;/span&gt; &lt;span class="s2"&gt;"Authorization: Bearer &lt;/span&gt;&lt;span class="nv"&gt;$SPICRAWL_API_KEY&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;-H&lt;/span&gt; &lt;span class="s2"&gt;"Content-Type: application/json"&lt;/span&gt; &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;-d&lt;/span&gt; &lt;span class="s1"&gt;'{
    "url": "https://www.ycombinator.com/jobs",
    "js_render": true,
    "cache": false
  }'&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This loads the page in a browser so its JavaScript can build the listings.&lt;/p&gt;

&lt;p&gt;In our October tests, this returned around 28 KB of content for three credits.&lt;/p&gt;

&lt;p&gt;For a source that already provides JSON, you can use a plain fetch instead. For example, Remote OK returned 100 items for one credit.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. What about pages that load more jobs while scrolling?
&lt;/h2&gt;

&lt;p&gt;This was one of the more interesting results from our tests.&lt;/p&gt;

&lt;p&gt;Indeed returned only a tiny, 60-byte page when we tried JavaScript rendering alone. The request technically succeeded, but the job listings weren't there.&lt;/p&gt;

&lt;p&gt;We added scrolling actions:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://www.indeed.com/jobs?q=data+engineer&amp;amp;l=Remote"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"js_render"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"wait"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;2000&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"actions"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"scroll"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"to_bottom"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;}},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"scroll"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"to_bottom"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;}}&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The response grew to around 68 KB of listings. This request cost eight credits because browser actions use the full-browser rendering tier.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;A successful HTTP response doesn't always mean you received useful data.&lt;/strong&gt; Check the returned content and target status before saving results.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Turn scraped pages into a job tracker
&lt;/h2&gt;

&lt;p&gt;Once you've collected the page content, you can extract fields such as:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Job title and company&lt;/li&gt;
&lt;li&gt;Location and employment type&lt;/li&gt;
&lt;li&gt;Salary, when available&lt;/li&gt;
&lt;li&gt;Required skills&lt;/li&gt;
&lt;li&gt;Application URL&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Spicrawl's &lt;code&gt;autoparse: true&lt;/code&gt; option can return structured data embedded in a page, including schema.org &lt;code&gt;JobPosting&lt;/code&gt; data when available.&lt;/p&gt;

&lt;p&gt;You can store the results in a database or spreadsheet and build features such as job filters, application tracking, and AI-powered comparisons against your skills.&lt;/p&gt;

&lt;p&gt;Just remember that not every page contains every field, and some job listings may be outdated.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. What we learned
&lt;/h2&gt;

&lt;p&gt;A few lessons stood out:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Use APIs and feeds when available.&lt;/strong&gt; They're often cheaper and easier to process.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Render JavaScript when needed.&lt;/strong&gt; Some listing pages don't contain their data in the initial HTML.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Check the actual response.&lt;/strong&gt; Empty pages can still return HTTP 200.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Respect website rules.&lt;/strong&gt; Check terms and &lt;code&gt;robots.txt&lt;/code&gt;, follow rate limits, and collect only the data you need.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What would you build?
&lt;/h2&gt;

&lt;p&gt;A job collector is just one use case. The same idea could help organize internships, scholarships, research opportunities, or listings for a job aggregator.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;If you were building a job-hunting assistant, what would you want it to do first?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Find relevant jobs, compare opportunities, match jobs to your skills, or track applications?&lt;/p&gt;

&lt;p&gt;I'm exploring these use cases while working on Spicrawl, and I'd genuinely love to hear your ideas.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Want to explore more job boards?&lt;/strong&gt; Check out the &lt;a href="https://docs.spicrawl.com/use-cases/job-postings" rel="noopener noreferrer"&gt;Spicrawl job-postings scraping guide&lt;/a&gt; for tested API requests, credit costs, JavaScript rendering, and tips for scraping different job sources.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://spicrawl.com/" rel="noopener noreferrer"&gt;Explore Spicrawl&lt;/a&gt;  currently free during beta, with no credit card required.&lt;/p&gt;

</description>
      <category>webscraping</category>
      <category>python</category>
      <category>webdev</category>
      <category>discuss</category>
    </item>
  </channel>
</rss>
