<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: mcpcustoms</title>
    <description>The latest articles on DEV Community by mcpcustoms (@mcpcustoms).</description>
    <link>https://dev.to/mcpcustoms</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3990964%2Fb643c3c6-98fb-4cf2-90a6-88da66370358.png</url>
      <title>DEV Community: mcpcustoms</title>
      <link>https://dev.to/mcpcustoms</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/mcpcustoms"/>
    <language>en</language>
    <item>
      <title>We scanned 12 popular MCP servers. The most interesting finding was our own false positives.</title>
      <dc:creator>mcpcustoms</dc:creator>
      <pubDate>Thu, 18 Jun 2026 13:04:26 +0000</pubDate>
      <link>https://dev.to/mcpcustoms/we-scanned-12-popular-mcp-servers-the-most-interesting-finding-was-our-own-false-positives-kcf</link>
      <guid>https://dev.to/mcpcustoms/we-scanned-12-popular-mcp-servers-the-most-interesting-finding-was-our-own-false-positives-kcf</guid>
      <description>&lt;p&gt;We built &lt;code&gt;mcp-customs&lt;/code&gt;, a free, offline CLI that checks an MCP server for&lt;br&gt;
common security risks before you install it — think &lt;code&gt;npm audit&lt;/code&gt;, but&lt;br&gt;
for the servers your AI agent connects to. Before asking anyone to use&lt;br&gt;
it, we pointed it at 12 real, popular MCP servers and read every single&lt;br&gt;
finding by hand. Here's what actually held up.&lt;/p&gt;

&lt;h2&gt;
  
  
  The setup
&lt;/h2&gt;

&lt;p&gt;We pulled the current top MCP-related repos on GitHub by star count and&lt;br&gt;
scanned each one as-is, no cherry-picking:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Server&lt;/th&gt;
&lt;th&gt;Stars&lt;/th&gt;
&lt;th&gt;Score&lt;/th&gt;
&lt;th&gt;Stamp&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;github/github-mcp-server&lt;/td&gt;
&lt;td&gt;30.8k&lt;/td&gt;
&lt;td&gt;97/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;BeehiveInnovations/pal-mcp-server&lt;/td&gt;
&lt;td&gt;11.6k&lt;/td&gt;
&lt;td&gt;0/100&lt;/td&gt;
&lt;td&gt;FLAGGED*&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;firecrawl/firecrawl-mcp-server&lt;/td&gt;
&lt;td&gt;6.6k&lt;/td&gt;
&lt;td&gt;97/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;exa-labs/exa-mcp-server&lt;/td&gt;
&lt;td&gt;4.6k&lt;/td&gt;
&lt;td&gt;97/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;makenotion/notion-mcp-server&lt;/td&gt;
&lt;td&gt;4.4k&lt;/td&gt;
&lt;td&gt;29/100&lt;/td&gt;
&lt;td&gt;FLAGGED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;antvis/mcp-server-chart&lt;/td&gt;
&lt;td&gt;4.2k&lt;/td&gt;
&lt;td&gt;94/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;haris-musa/excel-mcp-server&lt;/td&gt;
&lt;td&gt;3.9k&lt;/td&gt;
&lt;td&gt;97/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;cloudflare/mcp-server-cloudflare&lt;/td&gt;
&lt;td&gt;3.9k&lt;/td&gt;
&lt;td&gt;0/100&lt;/td&gt;
&lt;td&gt;FLAGGED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;browserbase/mcp-server-browserbase&lt;/td&gt;
&lt;td&gt;3.4k&lt;/td&gt;
&lt;td&gt;22/100&lt;/td&gt;
&lt;td&gt;FLAGGED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;blazickjp/arxiv-mcp-server&lt;/td&gt;
&lt;td&gt;2.9k&lt;/td&gt;
&lt;td&gt;94/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Jpisnice/shadcn-ui-mcp-server&lt;/td&gt;
&lt;td&gt;2.8k&lt;/td&gt;
&lt;td&gt;0/100&lt;/td&gt;
&lt;td&gt;FLAGGED*&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;stickerdaniel/linkedin-mcp-server&lt;/td&gt;
&lt;td&gt;2.4k&lt;/td&gt;
&lt;td&gt;94/100&lt;/td&gt;
&lt;td&gt;CLEARED&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;*see below — these two scores don't mean what they look like they mean.&lt;/p&gt;

&lt;h2&gt;
  
  
  Finding #1: almost nobody declares permissions
&lt;/h2&gt;

&lt;p&gt;Eleven of twelve servers had &lt;strong&gt;zero&lt;/strong&gt; permission or scope declaration in&lt;br&gt;
their manifest. Not "weak" declarations — none at all. This isn't a&lt;br&gt;
ranking judgment on any one project; right now there's no real convention&lt;br&gt;
for it. If you're building an MCP server, declaring what it actually&lt;br&gt;
needs (filesystem? network? shell?) is the single easiest thing you can&lt;br&gt;
do to make a client's "do you want to allow this?" prompt mean something.&lt;/p&gt;

&lt;h2&gt;
  
  
  Finding #2: our own scanner was the bigger story
&lt;/h2&gt;

&lt;p&gt;Before publishing anything, we split every finding into "runtime code"&lt;br&gt;
vs. "test/dev/script code" — because a &lt;code&gt;subprocess.run(shell=True)&lt;/code&gt; in a&lt;br&gt;
test fixture is a very different thing from the same line in a request&lt;br&gt;
handler. Once we did that:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;pal-mcp-server&lt;/strong&gt; scored 0/100 with 13 findings. Every single one was
in &lt;code&gt;tests/&lt;/code&gt; or &lt;code&gt;simulator_tests/&lt;/code&gt; — fake API keys used to test a &lt;em&gt;PII
sanitizer&lt;/em&gt;, and a &lt;code&gt;shell=True&lt;/code&gt; call in a test for a security-audit
feature. Runtime-code findings: &lt;strong&gt;zero&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;shadcn-ui-mcp-server&lt;/strong&gt; also scored 0/100. Two of its three findings
were &lt;code&gt;execSync()&lt;/code&gt; calls in a release-versioning script
(&lt;code&gt;scripts/bump-version.js&lt;/code&gt;) — not reachable by an agent, just a
maintainer running &lt;code&gt;npm version&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;We also caught &lt;strong&gt;our own bug&lt;/strong&gt; mid-process: the scanner initially
flagged a commented-out &lt;code&gt;eval()&lt;/code&gt; call in notion-mcp-server as critical.
It was inside a &lt;code&gt;//&lt;/code&gt; comment. We fixed comment-stripping before
re-running anything in this post — an earlier draft of this table
would have been wrong.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A heuristic scanner that can't tell test code from runtime code, or a&lt;br&gt;
comment from a statement, isn't very useful. We'd rather show you where&lt;br&gt;
it broke than publish the inflated numbers.&lt;/p&gt;

&lt;h2&gt;
  
  
  Finding #3: the two things actually worth a second look
&lt;/h2&gt;

&lt;p&gt;After filtering out test/dev noise, two real-code patterns remained that&lt;br&gt;
we think are legitimately worth the maintainers' attention — not&lt;br&gt;
confirmed vulnerabilities, just the exact shape of thing this category&lt;br&gt;
of tool exists to surface:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;cloudflare/mcp-server-cloudflare&lt;/strong&gt;, &lt;code&gt;sandbox.container.app.ts&lt;/code&gt;: a
file read and a file write both take a variable named &lt;code&gt;reqPath&lt;/code&gt;
directly into &lt;code&gt;fs.readFile&lt;/code&gt; / &lt;code&gt;fs.writeFile&lt;/code&gt;. We didn't trace the full
call path to confirm whether it's constrained upstream — that's a
five-minute check for someone who knows the codebase, which is exactly
the point of flagging it rather than asserting it.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;notion-mcp-server&lt;/strong&gt;, &lt;code&gt;src/init-server.ts&lt;/code&gt;: reads a spec file from a
path resolved at startup. Lower stakes — looks like a local config
path, not something an agent's tool call controls — but same category.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Everything else that scored a CLEARED or a high number had, at most, the&lt;br&gt;
missing-permissions finding from #1.&lt;/p&gt;

&lt;h2&gt;
  
  
  What this means if you're picking an MCP server today
&lt;/h2&gt;

&lt;p&gt;Don't read the scores in the table above as a safety ranking — read&lt;br&gt;
finding #2 first. A FLAGGED stamp from a heuristic tool like this means&lt;br&gt;
"go look," not "don't install." Several of today's FLAGGED results&lt;br&gt;
would be CLEARED if the tool only understood that a test directory isn't&lt;br&gt;
a runtime path, which is a limitation of the tool, not the project.&lt;/p&gt;

&lt;h2&gt;
  
  
  Try it
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;npx mcp-customs scan ./path-to-some-mcp-server
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Fully offline, zero telemetry, free, Apache-2.0. The rules and the&lt;br&gt;
scanner itself are about 250 lines — read all of them in five minutes,&lt;br&gt;
which is more than you can say for most security tools.&lt;/p&gt;

&lt;p&gt;If you maintain one of the servers above and want help interpreting (or&lt;br&gt;
arguing with) a finding, open an issue. If you maintain a different MCP&lt;br&gt;
server and want to run this yourself before we do, that's the whole&lt;br&gt;
point — we'd rather you find your own false positives than us find&lt;br&gt;
them for you in public.&lt;/p&gt;

</description>
      <category>security</category>
      <category>opensource</category>
      <category>ai</category>
      <category>showdev</category>
    </item>
  </channel>
</rss>
