npm run dev is the standard for "run my website locally," but how does it work? How can we expand its functionality? In this post we'll look at:
- How to configure what
npm run devdoes. - How to decompose complex commands into granular units.
- How to run multiple commands in parallel.
- How to run pre-requisites without losing normal
Ctrl-Cbehavior. - How to add seed data (if none exists) when starting up a Convex backend.
As a motivating example, here are some scripts defined in the convex-helpers example app. We'll cover what each piece does
"scripts": {
"dev": "npm-run-all --parallel dev:backend dev:frontend",
"build": "tsc && vite build",
"dev:backend": "convex dev",
"dev:frontend": "vite",
"predev": "convex dev --until-success",
"test": "vitest"
},
How and where they're defined
npm run runs commands that are defined in your package.json in your project's workspace. These commands are often pre-configured when you start your repo from a command like npm create vite@latest with commands for:
-
dev: Run a development environment. This often includes autor-reloading the UI when files change. For Vite this isviteand Next.js isnext dev. -
build: Build the website for deployment. This will generally compile and bundle all your html, css, and javascript. For Vite this isvite buildand Next.js isnext build. -
test: Run tests - if you're using Jest, it's just"test": "jest"orvitestfor Vitest.
Here's a basic example from Next.js:
// in package.json
{
// ...
"scripts": {
"dev": "next dev",
"build": "next build",
"start": "next start",
"lint": "next lint"
},
//...
Here you can run npm run dev or npm run lint etc.
You can learn more about npm run in the docs.
Why use scripts?
It's a fair question why one would put commands that already so simple into package scripts. Why not just call jest or vite or next build? There's a few good reasons:
- You can save the default parameters for commands so you don't have to remember or document the "standard" way of starting something. We'll see below how you can configure it to chain commands and run others in parallel.
- It allows you to easily run commands that are installed by
npmbut not globally accessible from your shell (terminal).1 When you install things likenpm install -D vitest, it installsvitestintonode_modules/.bin.2 You can't runvitestdirectly in your shell,3 but you can have a config like:"scripts": { "test": "vitest" }andnpm run testwill runvitest. - It always runs with the root of the package folder as the "current directory" even if you're in a subdirectory. So you can define a script like
"foo": "./myscript.sh"and it will always look formyscript.shin the package root (in the same directory as package.json). Note: you can access the current directory where it was called via theINIT_CWDenvironment variable. - You can reference variables in the
package.jsoneasily when the script is run fromnpm run. For instance, you can access the "version" of your package with thenpm_package_versionenvironment variable, likeprocess.env.npm_package_versionin js or$npm_package_versionin a script. - If you have multiple workspaces (many directories with their own package.json configured into a parent package.json with a "workspaces" config), you can run the same command in all workspaces with
npm test --workspacesor one withnpm run lint --workspace apps/web.
Does npm run dev work with yarn / pnpm / bun?
Yes! Even if you install your dependencies with another package manager, you can still run your package scripts with npm.
yarn # similar to `npm install`
npm run dev # still works!
You don't have to remember that npm run dev maps to yarn dev (or yarn run dev). The same goes for npx: npx convex dev works regardless of what package manager you used to install things.
Running commands in parallel
There are a couple packages you can use to run commands concurrently:4
We'll just look at npm-run-all here. Consider our example:
"scripts": {
"dev": "npm-run-all --parallel dev:backend dev:frontend",
"dev:backend": "convex dev",
"dev:frontend": "vite",
},
This defines three scripts.
-
npm run dev:backendrunsconvex dev. -
npm run dev:frontendrunsvite. -
npm run devruns bothconvex devandvitein parallel vianpm-run-all.
Both outputs are streamed out, and doing Ctrl-C will interrupt both scripts.
predev? postbuild?
You can specify commands to run before (pre) or after (post) another command (say, X) by naming your command preX or postX. In the example:
"scripts": {
"dev": "npm-run-all --parallel dev:backend dev:frontend",
"dev:backend": "convex dev",
"dev:frontend": "vite",
"predev": "convex dev --until-success",
},
This will run convex dev --until-success, before the "dev" command of npm-run-all --parallel dev:backend dev:frontend.
Chaining with "&&"
For those used to shell scripting, you can run two commands in sequence if the previous one succeeds with commandA && commandB. This works on both Windows and Unix (mac / linux).
However, there's a couple advantages to just using pre-scripts:
- You can run either command with
npm run dev --ignore-scriptsto not do the "predev" script, ornpm run predevto explicitly only do the "predev" step. - The Ctrl-C behavior is more predictable in my experience. In different shell environments, doing Ctrl-C (which sends an interrupt signal to the current process) would sometimes kill the first script but still run the second script. After many attempts we decided to switch to "predev" as the pattern.
Run interactive steps first
For Convex, when you first run npx convex dev (or npm run dev with the above scripts), it will ask you to log in if you aren't already, and ask you to set up your project if one isn't already set up. This is great, but interactive commands that update the output text don't work well when the output is being streamed by multiple commands at once. This is the motivation for running npx convex dev --until-success before npx convex dev.
-
convex devsyncs your functions and schema whenever it doesn't match what you have deployed, watching for file changes. - The
--until-successflag syncs your functions and schema only until it succeeds once, telling you what to fix if something is wrong and retrying automatically until it succeeds or you Ctrl-C it. - By running
npx convex dev --until-success, we can go through the login, project configuration, and an initial sync, all before trying to start up the frontend and backend. - The initial sync is especially helpful if it catches issues like missing environment variables which need to be set before your app can function.
- This way the frontend doesn't start until the backend is ready to handle requests with the version of functions it expects.
Seeding data on startup
If you change your "predev" command for Convex to include --run it will run a server-side function before your frontend has started.
"scripts": {
//...
"predev": "convex dev --until-success --run init",
//...
},
The --run init command will run a function that is the default export in convex/init.ts. You could also have run --run myFolder/myModule:myFunction. See docs on naming here. See this post on seeding data but the gist is that you can define an internalMutation that checks if the database is empty, and if so inserts a collection of records for testing / setup purposes.
tsc?
If you use TypeScript, you can run a type check / compile your typescript files with a bare tsc. If your tsconfig.json is configured to emit types, it will write out the types. If not, it will just validate the types. This is great to do as part of the build, so you don't build anything that has type errors. This is why the above example did:
"build": "tsc && vite build",
How to pass arguments?
If you want to pass arguments to a command, for instance passing arguments to your testing command to specify what test to run, you can pass them after a -- to separate the command from the argument. Technically you don't need -- if your arguments are positional instead of --prefixed, but it doesn't hurt to always do it in case you forget which to do it for.
npm run test -- --grep="pattern"
Summary
We looked at some ways of using package.json scripts to simplify our workflows. Who knew how much power could rest behind a simple npm run dev? Looking at our original example:
"scripts": {
"dev": "npm-run-all --parallel dev:backend dev:frontend",
"build": "tsc && vite build",
"dev:backend": "convex dev",
"dev:frontend": "vite",
"predev": "convex dev --until-success",
"test": "vitest"
},
-
devruns the frontend and backend in parallel, afterpredev. -
builddoes type checking viatscbefore building the static site. -
dev:backendcontinuously deploys the backend functions to your development environment as you edit files. -
dev:frontendruns a local frontend server that auto-reloads as you edit files. -
predevruns beforedevand does an initial deployment, handling login, configuration, and an initial sync as necessary. -
testuses Vitest to run tests. Note:npm testis shorthand fornpm run testalong with other commands, but they're special cases.npm run testis the habit I suggest.
-
The way your shell finds which command to run when you type
npmis to check the shell'sPATHenvironment variable (on unix machines anyways). You can see your own withecho "$PATH". It checks all the places specified in$PATHand uses the first one. ↩ -
Technically you can override & specify where npm installs binaries. ↩
-
If you really want to, you can run
npm exec vitest,npx vitestfor short,./npm_modules/.bin/vitestdirectly, or add.npm_modules/.binto your PATH. ↩ -
Some people use a bare
&to run one task in the background, but that is not supported on Windows, and interrupting one command won't necessarily kill the other. ↩
Top comments (0)