How fastify performs better than other frameworks ?

Vinamra Sareen — Tue, 13 Apr 2021 12:11:12 +0000

What is Fastify ?

Fastify is a web framework for developing the backend of an application based on its powerful plugin architecture. Fastify efficiently handles the resources of the server and helps you serve the max number of requests per second.

It is the most popular framework in town not because of it’s user base but because of the fact it is the most fastest framework available.

Why use Fastify ?

There are many alternatives in market, then why focus on fastify ?
If you have worked with backend applications before you might have heard of some popular frameworks such as express, koa, hapi or restify. Out of these the most popular framework has been Express.js, due to its wide use and community support it is always at the top of charts. But in terms of performance it is not.

A good way to understand is by comparison.

Have a look at these comparisons I did between fastify and express.

The first image is of express, where we have used autocannon (a benchmarking tool).The number of requests served by express is 14k

When compared to fastify, it outperforms express. The number of requests served per second is 28K, two times than that of express.

You can also checkout this link, for benchmarks with other frameworks : Benchmarks

Reasons for performance

One of the primary reasons for the performance of fastify is because of its dependencies. Some of the dependencies that fastify uses:

find-my-way
pino
fast-json-stringify
fastify-helmet

And might be few others too.

If we take a close look at each of these dependencies.

For routing they use find-my-way which avoids closure allocation, is built on a radix tree and safe to use. Those who are not aware of closure based problems in javascript:

1. Variables used by closure do not get garbage collected.
2. Memory snapshot of the application increases if closures are not used properly

Fastify uses pino for logging which is more performant than other logging libraries available (bunyan, winston).
JSON.stringify cannot be optimized by v8, so they use fast-json-stringify which is schema based JSON rendering and generates code based on schema, which greatly reduces the computation overhead for identifying field types for JSON serialization.
Fastify-helmet performs better than other libraries

That’s been said about dependencies, there is another reason behind fastify’s performance.

Its life cycle.

It's not just about dependencies it uses but it has been designed in such a way that it optimizes with v8 in the best possible way.

What code developer writes is used by fastify which is pre initialized so it is available at the time it is requested which makes it faster, the pre initialized data structures are fast and improves and the efficiency of the fastify framework making it more performant.

Please, let me know everyone if you have anything to add, or correct.

References: Fastify

How to improve database performance for insert queries

Vinamra Sareen — Sun, 28 Feb 2021 07:55:09 +0000

Hey all, this is my first blog, I have recently started working as a full stack web developer at Adda52Rummy and I was assigned with a task to insert some records in database, which I thought I handled appropriately. But my manager gave me csv file of 5K records to insert to database. It was synchronous code and took some time.

About tech Stack, I was working in Node.js with MariaDB and Fastify framework (performs better than express and other sever frameworks or library). I used Sequelize as ORM library, it is a promise-based Node.js ORM for Postgres, MySQL, MariaDB, SQLite and Microsoft SQL Server. To improve the performance of my operations, I needed to run insert operations in multiple batches and those batches had to run in parallel. Aha! Sound nice, but to how to implement it. After spending ample time of searching I found some solution on how to do it.
Thanks to Evan Siroky.

The solution was to use bulkCreate to insert multiple batches and use asnyc.cargo function to run batches in parallel. After using this I was able to insert data in 2 seconds and guess what, I was able to insert 100K records in 5 ~ 7 seconds.

Let's jump straight to code:

In my controllers, coupon.js

const Coupon = require("../models/coupon");

// exports.createCoupon = async (row) => {
//   await Coupon.sync();
//   return Coupon.create({
//     coupon_code: row.coupon_code,
//   });
// };

// Here I am using bulkCreate
exports.createCoupon = (tasks, inserterCb) => {
  Coupon.bulkCreate(tasks).then(function () {
    inserterCb();
  });
};

I have created a utility folder, where I have created a csv-to-db.js_ file:

const fs = require("fs");
const path = require("path");
const async = require("async");
const csv = require("csv");

function csvToDb(filename, fn) {
  let input = fs.createReadStream(
    path.resolve(__dirname, "../public/assets", filename)
  );
  let parser = csv.parse({
    columns: true,
    relax: true,
  });

  let inserter = async.cargo(function (tasks, inserterCb) {
    fn(tasks, inserterCb);
  }, 1000 // -> task size); 

/* you can specify how many task you want to handle, I have set it to 
1000 tasks at a time parallel, I can say for 100K let's handle 
50K - 50K to take much less time, but it doesn't work that way,
 it will take maybe two or more seconds to execute input of size 50K,
 as it is large input. So take a size which execute faster but handles
 many task as possible. */

  parser.on("readable", function () {
    while ((line = parser.read())) {
      inserter.push(line);
    }
  });

  parser.on("error", function (err) {
    throw err;
  });

  parser.on("end", function (count) {
    inserter.drain();
  });

  input.pipe(parser);
}

module.exports = csvToDb;

Now, when I call this route 'http::/localhost:3000/coupon', this is the code that gets executed.

const Coupon = require("../controllers/coupon");

module.exports = function routes(fastify, options, done) {
  fastify.get("/coupon", async (req, res) => {
    csvToDb("filename.csv", Coupon.createCoupon);
    return { statusCode: 200, message: "sucess" };
  });

  done();
}

Thanks to read out.

All references:

DEV Community: Vinamra Sareen

How fastify performs better than other frameworks ?

What is Fastify ?

Why use Fastify ?

Reasons for performance

How to improve database performance for insert queries