DEV Community: Toan Nguyen Truong

Implementing Redis Sentinel - Ensuring High Availability of Redis for Your Application

Toan Nguyen Truong — Sun, 29 Sep 2024 16:50:18 +0000

Introduce

In today's application development environment, ensuring the availability and fault tolerance of systems is extremely important. In this context, Redis Sentinel emerges as a crucial solution for managing and protecting your Redis systems.

Redis Sentinel is an automated system management component of Redis, designed to monitor, manage, and provide fault tolerance for Redis nodes. By deploying Redis Sentinel, you can confidently build and operate Redis systems that are self-healing and highly fault-tolerant.

In this article, we will explore Redis Sentinel, including its main functions, how to deploy and configure it, and the benefits it brings to managing your Redis system. Let’s delve into how Redis Sentinel can enhance the performance and reliability of your Redis systems!

Understanding Sentinels

Redis Sentinel is a distributed system consisting of multiple Redis instances running in sentinel mode. We call these instances Sentinels.

The group of Sentinels monitors a master Redis and its replicas. If the Sentinels detect that the master Redis has failed, the sentinel processes will look for the replica with the most up-to-date data and will promote that replica to become the new master. This allows clients communicating with the database to reconnect to the new master Redis and continue functioning normally, causing minimal disruption to users.

Deciding That the Master Redis Has Failed
- For the Sentinels to decide that the master Redis has failed, we need enough Sentinels to agree that the server is inaccessible.
- A certain number of Sentinels need to agree that they need to take action, which is referred to as achieving quorum. If the Sentinels do not reach quorum, they cannot decide that the master has failed. The exact number of Sentinels required for quorum can be configured.
Activating Failover
- Once the Sentinels have decided that a master Redis has failed, they must elect and authorize a leader (one Sentinel instance) to perform the failover. A leader can only be chosen if the majority of the Sentinels agree.
- In the final step, the leader will configure the selected replica to become the master by sending the command REPLICA OF NO ONE, and it will configure the other replicas to follow the newly promoted master.

High Availability with Redis Sentinel

Redis Sentinel provides high availability for Redis when not using Redis Cluster.

It also offers other ancillary tasks such as monitoring, notification, and acting as a configuration provider for clients.

Here is a complete list of Sentinel's capabilities at a high level (i.e., the overall picture):

Monitoring: Sentinel continuously checks whether the master and replica instances are functioning as expected.
Notification: Sentinel can notify system administrators or other computer programs via an API if there is an issue with one of the monitored Redis instances.
Automatic Failover: If a master is not functioning as expected, Sentinel can initiate an automatic failover process where a replica is promoted to master, the other replicas are reconfigured to use the new master, and applications using the Redis server are informed of the new address to connect to.
Configuration Provider: Sentinel acts as a configuration source for service discovery for clients: clients connect to Sentinel to request the address of the current master Redis that provides a specific service. If an issue occurs, Sentinel will report the new address.

Sentinel as a Distributed System

Sentinel is designed to run in a configuration with multiple cooperating Sentinel processes. The benefits of having multiple cooperating Sentinel processes are:

Fault detection is performed when multiple Sentinels agree that a specific master is no longer available. This reduces the likelihood of false positives.
Sentinel continues to operate even if not all Sentinel processes are active, making the system robust against failures.

Deploying Redis Sentinel for Applications

In this section, I will demonstrate a NodeJS application using ioredis to set up Redis Sentinel.

Configuring Redis Sentinel on Docker

I will write a Docker Compose file to run Redis Sentinel as shown below. It will include 1 master, 2 slaves, and 3 sentinels.

version: '3'

services:
  redis-master:
    image: bitnami/redis:latest
    ports:
      - '6379:6379'
    environment:
      - REDIS_REPLICATION_MODE=master
      - ALLOW_EMPTY_PASSWORD=yes
      - REDIS_AOF_ENABLED=yes
    volumes:
      - redis-master-db:/bitnami/redis/data
    networks:
      redis-net:
        ipv4_address: 172.50.0.10

  redis-slave1:
    image: bitnami/redis:latest
    ports:
      - '6380:6379'
    environment:
      - REDIS_REPLICATION_MODE=slave
      - REDIS_MASTER_HOST=redis-master
      - REDIS_MASTER_PORT_NUMBER=6379
      - ALLOW_EMPTY_PASSWORD=yes
      - REDIS_AOF_ENABLED=yes
    volumes:
      - redis-slave1-db:/bitnami/redis/data
    networks:
      redis-net:
        ipv4_address: 172.50.0.11
    depends_on:
      - redis-master

  redis-slave2:
    image: bitnami/redis:latest
    ports:
      - '6381:6379'
    environment:
      - REDIS_REPLICATION_MODE=slave
      - REDIS_MASTER_HOST=redis-master
      - REDIS_MASTER_PORT_NUMBER=6379
      - ALLOW_EMPTY_PASSWORD=yes
      - REDIS_AOF_ENABLED=yes
    volumes:
      - redis-slave2-db:/bitnami/redis/data
    networks:
      redis-net:
        ipv4_address: 172.50.0.12
    depends_on:
      - redis-master

  redis-sentinel1:
    image: bitnami/redis-sentinel:latest
    ports:
      - '26379:26379'
    environment:
      - REDIS_MASTER_HOST=redis-master
      - REDIS_MASTER_PORT_NUMBER=6379
      - REDIS_SENTINEL_PORT_NUMBER=26379
    networks:
      redis-net:
        ipv4_address: 172.50.0.13
    depends_on:
      - redis-master
      - redis-slave1
      - redis-slave2

  redis-sentinel2:
    image: bitnami/redis-sentinel:latest
    ports:
      - '26380:26379'
    environment:
      - REDIS_MASTER_HOST=redis-master
      - REDIS_MASTER_PORT_NUMBER=6379
      - REDIS_SENTINEL_PORT_NUMBER=26380
    networks:
      redis-net:
        ipv4_address: 172.50.0.14
    depends_on:
      - redis-master
      - redis-slave1
      - redis-slave2

  redis-sentinel3:
    image: bitnami/redis-sentinel:latest
    ports:
      - '26381:26379'
    environment:
      - REDIS_MASTER_HOST=redis-master
      - REDIS_MASTER_PORT_NUMBER=6379
      - REDIS_SENTINEL_PORT_NUMBER=26381
    networks:
      redis-net:
        ipv4_address: 172.50.0.15
    depends_on:
      - redis-master
      - redis-slave1
      - redis-slave2

networks:
  redis-net:
    driver: bridge
    ipam:
      driver: default
      config:
        - subnet: 172.50.0.0/24

volumes:
  redis-master-db:
  redis-slave1-db:
  redis-slave2-db:

This is the result after running the compose file:

Check the logs in the containers; if they display as shown below, you have successfully run it:

Log redis-sentinel-demo-redis-master-1:

Log redis-sentinel-demo-redis-sentinel1-1:

Thus, the database setup step is complete.

Connecting the Application to Redis Sentinel

Information on the necessary environment variables:

REDIS_MASTER_HOST_PORT_DOCKER=172.50.0.10:6379
REDIS_SLAVE_HOST_PORT_DOCKER_1=172.50.0.11:6379
REDIS_SLAVE_HOST_PORT_DOCKER_2=172.50.0.12:6379
REDIS_MASTER_MACHINE_HOST=your_machine_ip
REDIS_SLAVE_MACHINE_HOST_1=your_machine_ip
REDIS_SLAVE_MACHINE_HOST_2=your_machine_ip
REDIS_MASTER_MACHINE_PORT=6379
REDIS_SLAVE_MACHINE_PORT_1=6380
REDIS_SLAVE_MACHINE_PORT_2=6381
REDIS_SENTINEL_HOST_PORT_DOCKER_1=172.50.0.13:26379
REDIS_SENTINEL_HOST_PORT_DOCKER_2=172.50.0.14:26379
REDIS_SENTINEL_HOST_PORT_DOCKER_3=172.50.0.15:26379
REDIS_SENTINEL_HOST_1=your_machine_ip
REDIS_SENTINEL_HOST_2=your_machine_ip
REDIS_SENTINEL_HOST_3=your_machine_ip
REDIS_SENTINEL_PORT_1=26379
REDIS_SENTINEL_PORT_2=26380
REDIS_SENTINEL_PORT_3=26381
REDIS_MASTER_NAME=mymaster
REDIS_DB=0

Write a config file to connect to Redis Sentinel:

const dbConfig = {
  redisSentinels: {
    natMap: {
      [`${process.env.REDIS_MASTER_HOST_PORT_DOCKER}`]: {
        // Docker IP and internal port of redis-primary
        host: process.env.REDIS_MASTER_MACHINE_HOST,
        port: parseInt(process.env.REDIS_MASTER_MACHINE_PORT), // Exposed port in docker-compose
      },
      [`${process.env.REDIS_SLAVE_HOST_PORT_DOCKER_1}`]: {
        // Docker IP and internal port of redis-replica 1
        host: process.env.REDIS_SLAVE_MACHINE_HOST_1,
        port: parseInt(process.env.REDIS_SLAVE_MACHINE_PORT_1), // Exposed port in docker-compose
      },
      [`${process.env.REDIS_SLAVE_HOST_PORT_DOCKER_2}`]: {
        // Docker IP and internal port of redis-replica 2
        host: process.env.REDIS_SLAVE_MACHINE_HOST_2,
        port: parseInt(process.env.REDIS_SLAVE_MACHINE_PORT_2), // Exposed port in docker-compose
      },
      // Docker IP of Sentinel 1
      [`${process.env.REDIS_SENTINEL_HOST_PORT_DOCKER_1}`]: {
        host: process.env.REDIS_SENTINEL_HOST_1,
        port: parseInt(process.env.REDIS_SENTINEL_PORT_1), // Exposed port in docker-compose
      },
      // Docker IP of Sentinel 2
      [`${process.env.REDIS_SENTINEL_HOST_PORT_DOCKER_2}`]: {
        host: process.env.REDIS_SENTINEL_HOST_2,
        port: parseInt(process.env.REDIS_SENTINEL_PORT_2), // Exposed port in docker-compose
      },
      // Docker IP of Sentinel 3
      [`${process.env.REDIS_SENTINEL_HOST_PORT_DOCKER_3}`]: {
        host: process.env.REDIS_SENTINEL_HOST_3,
        port: parseInt(process.env.REDIS_SENTINEL_PORT_3), // Exposed port in docker-compose
      },
    },
    sentinels: [
      { host: process.env.REDIS_SENTINEL_HOST_1, port: parseInt(process.env.REDIS_SENTINEL_PORT_1) },
      { host: process.env.REDIS_SENTINEL_HOST_2, port: parseInt(process.env.REDIS_SENTINEL_PORT_2) },
      { host: process.env.REDIS_SENTINEL_HOST_3, port: parseInt(process.env.REDIS_SENTINEL_PORT_3) },
    ],
    name: process.env.REDIS_MASTER_NAME || 'mymaster',
    redisDB: parseInt(process.env.REDIS_DB, 10) || 0,
  },
};

module.exports = dbConfig;

Create a client using ioredis to connect to the Sentinel:

const { Redis } = require('ioredis');
const config = require('../configs');

const redisClient = new Redis(
  {
    sentinels: config.redisSentinels.sentinels,
    name: config.redisSentinels.name,
    showFriendlyErrorStack: true,
    db: config.redisSentinels.redisDB,
  },
  { natMap: config.redisSentinels.natMap },
);

redisClient.on('connect', () => {
  console.info('Connect Redis successfully');
});

redisClient.on('error', (err) => {
  console.error('Redis client error', err);
});

module.exports = { redisClient };

Write a simple ExpressJS server with two routes: /write and /read to test writing and reading data to Redis via the Sentinel connection:

Results

Run the server and check the connection:

Thus, the server is running and has successfully connected to Redis Sentinel.

Check the API for writing data:

Check the API for reading data:

Conclusion

In this article, I introduced Redis Sentinel and the features it offers when applied to our applications. I also provided a detailed guide on how to configure and run a Redis Sentinel setup using Docker. Finally, there was a tutorial on connecting to a demo NodeJS application using ioredis.

I hope this article provides valuable knowledge and helps those of you looking to implement Redis Sentinel for your applications. If you found the article helpful and interesting, please vote for me (this is my first article, so it would be a great motivation for me). I am also open to listening, improving, and offering support if you need it, so feel free to leave comments. I will conclude this article here; remember to vote for me. I look forward to seeing everyone in future articles.

If the article is interesting and useful to you, you can give me a cup of coffee. Thanks for reading.

Build a simple Music Player with AWS Amplify and React

Toan Nguyen Truong — Sat, 01 Oct 2022 09:42:31 +0000

Introduction

Hello everyone, I finally finished my mini project and this is also my first post - a fledgling developer from Vietnam.

In this article, I would like to share the process of learning and building a simple music player using AWS Amplify and ReactJS.

Technology

AWS Amplify
AWS AppSync
AWS S3
AWS DynamoDB
AWS Cognito
React JS
GraphQL
Material UI

Project initialization

Create React app

Yeah, I'm a backend developer and it's my first time trying it.

npx create-react-app musicplayer
cd musicplayer
npm start

Everything is very good, the whole project structure is instantiated.

Amplify configure

First we need to install amplify-cli to facilitate the setup related to Amplify on our computer. Let's use the command:

npm i -g @aws-amplify/cli

At the project directory (musicplayer), run the command:

amplify configure

Follow the instructions on the command line to set up access to your AWS account, these include:

Choose region
Set username for the new IAM user
Redirect to AWS console to check and set permissions, get Access key ID and secret access key

And after creating a new IAM user, you will use that account to develop applications with different defaults from Amplify when you run the amplify init command. At this point, you should be able to view your application when accessing the AWS Amplify service as shown below:

Add create account, sign in, sign out

Execute the command below to add authentication functions to the application:

amplify add auth

At this step, I choose email as the way for users to register for an account. Other ways can be selected and easily changed by updating them on your AWS console. After every Amplify-related change or update, you need to run the command amplify push to save them in the cloud.

AWS Amplify automatically generates the amplify directory and the aws-exports.js file containing the config information that the application needs to use.

Install the necessary packages:

npm i aws-amplify @aws-amplify/ui-react

In file App.js:

import { Amplify, API, graphqlOperation, Storage } from 'aws-amplify';
import { withAuthenticator } from '@aws-amplify/ui-react';
import configure from "./aws-exports";
Amplify.configure(configure);
function App({ signOut, user }) {
//...
return (
    //...
    )
}
//...
export default withAuthenticator(App);

With the help of AWS Amplify, adding authentication capabilities to your application is really fast.

Use DynamoDB and GraphQL for API

Run the command:

amplify add api

In this step, I choose to use the GraphQL API with the schema template being a single object with fields and the default authorization type for the API is Amazon Anonymous User Pools. And below is the schema sample generated by Amplify:

type Todo @model {
  id: ID!
  name: String!
  description: String
}

With my needs for this application, I want the schema to save the information for a song, so I modified the model as follows:

type Song @model {
  id: ID!
  name: String!
  description: String!
  filePath: String!
  heart: Int!
  author: String!
}

After finishing editing the model, I pushed my changes to AWS and accepted when asked if I wanted to generate code for the newly created GraphQL API. That way, AWS Amplify creates for me a graphql directory in the src folder containing mutations, queries, and subscriptions. I can use these APIs right away without any modification.

Function to get a list of songs:

import { API, graphqlOperation } from 'aws-amplify';
import { listSongs } from "./graphql/queries";
//...
const [songs, setSongs] = useState([]);
const getSongs = async () => {
    try {
      const songData = await API.graphql(graphqlOperation(listSongs));
      setSongs(songData.data.listSongs.items)
    } catch (error) {
      console.error('error on get songs: ', error);
    }
  }

Increase the number of favorites when the user clicks on the heart icons:

import { updateSong } from "./graphql/mutations";
//...
const increaseHeart = async index => {
    try {
      const song = songs[index];
      song.heart += 1;
      delete song.createdAt;
      delete song.updatedAt;

      const songData = await API.graphql(graphqlOperation(updateSong, { input: song }));

      const songList = [...songs];
      songList[index] = songData.data.updateSong;
      setSongs([...songs]);
    } catch (error) {
      console.error('error on increase heart: ', error);
    }
  }

Try adding some records to DynamoDB and start the application to see the results of the functions.

I use Material UI for faster front-end development. The image source I get is random from Unsplash with the category being music with the id of each song to limit getting duplicate images.

const image = `https://source.unsplash.com/random/200x200/?music&id=${song.id}`

My application at the moment:

Storage audio on S3

To use S3 for storing the application's audio, we run the command:

amplify add storage

then choose the content type to store, set the bucket name, who can access it, the permissions of the auth users, and whether to use a lambda trigger... finally run amplify push to finish set up.

Implement music play/pause functionality, using AWS Amplify's Storage class to get access URLs of songs.

import { Storage } from 'aws-amplify';
//...
const [songPlaying, setSongPlaying] = useState('');
const [audioURL, setAudioURL] = useState('');

const toggleSong = async index => {
    if (songPlaying === index) {
      setSongPlaying('')
      return
    }

    const songFilePath = songs[index].filePath;
    try {
      const fileAccessURL = await Storage.get(songFilePath, { expires: 60 })
      setSongPlaying(index);
      setAudioURL(fileAccessURL);
      return;
    } catch (error) {
      console.error('error accessing the file from S3: ', error);
      setAudioURL('');
      setSongPlaying('');
    }
}

Upload audio files to S3 and update filePath fields in records in DynamoDB.

The product is complete, now we can play and stop the tracks, and drop the heart for our favourite music.

Deploy and host app

You may eventually want to deploy and host your application. You can follow the instructions in the link below:

https://aws.amazon.com/getting-started/guides/deploy-webapp-amplify/module-three/

Here are 2 access links to my deployed app:
https://master.d2knwrz36tm5yc.amplifyapp.com/
https://d2wvly4638hbyf.cloudfront.net/

Link GitHub repository:
https://github.com/nguyentruongtoan1309/musicplayer

This is my first post, I hope to receive your support and suggestions.

Yes, it's done. This is just a simple demo application for applying AWS Amplify to building a web application with ReactJS, all the work is done very quickly and easily. You can improve based on my app, some of the things that can be thought of are allowing users to share songs they like with others, adding comments, chatting... Of course, the knowledge in this article is very limited, and AWS Amplify does much more than that.

Resources

See original post here

If the article is interesting and useful to you, you can give me a cup of coffee. Thanks for reading.