DEV Community: Goffity Corleone

Reduce docker image size of nextJS

Goffity Corleone — Sun, 02 Oct 2022 18:23:53 +0000

I had the opportunity to work on a legacy project developed in React with nextJS framework. I am responsible for building the docker container and deploying it to the cluster. When I looked at a Dockerfile and make it, the size of the image was huge.

The legacy Dockerfile are

FROM node:16

WORKDIR /app
COPY . .
RUN yarn install --frozen-lockfile
CMD ["yarn","start"]

I got the first problem. In the Dockerfile.

First Solution

I try to use multi-stage build for reduce docker images size.

FROM node:16 AS dependency

WORKDIR /app
COPY package.json .
COPY yarn.lock .
RUN yarn install --frozen-lockfile

FROM node:16-alpine AS builder
WORKDIR /app
COPY --from=dependency /app/node_modules ./node_modules
COPY . .
RUN env
RUN yarn build

CMD [ "yarn","start" ]

But the size of the image is still not satisfactory.

Second

I try to research the way to build and deploy nextjs application with docker images and I found the solution on next.js Github

Use Output Standalone Edit next.config.js

module.exports = {
  // ... rest of the configuration.
  output: 'standalone',
}

Edit Dockerfile follow example.


FROM node:16-alpine AS deps
RUN apk add --no-cache libc6-compat
WORKDIR /app
COPY yarn.lock* package-lock.json* pnpm-lock.yaml* ./
RUN \
  if [ -f yarn.lock ]; then yarn --frozen-lockfile; \
  elif [ -f package-lock.json ]; then npm ci; \
  elif [ -f pnpm-lock.yaml ]; then yarn global add pnpm && pnpm i; \
  else echo "Lockfile not found." && exit 1; \
  fi

FROM node:16-alpine AS builder
WORKDIR /app
COPY --from=deps /app/node_modules ./node_modules
COPY . .
RUN yarn build

FROM node:16-alpine AS runner
WORKDIR /app
ENV NODE_ENV production
RUN addgroup --system --gid 1001 nodejs
RUN adduser --system --uid 1001 nextjs
COPY --from=builder /app/public ./public
COPY --from=builder --chown=nextjs:nodejs /app/.next/standalone ./
COPY --from=builder --chown=nextjs:nodejs /app/.next/static ./.next/static
USER nextjs
EXPOSE 3000
ENV PORT 3000
CMD ["node", "server.js"]

Ignore unnecessary files, I add Added .dockerignore to ignore that.

node_modules
build
.dockerignore
Dockerfile
Dockerfile.*

Result

The image size reduce from over 1GB to around 1xxMB

Use cache

In this project we use yarn as package dependency. and in the Dockerfile if we run

yarn --frozen-lockfile

take a very long time so I changed a Dockerfile to use cache on package dependency.

FROM node:16-alpine AS deps
RUN apk add --no-cache libc6-compat
WORKDIR /app
COPY yarn.lock* package-lock.json* pnpm-lock.yaml* ./
# RUN \
#   if [ -f yarn.lock ]; then yarn --frozen-lockfile; \
#   elif [ -f package-lock.json ]; then npm ci; \
#   elif [ -f pnpm-lock.yaml ]; then yarn global add pnpm && pnpm i; \
#   else echo "Lockfile not found." && exit 1; \
#   fi
RUN --mount=type=cache,target=/root/.yarn YARN_CACHE_FOLDER=/root/.yarn yarn install --frozen-lockfile

...

Create RSA key using openssl

Goffity Corleone — Wed, 24 Aug 2022 18:53:21 +0000

The following command may be used with OpenSSL to create an RSA encryption key.

Step to create key to encrypt data with RSA algorithm

Create private key
Use private from (1) to create public key.

Generate private key using the following command:

openssl genrsa -out private.pem 4096

In this command, i Have used a key length of 4096 bits. recommended for length is 2048.

This gives you a private key look like:

Generate public key from public

The private key from step (1) we can use it to generate public key following.

openssl rsa -in private.pem -puout -out public.pem

This should give you a public key look like:

Reference:
https://www.scottbrady91.com/openssl/creating-rsa-keys-using-openssl

Restart Rebuild and ReCreate container on docker compose v2

Goffity Corleone — Mon, 13 Jun 2022 06:45:33 +0000

I want to use docker compose to deploy a new version of an application, However, I do not want to down the compose project and eliminate the volume of other services.

Remove any services that are attempting to deploy.
Start service.

docker compose rm -s -v -f ${service_name}
docker compose up -d ${service_name}

Delete git branch not in remote

Goffity Corleone — Fri, 15 Apr 2022 11:09:36 +0000

I'm not sure where I received the information, but it was most likely from stackoverflow.

git fetch -p && git branch -vv | awk '/: gone]/{print $1}' | xargs git branch -d

Update 2022-08-02

git checkout develop && git branch --merged | grep -v 'main' | grep -v 'develop' >/tmp/merged-branches && vi /tmp/merged-branches && xargs git branch -d </tmp/merged-branches

Ref: https://stackoverflow.com/questions/7726949/remove-tracking-branches-no-longer-on-remote

Install docker and docker-compose on ubuntu 20.04

Goffity Corleone — Fri, 08 Apr 2022 05:39:14 +0000

Docker

Add dependency and install prerequisite packages

apt update
apt install -y apt-transport-https ca-certificates curl software-properties-common

Add docker repository

curl -fsSL https://download.docker.com/linux/ubuntu/gpg | apt-key add -
add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu focal stable"

Install Docker

apt install docker-ce
systemctl status docker

Docker compose

mkdir -p ~/.docker/cli-plugins/
curl -SL https://github.com/docker/compose/releases/download/v2.2.3/docker-compose-linux-x86_64 -o ~/.docker/cli-plugins/docker-compose
chmod +x ~/.docker/cli-plugins/docker-compose
docker compose version

Copy collection in same database.

Goffity Corleone — Sun, 03 Apr 2022 15:50:16 +0000

Copy collection in same database without dump command.

db.collectionName.aggregate([{$match:{}},{$out:"copyCollectionName"}])

Install Spring boot on Weblogic 12c

Goffity Corleone — Tue, 03 Aug 2021 04:01:37 +0000

การจะ deploy web application ที่พัฒนาด้วย spring boot บน weblogic ต้องเพิ่มเติม 2 ส่วนหลัก ๆ คือ

Application เราต้อง implements WebApplicationInitializer

@SpringBootApplication
public class MyApplication extends SpringBootServletInitializer implements WebApplicationInitializer {
...
}

ต้องเพิ่มไฟล์ weblogic.xml ที่ /src/main/webapp/WEB-INF/weblogic.xml

<?xml version="1.0" encoding="UTF-8"?>
<wls:weblogic-web-app
    xmlns:wls="http://xmlns.oracle.com/weblogic/weblogic-web-app"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://java.sun.com/xml/ns/javaee
        https://java.sun.com/xml/ns/javaee/ejb-jar_3_0.xsd
        http://xmlns.oracle.com/weblogic/weblogic-web-app
        https://xmlns.oracle.com/weblogic/weblogic-web-app/1.4/weblogic-web-app.xsd">
    <wls:context-root>/myapp</wls:context-root>
    <wls:container-descriptor>
        <wls:prefer-application-packages>
            <wls:package-name>org.slf4j</wls:package-name>
        </wls:prefer-application-packages>
    </wls:container-descriptor>
</wls:weblogic-web-app>

จากนั้นก็ทำการ deploy ที่ weblogic ตามขั้นตอนของแต่ละรุ่น

https://docs.spring.io/spring-boot/docs/2.5.1/reference/html/howto.html#howto.traditional-deployment.weblogic

Python web scrapping on GCP

Goffity Corleone — Mon, 05 Jul 2021 16:42:28 +0000

Content

build container images.
tag images.
upload images to GCP.
create services.

build container images.

selenium.
web scrapping.

tag images.

image with GCP pattern.

docker pull selenium/standalone-chrome
# tag with pattern $GCP_REGISTRY/$PROJECT_NAME/$IMAGE_NAME
docker tag selenium/standalone-chrome asia.gcr.io/$PROJECT_NAME/selenium-standalone-chrome
# push image
docker push asia.gcr.io/$PROJECT_NAME/selenium-standalone-chrome

upload images to GCP.

authentication on browser.

gcloud auth login

setup project.

gcloud config set project $PROJECT_NAME

create services.

Create from container images.

  # create selenium service.
gcloud run deploy selenium-chrome --image asia.gcr.io/$PROJECT_NAME/selenium_standalone-chrome --port 4444 --memory 2G --region asia-southeast1 --platform managed

Create from cloud build.

# gcloud builds submit --tag asia.gcr.io/$PROJECT_NAME/$IMAGE_NAME

gcloud builds submit --tag asia.gcr.io/$PROJECT_NAME/web-scrpping
# deploy service
gcloud run deploy selenium-chrome --image asia.gcr.io/$PROJECT_NAME/selenium_standalone-chrome

Reference:
https://www.roelpeters.be/how-to-deploy-a-scraping-script-and-selenium-in-google-cloud-run/
https://dev.to/googlecloud/using-headless-chrome-with-cloud-run-3fdp

MySQL query default value is query is NULL

Goffity Corleone — Mon, 05 Jul 2021 16:41:35 +0000

Problem when wanting to mapping values from MySQL query to Object in JAVA but MySQL Query returns NULL
If Application is written in spring boot with JDBCTemplate and mapping to Object, the exception will occur.

org.springframework.beans.TypeMismatchException

can be solved by use IFNULL

SELECT IFNULL(emp_id,0) FROM emp WHERE 1=0;

Output

Reference:
https://dev.mysql.com/doc/refman/5.7/en/flow-control-functions.html
https://www.w3schools.com/sql/func_mysql_ifnull.asp

Change Timezone on linux (ubuntu)

Goffity Corleone — Sun, 04 Jul 2021 19:14:45 +0000

Check timezone on host

timedatectl

Change timezone

timedatectl set-timezone ${timezone}

List timezone

timezonectl list-timezones

Get IP and subnet on Linux

Goffity Corleone — Thu, 15 Oct 2020 17:16:24 +0000

How to get public IP with subnet on Linux OS.

ip a | grep $(hostname -I | awk '{print $1}') | awk '{print $2}'

Install maven wrapper

Goffity Corleone — Mon, 21 Sep 2020 18:53:46 +0000

Install maven wrapper with maven wrapper plugin

mvn -N io.takari:maven:wrapper

Can also specify the version of maven

mvn -N io.takari:maven:wrapper -Dmaven=3.6.3

Ref:https://www.baeldung.com/maven-wrapper