DEV Community: Rajnish

Databricks introduction

Rajnish — Mon, 11 Nov 2024 17:29:00 +0000

Databricks

it is a unified, open analytics platform for building, deploying, sharing and maintaining data, analytics, and AI solutions at scale.

Clusters

it’s a collection of VM (Virtual Machines) instances.
over which computational workloads are distributed across workers

There are two types

All-Purpose Clusters	Job Clusters
Analyse data collectively using interactive Notebooks	Run automated jobs
Create cluster from the workspace or API	The Databricks job scheduler creates job clusters when running jobs
Configuration information is retained for upto 70 clusters for upto 30 days	Configuration information is retained for upto 30 most recently terminated cluster

Share docker image on docker hub

Rajnish — Sat, 02 Nov 2024 13:41:49 +0000

If you are new to docker and want to learn everything of docker read this blog From Setup to Deployment: Running a Flask App in Docker on Mac

I have created another blog to Deploy Flask app using docker Compose

Let's start this blog
we are going to share an image on docker hub and then we will validate it with pull request on our local machine.

Docker hub

Docker hub is a platform where we can publish our own docker image and we can use existing images vice versa.

steps to be followed

register or login on docker hub
Create a new repository

Click on Create repository and the fill up the details I have given the repository name as productivity-docker once repository is created copy and save the command from docker-hub for your repository

example for me it's - docker push rajnishspandey/productivity-docker

now run let's get back to our Terminal or vscode whatever editor you are using.

To create new image make sure you have dockerfile in your project repository or you are in correct directory

run in Terminal (creating image again as I have deleted all the images)

docker build -t rajnishspandey/productivity-docker .

docker login run it in terminal if you are already logged in to docker-hub it will authenticate if not just provide your credentials in Terminal and get authenticated.
now run the command we have saved above from docker hub repository in Terminal docker push rajnishspandey/productivity-docker.

This will check our image and latest tag of the docker image and if found it will publish the image to docker-hub

Now let's check the image in docker-hub

Validation

let's validate with the pull request of our latest image from docker-hub

but before doing pull first will delete all the images from our local docker desktop app to make sure we don't have any image before pull.

now run pull request

docker pull rajnishspandey/productivity-docker

Create container and run the application.

Learn how to

- From Setup to Deployment: Running a Flask App in Docker

- Deploy Flask app using docker Compose

"Happy Learning"

Buy me a coffee

some useful docker commands

docker images to check all the images
docker build -t <new-image-name>-app . to build an images from your application
docker image rm <image-name> - to delete image which is not in use
docker run -it --name <new_container> <base-image> /bin/bash to create a new container and run it from base image. (here above we had python as base image)
docker image rm <image-name> -f delete image which is in use forcefully
docker ps -a to see all the containers running
docker container rm <container-name> to delete container which is not running
docker container rm <container-name> -f to delete container forcefully which is running
docker system prune -a to delete all containers, images and caches.
docker compose up to run docker compose file and created image
docker pull rajnishspandey/productivity-docker to pull the latest image from docker-hub
docker push rajnishspandey/productivity-docker - to push the latest image on docker-hub
docker login - to login on docker-hub through terminal

Deploy Flask app using docker Compose

Rajnish — Sat, 02 Nov 2024 12:19:22 +0000

Docker compose

Compose simplifies the control of your entire application stack, making it easy to manage services, networks, and volumes in a single, comprehensible YAML configuration file. Then, with a single command, you create and start all the services from your configuration file

To learn more about Docker images, containers and basic Flask app deployment on docker read blog

In this blog we are going to deploy our flask application on Docker using docker compose file.

how to clone, create, deploy everything is already covered here please read and follow the instructions or you can just start by

git clone https://github.com/rajnishspandey/productivity.git

docker system prune -a to delete all existing containers, images and caches.

docker compose up

Docker Images

Docker Containers

Running flask Application
This UI can be different as it's possible that the code is updated

Learn how to

- From Setup to Deployment: Running a Flask App in Docker

- Share docker image on docker hub

"Happy Learning"

Buy me a coffee

some useful docker commands

docker images to check all the images
docker build -t <new-image-name>-app . to build an images from your application
docker image rm <image-name> - to delete image which is not in use
docker run -it --name <new_container> <base-image> /bin/bash to create a new container and run it from base image. (here above we had python as base image)
docker image rm <image-name> -f delete image which is in use forcefully
docker ps -a to see all the containers running
docker container rm <container-name> to delete container which is not running
docker container rm <container-name> -f to delete container forcefully which is running
docker system prune -a to delete all containers, images and caches.
docker compose up to run docker compose file and created image

From Setup to Deployment: Running a Flask App in Docker on Mac

Rajnish — Sat, 02 Nov 2024 10:26:40 +0000

Download Docker

Docker Images

Docker Images are the templates (blueprint) of the project
Images can not be updated it's read-only
It has Source code, Libraries, external dependencies, tools etc.

Docker Containers

Containers are the running instance of the Image
It runs independently on computer hence we can call it, it's an isolated process

Docker base Image or Parent Image

Example Python programming image which we can download from official website of Docker hub

How do we create Docker image

To create a Docker image, we write the details in a Dockerfile that contains instructions for building the image. When we build this Dockerfile, an image is generated, which we can then run as a container.

Now let's proceed with setup and run
After downloading docker desktop

search Python base image in docker hub pull it using Terminal or Docker Desktop
run using Terminal or Docker Desktop

docker run -it --name rajnish_python python /bin/bash

now go to Container in docker desktop and see if it's running.

Open Container and explore it more by checking python version

let's create a basic Python Flask web-app and run it through docker

either you can create a new web app or just clone my repository productivity

git clone https://github.com/rajnishspandey/productivity.git

Here I have created a project and it's in my local I want to create a new repository on github and push it from my Terminal

git init

~~in case you want to remove the git initialised you can run below command and do git init again to add.~~

~~rm -rf git~~

git add .

git commit -m 'Initial Commit'

I created a repository called productivity on github and will link it with my local/remote git

git remote set-url origin https://github.com/rajnishspandey/productivity.git

git push -u origin master

now let's build the app and copy all the files of our application to our container > docker build -t productivity-app .

command to check how many images we have in docker
run docker images in Terminal

we can see now new images is created in the docker

Now we have to run it through container

Click on run and configure the details

click on ports 5500:5000

it will redirect you to the browser and you should see the app running

This UI can be different as it's possible that the code is updated

Docker Command list from official site

Learn how to

- Share docker image on docker hub

- Deploy Flask app using docker Compose

"Happy Learning"

Buy me a coffee

some useful docker commands

docker images to check all the images
docker build -t <new-image-name>-app . to build an images from your application
docker image rm <image-name> - to delete image which is not in use
docker run -it --name <new_container> <base-image> /bin/bash to create a new container and run it from base image. (here above we had python as base image)
docker image rm <image-name> -f delete image which is in use forcefully
docker ps -a to see all the containers running
docker container rm <container-name> to delete container which is not running
docker container rm <container-name> -f to delete container forcefully which is running
docker system prune -a to delete all containers, images and caches.

Share files-Photos between Mac and GooglePixel

Rajnish — Sun, 27 Oct 2024 14:12:15 +0000

I have always been annoyed by the hassle of moving files between my Mac and Google Pixel (6A). I was looking for a reliable, safe, and fast tool that doesn't cost me anything.

After some research, I found a tool that exceeded my expectations in terms of speed and efficiency.

Here is how I set it up:

I have a Google Pixel 6A and a MacBook Air M1, so I needed to transfer files from my Mac to the phone. I expected that was going to be involved but managed to find a version for it on GitHub.

So I installed the utility, and ran a couple of tests.

Transferred files from MacBook to Pixel

Transferred files from Pixel 6A to MacBook

Follow these steps to get started:

GitHub Link
Open the Terminal on your Mac and execute the following command:
brew install --no-quarantine grishka/grishka/neardrop

You’re all set to go!

To send a file from your Mac, right-click on the file, choose the Share option, and select NearDrop.

On your Pixel, open the Files app and tap on Receive.

To share files from your phone to your Mac, just select the file, hit Share, and choose QuickShare. You’re ready to share!

Enjoy seamless file sharing!