Django + Celery + CPU/GPU + Tensorflow, Keras + Docker

karthik-ke — Thu, 05 Aug 2021 07:33:38 +0000

We held up a situation where we build tensorflow model using a GPU machine and calling the model in the same machine working fine as expected.

We wanted to consume this model in our application which runs under Django framework with the help of celery tasks, while calling the model in the application flow inside celery worker it didn't work or got hang up.

We tried following possible solution but nothing worked.

Increased the CPU machine number of cores and RAM size.
Created a AWS instance with GPU enabled and tried to consume the model. We haven't added configuration to use the GPU since tensorflow automatically detects GPU and use it for model prediction.
Since the Django application and celery running in docker container, we thought docker couldn't able to use the GPU automatically, so we changed our base image to tensorflow CPU/GPU as base docker image and tried to consume the model but failed :(.
We created a new API to consume the model but failed to get the output again.
We noticed from the beginning the model call is working fine without application flow but via application it's not working. so we tried to call the model through a python script by using multiprocessing and found out that with multiprocessing(since celery does that) it's not working.

The solution:

After we found that with multiprocessing tensorflow model predict was not working, we came through the following post which given a clear picture what's happening inside.

why tensorflow model predict not running under multiprocessing

We added the flow in our requirements.txt

eventlet

And in celery command while building the docker added --pool as below,

celery -A Proj worker -l info -Q Q1,Q2 --pool=eventlet -c 5

By this change we were able to call the model and get the prediction in the application flow without GPU enabled machine!!!

To get the prediction alone from a tensorflow model we don't need a GPU machine.

We spent a quite few days by doing many changes apart from what I mentioned above. Thought to share this so someone's day will be saved..

Happy Coding!!!

Go Language to go for beginners

karthik-ke — Thu, 17 Dec 2020 10:02:07 +0000

Overview:

Go language is designed & developed at Google (Go). It is a compiled language that is like C and CPP but with memory safety, structural typing, and CSP (Communicating Sequential Processes).
This documentation will not guide you to each element in Go but will give you a good idea to start with Go. Go’s key feature is concurrency.

Some software developed using Go:

Docker
Kubernetes
Heroku

Go - Hello world:

We had traditional to practice any code, we start by writing a hello world sample code. We go by the same,

For installation and get started: Go

Sample code:

As I referred earlier Go influenced by C, Go code start executed from the main function.

Unlike C programming language if you want to use any in-built function you need to specify the package name before the function, here the Println function comes from fmt (format) package. The function definition is identified in Go with the keyword func.

All the functions and codes in Go should be under a package so that we can use the current package in another package (same as fmt in the above package-main).

Function open curly bracket should start with the same line of the function definition

Variables:

Variable creation and assigning value in Go in different ways as follows,

1. Declaring a variable:
var a int

Variable a created here without assigning value to it, the default value of a is 0 (int).

2. Declaring a variable and assigning value:
var a= 5

var is the keyword which is declaring variable a
5 is the value for variable a var a int = 5
In the above example same, we are assigning value 5 to the variable a but mentioning its type int. Here specifying type is optional, but when it comes to declaration alone it's mandatory.

3. Declaring a variable and assigning value:
a := 5

Here creation and assigning a value for a is happening by using the operator :=.

Variables available in Go:

Bool
String
int, int8, int16, int32, int64
uint, uint8, uint16, uint32, uint64
float32, float64

Creating a variable or import any package and not using anywhere in your Go throws error unlike other languages (Python, Java, C, CPP).

Loops:

Go have only for loop unlike other languages Go does not have do while, while loops in it. When it comes to loops, we need to specify three things variable value assignment, condition, incrementation.

1. Infinite loop:

In this type, we do not specify any of the three-parameter we mentioned above, so it becomes an infinite loop, useless though I want to mention this weird functionality availability.

2.Variable assignment, condition, increment/decrement in different areas:

Go is not like C language always specify assignment, condition, increment in one place, Go allows these three in different places as well.

3.Traditional pattern:

Assignment, condition, and increment/ decrement at loop initialization.

Functions:

Go language function declaration is done by using the key word func.
1. Function with no return value:
We can able to create a function without any return. Just to mention function without return type is possible in Go.

2. Function with multiple parameters & one return:

In the below snippet add function takes two-parameter and adding and returns a single value. Unlike other languages like python, we need to specify the type of return here in Go.

As we discussed earlier variable declaration and assignment happening at res: = add (2,3).

3. Function with multiple parameters & multiple return:

Some languages do not support multiple return values but Go gives that feature. Refer to the below snippet.

The above add function has two input values a, b as integer and sum_val, sub_val as output, and their return also mentioned. In the function we can just give a return it will work in Go.

If you want to use your own function in a package outside of the other package you need to create that function with a capital letter if you are creating a function with the small case you can’t use that outside of the package.
func inside_package () --> only accessible inside a package
func Outside_package () --> accessible by other packages as well.

Conditional statements in Go:

Go has two conditional statements if-else and switch. It is typically the same as C will be seeing the example so that we can have a better understanding.

if else:

One thing to be noted herein Go we start else if or else block and end of the if block itself.

Switch:

Same as C switch comes with default when condition not falling in any of the cases.

That all I feel basics to start with Go… Thanks for your time... Thoughts!? Please comment It

:) :) :)

DEV Community: karthik-ke

Django + Celery + CPU/GPU + Tensorflow, Keras + Docker

Go Language to go for beginners