DEV Community: chetan jain

How To get a job in IIT kanpur in this quarantine?

chetan jain — Thu, 21 May 2020 10:59:34 +0000

This video is in Hindi.

How to deploy your Python Package(library) in Production?

chetan jain — Thu, 09 Apr 2020 12:17:56 +0000

Package or Library

Package or library is a collection of logical related classes, functions and methods that allows you to perform many actions without writing your code.
We can reuse code whenever we want from the library. We don't have to write it again. A library can be installed from the python package manager like pip (preferred installer program) or conda.

If you want to install any python package then just go on anaconda prompt and type

pip install <package name>

Pip install the package from the python package index (PyPI). It is also known as the third party library repository for python. It hosts all python library in the form of archives called 'sdist' (Source Distributions) or pre-compiled wheels.

So if we want our package in production so we have to upload our package to PyPI. First, we have to check whether our package is working fine or not.

So first upload it on test.PyPI and then if everything goes well we will upload it on main PyPI repository.

Steps to Post your code on test.PyPI repository.

First make your package ready including init.py file.
Second inside the package along with all modules folder you have to create a setup.py file.

# In the setup.py file 
from setuptools import setup

setup(name= <name of your package>, # NOTE it should be unique.
      version=0.1,
      description='Guassian and binomial distributions', # Small descriptions.
      author = 'Chetan jain' , # Optional in test.PyPI.
      author_email = 'chetanjain645@yahoo.com', # Optional in test.PyPI.
      license ='MIT', # Optional in test.PyPI.
      packages=['distributions'], #include all package in the list.
      zip_safe=False) # It safe your file to directly install from the zip.

Third install twine library from the anaconda prompt.

pip install twine

Now we are ready to upload package on test.PyPI repository.

Open Cmd and go to package folder and Type commands.

python setup.py sdist

twine upload --repository-url https://test.pypi.org/legacy/ dist/*

Now just type your email and password for test.PyPI.org.
Now try to install it. If everything goes well then you made it.

pip install --index-url https://test.pypi.org/simple/ <your package name>

If you made it install in your system now we are ready to upload your package on PyPI.org.

Uninstall your test package which you install

pip uninstall <your package name>

Update setup.py

from setuptools import setup

setup(name= <name of your package>, # NOTE it should be unique.
      version=0.1,
      description='Guassian and binomial distributions', # Small descriptions.
      author = 'Chetan jain' , # Author name .
      author_email = 'chetanjain645@yahoo.com', # Author email
      license ='MIT', # Choose a valid license.
      packages=['distributions'], #include all package in the list.
      zip_safe=False) # It safe your file to directly install from the zip.

Choose a license from this website and make a new file license.txt along with setup.py file and copy your license detail from the website and paste it on license.txt file.
Make a README.md file and tell about your python library in that.
Make a setup.cfg file and paste this.

[metadata]
description-file = README.md

Now we are all set. Now just type the following command.

twine upload dist/*

Now try to install it.

pip install <your package name>

If this goes well.
Congratulations you made it so far and uploaded your package to the PyPI repository.

If you don't know about anaconda distributions go to this website.

Note that pypi.org and test.pypy.org are two different websites. You'll need to register separately at each website. If you only register at pypi.org, you will not be able to upload to the test.pypy.org repository.
Also, remember that your package name must be unique. If you use a package name that is already taken, you will get an error when trying to upload the package.

Thanks for reading.

List in Python

chetan jain — Wed, 08 Apr 2020 18:44:59 +0000

List

A list data structure is a collection of heterogeneous data elements (such as numbers or characters—or even other data structures) that are structured in some way, for example, by numbering (indexing) the elements. The most basic data structure in python is called list.

List is one of the Sequence Data structure.
List is a collection of items (Strings, integers or even other lists).
Lists are enclosed in [ ].
Each item in the list has an assigned index value.
Each item in a list is separated by a comma.
Lists are mutable, which means they can be changed.

List Creation

emptyList = []
lst = ['one', 'two', 'three', 'four'] # list of strings
lst2 = [1, 2, 3, 4] #list of integers
lst3 = [[1, 2], [3, 4]] # list of lists
lst4 = [1, 'ramu', 24, 1.24] # list of different datatypes

List Length

lst = ['one', 'two', 'three', 'four']
#find length of a list
print(len(lst)) # this will return 4

List Append

lst = ['one', 'two', 'three', 'four']
lst.append('five') # append will add the item at the end
print(lst) # print ['one', 'two', 'three', 'four', 'five']

List Insert

# Syntax: lst.insert(x, y) 
lst = ['one', 'two', 'four']
lst.insert(2, "three") # will add element y at location x
print(last) # print ['one', 'two', 'three', 'four']

Append vs Insert

Append only add an element at the end of the list but insert add an element at any position in the list.

List Remove

# Syntax: lst.remove(x) 
lst = ['one', 'two', 'three', 'four', 'two']
lst.remove('two') #it will remove the first occurrence of 'two' in a given list
print(last) # print ['one', 'three', 'four', 'two']

List Append & extend

lst = ['one', 'two', 'three', 'four']
lst2 = ['five', 'six'] 
lst.append(lst2) # append 
print(lst) # print ['one', 'two', 'three', 'four', ['five', 'six']]

#extend will join the list with list1
# Syntax: lst.extend(lst2)
lst.extend(lst2) # extend
print(lst) # print ['one', 'two', 'three', 'four', 'five', 'six']

List Delete vs Pop

#del to remove item based on index position
lst = ['one', 'two', 'three', 'four', 'five']
del lst[1] # remove 'two' from the list
print(lst) # print ['one', 'three', 'four', 'five']

#or we can use pop() method
a = lst.pop(1) # this will remove 'three' because 'two' is already deleted
print(lst) # print ['one', 'four', 'five']

List related Keywords in Python

in

#keyword 'in' is used to test if an item is in a list.
lst = ['one', 'two', 'three', 'four']
if 'two' in lst:
    print('AI') # print 'AI' because 'two' is present in the list.

#keyword 'not' can combined with 'in'
if 'six' not in lst:
    print('ML') # print 'ML' because 'six' is not present in the list.

List Reverse

#reverse will be reversed the entire list
lst = ['one', 'two', 'three', 'four']
lst.reverse() 
print(lst) # print ['four', 'three', 'two', 'one']

List Sorting

The easiest way to sort a list is with the sorted(list) function.
That takes a list and returns a new list with those elements in sorted order.
The original list is not changed.
The sorted() optional argument reverse=True, e.g. sorted(list, reverse=True), makes it sort backwards.

#create a list with numbers
numbers = [3, 1, 6, 2, 8]
sorted_lst = sorted(numbers) 
print("Sorted list :", sorted_lst) # print [1, 2, 3, 6, 8] 
# (original list remained unchanged)

#print a list in reverse sorted order
print("Reverse sorted list :", sorted(numbers, reverse=True)) 
# print [8, 6, 3, 2, 1]

#sort the list and stored in itself
numbers.sort() # this will change the original list [1, 2, 3, 6, 8]
print(numbers) # print [1, 2, 3, 6, 8]

The list is robustly used in python so please read and I will add some more things of a list in next post like slicing and list comprehension and some more thing.
Till then bye.
Thank you for reading

What is Version Control System?

chetan jain — Tue, 24 Mar 2020 11:37:07 +0000

Version Control System

Version Control System's are the software which is continuously seeing in your code and whenever you made a single change in your code they report it and took a snapshot and save it in their memory.
So the basic work of VCS(version control system) is the management of our code over time.
VCS keeps track of each modification you made it in your code. If you want to revert back in the code.

example
- If you add some code in your project and that code gives you an error in your project and you need to go back to the previous position so you can compare your code with the help of VCS so that you will know what you add and delete in your project and revert back to the previous position.

USES

VCS protects your source code from unattended access in your projects.
VCS helps developers to work simultaneously on the same project. If VCS is not there then it is almost impossible to collaborate on the same project until and unless the person is sitting next to you.
VCS follows a tree data structure so the software made one node per participant and the changes made by the participant goes downside of the participant node as a child node that will help us to track the changes made by each participant in the project.
VCS take backups of our project if by chance we delete anything which is mandatory to run our project so we can download or pull that from the repository(project folder on the server of VCS).

Top 10 Version Control System

Git
GitLab
BeanStalk
PerForce
Apache Subversion
AWS CodeCommit
Microsoft Team Foundation Server
Mercurial
CVS Version Control (Concurrent Versions System)
BitBukcet

Each has its own advantages and disadvantages but the most preferred by the community is Git.

How to install Git?

Follow the instruction here

How to Deploy the Machine Learning Model on AWS EC2 Instance?

chetan jain — Sat, 21 Mar 2020 23:20:27 +0000

First of all the Framework which I used is the flask, so first thing check your model whether it is running or not in your local environment.

Run anaconda prompt and go on the appropriate path of your model and type

python model.py

Then the output must look like this

Now after verifying on a local machine its time to go on an AWS management console.

Open EC2.
Then Click on Running Instances.
Then Launch Instance.
Then Search Ubuntu Because it is free so you can use that for your personal projects. but In companies, they use premium server so that so many things are pre-installed they will not do it manually but we have to do it manually.

Then it might look like this

After that

Choose a t2-micro version of Ubuntu server for the free tier.
Then click on review and launch.
Again click on launch. Then a pop-up will show up like this.

Here you will do

Create a new key pair and give it a name and download that keypair and put inside your project folder.

That ''' .pem ''' extension file will help us to interact with the server which is running on EC2 instance.

Now click on Launch Instance.

Now you need to download 3 software

Putty - A ssh client to interact with the server.
Download here
Putty gen - For converting that ''' .pem ''' file into private key.
Download here
WinSCP - For sending your all-important files to the server.
Download here

Now open putty gen

Load yours.pem file.
Generate your private key. (Convert .pem to .ppk file)
And save that on your project folder.

Now copy your hostname from EC2

Go to EC2.
Open Running Instances.
Right-click on Instance which we are working and click on connect.

And Copy that.

Now open your winSCP

Paste your Hostname in hostname column.

Click on Advanced.
Now click on Authentication and browse your private key (.ppk) file.

Now click on log-in and press yes on the pop-up.
Now drag your appropriate files from your local machine to Ubuntu server.

Now open Putty

Paste your Hostname.
Now click on ssh expand it and click on Auth.
Now browse the private key and save the session.

Now click on open.
Now type Ubuntu in login as.
Now you are in the ubuntu server panel.

Here now you have to update and install pip and appropriate libraries respectively to run your project.
run this command as you enter inside your server terminal.

sudo apt-get update && sudo apt-get install python3-pip

Now this command will manage your all issues regarding '''pip3 installer'''

Make sure in your

app.py or model.py

your host and port must be as is this.

host='0.0.0.0' and port=8080

Now in the Ubuntu server

pip install -r requirements.txt

As your installation of the libraries completed.
Now run

Python3 app.py or model.py

Now open the browser

Go to search bar.
Now paste your HostName followed by port 8080.

Like this.
Now enjoy, Your model is successfully deployed on EC2 Instance.

Extra tip, For running the program even after the terminal is closed or shut down the system.

nohup Python3 app.py or model.py &

Thank you so much for reading and visiting this.