DEV Community

Joe Hobot
Joe Hobot

Posted on

I am DevOps Engineer Working With K8s A Lot, Ask Me Anything!

I will try to answer most of your questions around DevOps or Kubernetes - Been now working on K8s for almost 2 years and have nothing but love for it.

Oldest comments (40)

Collapse
 
ben profile image
Ben Halpern

How has the kubernetes ecosystem evolved in the past two years?

Collapse
 
joehobot profile image
Joe Hobot

I think because it has been hyped up a lot and many companies got into "new shiny thing", now you have more resources to work from.

The support online has been amazing and I am talking about issues that have not been been out for even few hrs. There are 2-3 weekly k8s meetings I usually go to one a week or watch it on youtube k8s channel, then there is slack channel, /r/kubernetes and bunch of more sites.

People hear k8s fixes a lot of things, but in really anything can fix things if you put work into it, except for the part that k8s has ways of doing things differently.

The more time you spend in k8s of doing some fine-tuning and wanting "special" features , it gets complex with the time especially if you want all 100% automated.

In other words it's a beast that needs lots of food.

Collapse
 
maharsh007 profile image
Maharshi Choudhury

What is the cost of running kubernetes?

Collapse
 
joehobot profile image
Joe Hobot

That depends on what you want to run. My smallest k8s cluster of 1 nodes 1 master was $7

Collapse
 
slevesque profile image
Sylvain Lévesque

How long do it takes to get the nuts and bolts of K8s and be cozy with it ?

Collapse
 
joehobot profile image
Joe Hobot • Edited

Depending on how much time you devote to it and what types of things you want to do. I can tell you that the more you go deeper into it the more complex it gets.

I felt comfortable within about 5-6 months, but even now close to 2y working with it, there are just things that you still find out to be more useful than what you are accustomed to.

In general I would say 2-3hrs a day * 3-4 months = you get to the point that you could create a k8s cluster with no problem and install containers etc. But to get to the point where you work with multi cluster , horizontal/vertical scaling, network policies, etc etc.. that just takes out more time.

Collapse
 
slevesque profile image
Sylvain Lévesque

Thanks. It gives me a good idea.

Collapse
 
nicolus profile image
Nicolus

I have a confession to make : My first thought when reading the title was "Why would anyone use an Athlon64 in a production server in 2019" ?

Collapse
 
joehobot profile image
Joe Hobot

LoL!

Collapse
 
garicchi profile image
garicchi • Edited

how did you develop containers in local machine? i think kubernetes is too big platform for writing application code with developing containers.

Collapse
 
garfbradaz profile image
Gareth Bradley

Minikube :)

Collapse
 
joehobot profile image
Joe Hobot • Edited

Are you looking for to develop a container or container that would work with K8s? Say you integrate it with helm.

If it’s just working with containers then a simple docker is sufficient to work on your local machine . But as Gareth below mentions, minikube is good way to start locally if you want to have that feeling of how would it work on your K8s infrastructure. Also there are lightweight K8s. When I get off the phone I’ll send you a link.

How did I develop?
Well early on when I started I was using minikube because I did not want to mess around with extras around lab K8s but now that it’s all pretty much templated and have multi cluster environments I just use K8s.

Update: Lightweight K8s k3s.io/

Collapse
 
garicchi profile image
garicchi

thank you so much!

Collapse
 
flopi profile image
Flo Comuzzi

At what point would you say Kubernetes is worth the investment for an organization?

Collapse
 
joehobot profile image
Joe Hobot

Thats up to the organization and what services they want to provide. K8s can be expensive if it's not done right - especially if you don't have people that are knowledgeable about k8s already.

K8s is easy to install and works with but once you dig deeper its much more complex than you can imagine but it works really good. I think most of the time spent is automating things because if you do one offs and don't either document it, there is really no point of having k8s just because its such a large orchestration tool.

Now say you have 40-50 docker containers that are currently running on xyz, I think even with 10-15 containers and small k8s cluster would be a worth an investment. For an example, say you are running 2 wordpress sites, sure all of that can be containerized, but do you really need k8s to do all of that? No! But what if you are a company that wants to expand from 2 wordpress sites and is providing some wordpress hosting?

That is where k8s could come great to play because you can duplicate things very easly and do canary deploys with 0 downtime.

All in all, if you have not many applications to containerize it, by the time you learn k8s and work with it full on mode, it might not be worth it. As said above, I seen people run k8s cluster for 1 wordpress site. Why? I don't know! Because its cool? Ok..

Collapse
 
predatorcoderr profile image
Gautam

Resources for learning K8?

Collapse
 
joehobot profile image
Joe Hobot

There is tons of resources out there, while me lately I just go onto kubernetes.io to get some specs and resources for someone that just starts that site is bit overwhelming.

But if you want all of the above, this google sheet contains everything you need to know

kubernetes resources google sheet

Collapse
 
abhikhatri profile image
Abhi Khatri

I'm a fullstack dev and always enjoyed working with servers and just started learning devOps, as devOps yourself what path would you recommend and some general best practices that can help in the long run.

Thanks ❤️

Collapse
 
joehobot profile image
Joe Hobot

I think this post I wrote sums it pretty much up.

Collapse
 
nirebu profile image
Nicolò Rebughini • Edited

Hi, I'm a sysadmin working with traditional VM clusters. In your opinion, what would be the biggest selling point of moving towards containers and later on on K8s? And also, what would be the biggest drawback?

Thanks!

Collapse
 
joehobot profile image
Joe Hobot

Nicolo,

It really all depends on your business and applications you are working on. Now for sysadmins for an example instead of having say some vm with full blown OS like Ubuntu 18.04 and that only does some minimal jobs like cron jobs or parsing data, such things can be converted into a container that are easier to manage than patching, upgrading installing diff tools on Ubuntu + working on an applications that are tied to that VM. So for that alone I think its a good selling point because you are taking away the OS layer and do only what your app should be doing. But then there is something like lambda functions where it gets even better , you run just a code vs a container.

The biggest drawback I think its the stateless applications and databases, such things are OK to have on k8s cluster and even containerize it, however the container and any orchestration infrastructure is not fully there yet and if it is, it can be unstable and not worth it. So if you are looking for a full fledged speeds and latency minimization a VM Cluster or on-prem systems is better because you are minimizing the hops in network..

Another one is the troubleshooting, when shit goes down, and if you are not experienced you could be looking into 10-15 different things what went wrong. On vm cluster you look at only 4-5 things of failures. OS/Storage/Network/Application

Collapse
 
nirebu profile image
Nicolò Rebughini

Thanks Joe! I was exploring the container/Docker world in the last few weeks, and I'm glad to see that your opinion sort of resonates with the one I was forming.

I'm already looking at specific cases where containers would be more efficient than the usual VM approach, like small python apps and such. But, and that's a big but, the majority of what I have to deal with are database clusters, and the ephemeral nature of containers had me thinking that would be really hard to containerise DB clusters, especially ones with sharding and replicas (take this with a grain of salt because I'm a Docker noob).

Thread Thread
 
joehobot profile image
Joe Hobot

Databases in containers is a young fish. Maybe in few years where stability and speed comes up to the par but nothing will beat latency and transactions like a self/cloud hosted server. While I do run some apps and have contsinerized databases like MongoDB etc, been burned few times by simply “don’t touch it” lol.

Yeah if you can offload some of hosts/apps with containers that’s great start.

Collapse
 
bjornaligoransson profile image
Björn Ali Göransson

What do you think about the release pace of k8s in relation to cloud vendors' support and specifically Azure, is it kinda fast-paced? Should we be worried that our current version of k8s is phased out too soon?

Collapse
 
joehobot profile image
Joe Hobot • Edited

Yes and no. Assuming you are talking about managed K8s by Cloud Providers vs hosting and managing it yourself?

I think release pace is actually good because you know that things are being fixed and new features are being added. That said in personal experience being on release 1.9.x vs 1.13.x is not good because there is a large overlap in upgrades and most importantly is the security. As far as cloud vendors being one or two releases back is somewhat painful but at least you know that releases they put out are stable and work with their infrastructure. But say you have self managed K8s, to test all of the things with your app and infrastructure could take you month or two especial If you are working with many layers of networking and storage infrastructure.

Hope that helps. Feel free to ask more if this was not enough explained as I can go in greater details too :)