Jupyter Notebook is a fantastic tool for data exploration. It combines markdown text, executable code, and output all inside a single document se...
For further actions, you may consider blocking this person and/or reporting abuse
I like this concept! Definitely going to keep this in the back of my mind.
Regarding sharing notebooks & the problem of having them run locally, would Azure Notebooks be something that could help in this case? notebooks.azure.com
Azure Notebooks are in the same bus as Google Collaboratory. They are both hosted Jupyter Notebook service, great for sharing/collaboration in the team. The problem with DevOps use case it is requires,
So if we are using Azure/Google Notebooks, we need to somehow allow their servers access to our infrastructure. This is almost impossible unless you allow your infra to be publicly accessible from the web (big security hazard). If there is some feature like your Azure/Google Notebooks can access your Azure/GCP infra then I'm not aware of it.
Storing your credentials on a third party hosted service is a bad idea. Even if their intentions are best they could be a victim of attack.
Because of these self hosted Notebook setup that allows sharing is the only way I see it being used in DevOps.
python.org/dev/peps/pep-0257/
Sure :)
Thanks for the link.
You could use AWS Sagemaker - these are basically AWS hosted Juypter notebooks that reduce the problems with single user problem and makes sharing easier.
Yes, but there are 2 limitations for our use case.
Sagemaker Jupyter is running on single EC2 instance and all notebooks are stored on the disk of that EC2 instance. If that instance dies for some reason, you can't access your Jupyter and all runbooks are gone.
Sagemaker is optimized for ML/Data science experiments. There is absolutely nothing that helps with DevOps use cases. Simple things like polling cloud watch graphs in Jupyter can be painful without some library help.
I am solving both these with nurtch.com
It's a cluster Jupyter setup with S3 as backend for storing Notebooks. I built a Rubix library that makes performing DevOps tasks easy in the notebook: docs.nurtch.com/en/latest/rubix-li...
Thanks David :)