The latest articles on DEV Community by Bilal Khan (@bkkaggle). https://dev.to/bkkaggle https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F393157%2Fb98ca2b2-5a4d-4ac3-ac02-243df8e29846.png https://dev.to/bkkaggle en Bilal Khan Fri, 22 May 2020 20:19:14 +0000 https://dev.to/bkkaggle/pytorch-zoo-4nj4 https://dev.to/bkkaggle/pytorch-zoo-4nj4 <h2> My Final Project </h2> <p>My project was PyTorch Zoo, a PyTorch library that I made that contains a collection of useful libraries and tools to help reduce the amount of time people spend searching for high-quality implementations of commonly used machine learning modules and utilities. </p> <h2> Link to Code </h2> <div class="ltag-github-readme-tag"> <div class="readme-overview"> <h2> <img src="https://res.cloudinary.com/practicaldev/image/fetch/s--vWogaON8--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_880/https://practicaldev-herokuapp-com.freetls.fastly.net/assets/github-logo-28d89282e0daa1e2496205e2f218a44c755b0dd6536bbadf5ed5a44a7ca54716.svg" alt="GitHub logo"> <a href="https://github.com/bkkaggle"> bkkaggle </a> / <a href="https://github.com/bkkaggle/pytorch_zoo"> pytorch_zoo </a> </h2> <h3> A collection of useful modules and utilities (especially helpful for kaggling) not available in Pytorch </h3> </div> <div class="ltag-github-body"> <div id="readme" class="md"> <h1> Pytorch Zoo </h1> <h4> A collection of useful modules and utilities (especially helpful for kaggle) not available in <a href="https://pytorch.org" rel="nofollow">Pytorch</a> </h4> <p> <a href="https://forthebadge.com" rel="nofollow"> <img src="https://camo.githubusercontent.com/2fb0723ef80f8d87a51218680e209c66f213edf8/68747470733a2f2f666f7274686562616467652e636f6d2f696d616765732f6261646765732f6d6164652d776974682d707974686f6e2e737667" alt="forthebadge"> </a> <a href="https://lgtm.com/projects/g/bkkaggle/pytorch_zoo/context:python" rel="nofollow"> <img alt="Language grade: Python" src="https://camo.githubusercontent.com/f2b8b6b9bae0099518af271e09606465b4af58c7/68747470733a2f2f696d672e736869656c64732e696f2f6c67746d2f67726164652f707974686f6e2f672f626b6b6167676c652f7079746f7263685f7a6f6f2e7376673f6c6f676f3d6c67746d266c6f676f57696474683d3138"> </a> <a href="https://lgtm.com/projects/g/bkkaggle/pytorch_zoo/alerts/" rel="nofollow"> <img alt="Total alerts" src="https://camo.githubusercontent.com/64b7abbbb69f47b1829cabe68828138601596b6f/68747470733a2f2f696d672e736869656c64732e696f2f6c67746d2f616c657274732f672f626b6b6167676c652f7079746f7263685f7a6f6f2e7376673f6c6f676f3d6c67746d266c6f676f57696474683d3138"> </a> <a href="https://github.com/prettier/prettier"> <img src="https://camo.githubusercontent.com/687a8ae8d15f9409617d2cc5a30292a884f6813a/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f636f64655f7374796c652d70726574746965722d6666363962342e7376673f7374796c653d666c61742d737175617265" alt="code style: prettier"> </a> <a href="https://opensource.org/licenses/MIT" rel="nofollow"> <img src="https://camo.githubusercontent.com/3ccf4c50a1576b0dd30b286717451fa56b783512/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f4c6963656e73652d4d49542d79656c6c6f772e737667" alt="License: MIT"> </a> <a href="http://makeapullrequest.com" rel="nofollow"> <img src="https://camo.githubusercontent.com/a34cfbf37ba6848362bf2bee0f3915c2e38b1cc1/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f5052732d77656c636f6d652d627269676874677265656e2e7376673f7374796c653d666c61742d737175617265" alt="PRs Welcome"> </a> <a href="https://github.com/bkkaggle/pytorch_zoo/issues"> <img alt="GitHub issues" src="https://camo.githubusercontent.com/ed25d93579d8fa6825e38b8f41479485fa5af941/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f6973737565732f626b6b6167676c652f7079746f7263685f7a6f6f2e7376673f7374796c653d666c6174"> </a> <a href="https://github.com/bkkaggle/pytorch_zoo/pulls"> <img alt="GitHub pull requests" src="https://camo.githubusercontent.com/390314d48b76a2bca1de773fcdd1c9c6e46c532c/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f6973737565732d70722f626b6b6167676c652f7079746f7263685f7a6f6f2e737667"> </a> <a href="https://github.com/bkkaggle/pytorch_zoo/issues"> <img alt="GitHub last commit" src="https://camo.githubusercontent.com/32d65677fd917148d6530485c8b907473a7a3c74/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f6c6173742d636f6d6d69742f626b6b6167676c652f7079746f7263685f7a6f6f2e737667"> </a> </p> <p> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#overview">Overview</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#installation">Installation</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#documentation">Documentation</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#contributing">Contributing</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#authors">Authors</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#license">License</a> • <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#acknowledgements">Acknowledgements</a> </p> <div> <a rel="noopener noreferrer" href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/./screenshot.png"><img src="https://res.cloudinary.com/practicaldev/image/fetch/s--3FR4GpDn--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_880/https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/./screenshot.png"></a> </div> <p><strong>Made by <a href="https://github.com/bkkaggle">Bilal Khan</a> • <a href="https://bilal.software" rel="nofollow">https://bilal.software</a></strong></p> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#installation">Installation</a></li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#documentation">Documentation</a> <ul> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#notifications">Notifications</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#sending-yourself-notifications-when-your-models-finish-training">Sending yourself notifications when your models finish training</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#viewing-training-progress-with-tensorboard-in-a-kaggle-kernel">Viewing training progress with tensorboard in a kaggle kernel</a></li> </ul> </li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#data">Data</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#dynamicsamplersampler-batch_size32">DynamicSampler(sampler, batch_size=32)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#trim_tensorstensors">trim_tensors(tensors)</a></li> </ul> </li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#loss">Loss</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#lovasz_hingelogits-labels-per_imagetrue">lovasz_hinge(logits, labels, per_image=True)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#diceloss">DiceLoss()</a></li> </ul> </li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#metrics">Metrics</a></li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#modules">Modules</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#squeezeandexcitationin_ch-r16">SqueezeAndExcitation(in_ch, r=16)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#channelsqueezeandspatialexcitationin_ch">ChannelSqueezeAndSpatialExcitation(in_ch)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#concurrentspatialandchannelsqueezeandchannelexcitationin_ch">ConcurrentSpatialAndChannelSqueezeAndChannelExcitation(in_ch)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#gaussiannoise01">GaussianNoise(0.1)</a></li> </ul> </li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#schedulers">Schedulers</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#cyclicalmomentumoptimizer-base_momentum08-max_momentum09-step_size2000-modetriangular">CyclicalMomentum(optimizer, base_momentum=0.8, max_momentum=0.9, step_size=2000, mode="triangular")</a></li> </ul> </li> <li> <a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#utils">Utils</a> <ul> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#notifyvalue1-notification-title-value2-notification-body-key">notify({'value1': 'Notification title', 'value2': 'Notification body'}, key)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#seed_environmentseed42">seed_environment(seed=42)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#gpu_usagedevice-digits4">gpu_usage(device, digits=4)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#n_paramsmodel">n_params(model)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#save_modelmodel-fold0">save_model(model, fold=0)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#load_modelmodel-fold0">load_model(model, fold=0)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#saveobj-objpkl">save(obj, 'obj.pkl')</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#loadobjpkl">load('obj.pkl')</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#masked_softmaxlogits-mask-dim-1">masked_softmax(logits, mask, dim=-1)</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#masked_log_softmaxlogits-mask-dim-1">masked_log_softmax(logits, mask, dim=-1)</a></li> </ul> </li> </ul> </li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#contributing">Contributing</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#authors">Authors</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#license">License</a></li> <li><a href="https://raw.githubusercontent.com/bkkaggle/pytorch_zoo/master/#acknowledgements">Acknowledgements</a></li> </ul> <h2> Installation</h2> <p>pytorch_zoo can be installed from pip</p> <pre><code>pip install pytorch_zoo </code></pre> <h2> Documentation</h2> <h3> Notifications</h3> <h4> Sending yourself notifications when your models finish training</h4> <p>IFTTT allows you to easily do this. Follow <a href="https://medium.com/datadriveninvestor/monitor-progress-of-your-training-remotely-f9404d71b720" rel="nofollow">https://medium.com/datadriveninvestor/monitor-progress-of-your-training-remotely-f9404d71b720</a> to setup an IFTTT webhook and get a secret key.</p> <p>Once you have a…</p> </div> </div> <div class="gh-btn-container"><a class="gh-btn" href="https://github.com/bkkaggle/pytorch_zoo">View on GitHub</a></div> </div> <h2> How I built it (what's the stack? did I run into issues or discover something new along the way?) </h2> <p>I built this project using Python and Pytorch, a commonly used library used for training neural networks. I open-sourced the project on GitHub and you can download it from PyPi by running the command <code>pip install pytorch_zoo</code></p> octograd2020