The latest articles on DEV Community by Charly Wargnier (@datachaz). https://dev.to/datachaz https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F362015%2Faff394d8-419f-4c1c-94de-37129cdbb4f4.jpg https://dev.to/datachaz en Charly Wargnier Mon, 22 Feb 2021 11:52:08 +0000 https://dev.to/datachaz/introducing-wiki-topic-grapher-43gm https://dev.to/datachaz/introducing-wiki-topic-grapher-43gm <p>Leverage the power of Google Cloud Natural Language to retrieve entity relationships from Wikipedia URLs or topics!</p> <ul> <li>Get interactive graphs of connected entities </li> <li>Export results with entity types and salience to CSV!</li> <li>Export results with entity types and entity salience to CSV!</li> </ul> <p>💻 Try the app: <a href="https://lnkd.in/dkfuhed">https://lnkd.in/dkfuhed</a><br> 🧵 Twitter thread: <a href="https://lnkd.in/dji2a4s">https://lnkd.in/dji2a4s</a></p> <p><strong>Use cases</strong></p> <p>Many cool use cases! </p> <ul> <li>Research a topic then get entity associations that exist from that seed topic</li> <li>Map out related entities with your product, service or brand</li> <li>Find how well you've covered a specific topic on your website Differentiate your pages!</li> </ul> <p>This is not just an SEO tool! You can map <em>any</em> types of relationship from a given Wikipedia seed URL or topic. E.g someone from the community already mapped out relationships in structural molecular biology! 🤓🧠</p> <p><strong>Stack</strong> </p> <p>About the stack, it's 100% Python! 🐍🔥</p> <ul> <li>@GCPcloud Natural Language API</li> <li>PyWikibot</li> <li>Networkx PyVis</li> <li>@streamlit</li> <li>Streamlit Components -&gt; streamlit.io/components</li> </ul> <p><strong>⚒️ Still To-Do’s</strong></p> <p>💰 Add a budget estimator to get a sense of @GCPcloud costs!<br> 🌍Add a multilingual option (currently English only)<br> 📈Add on-the-fly physics controls to the network graph<br> 💯Add Google KG #API to add more data (scores, etc.) (ht <a class="comment-mentioned-user" href="https://dev.to/loukilaymen">@loukilaymen</a> )</p> <p>That code currently lays in a private repo. I should be able to make it public soon for you to re-use it in your own apps and creations! I just need to clean it a tad, remove some sensitive bits, etc.</p> <p><strong>🙌 Shout-outs</strong></p> <p>Kudos to @jroakes for the original script. Buy that man a 🍺 for his sterling contributions! -&gt;<br> paypal.com/paypalme/codes…</p> <p>Kudos also to fellow @streamlit Creators:</p> <p><a class="comment-mentioned-user" href="https://dev.to/napoles3d">@napoles3d</a> who told me about the PyVis lib! 🔥<br> <a class="comment-mentioned-user" href="https://dev.to/andfanilo">@andfanilo</a> /<a class="comment-mentioned-user" href="https://dev.to/christianklose3">@christianklose3</a> for their precious advice! 🙏</p> <p><strong>💲 Beware on costs!</strong> </p> <p>It can get expensive quickly with that Google Natural Language API!</p> <p>Monitor your costs via the GCP console regularly and/or put quotas to tame that G beast! I'm planning to add a budget estimator pre-API calls. Should come handy. </p> <p><strong>Feedback and support</strong></p> <p>Wiki Topic Grapher's still in Beta, with possible rough edges! Head-off to my Gitter page for bug reports, questions, or suggestions.</p> <p>This app is free. If it's useful to you, you can buy me a ☕ to support my work! 🙏</p> <p>▶️ buymeacoffee.com/cwar05</p> <p>That's all, folks. Enjoy! </p> <p>Charly</p> machinelearning googlecloud nlp datascience