AIM Weekly - 26 August 2024

Tim Spann @PaaSDev
Milvus - Attu - Feder - GPTCache - VectorDB Bench
https://linktr.ee/Milvusio

TL;DR --- But you should #152 - 26-August-2024

📎 Multi-modal RAG with CLIP, LLama3, Milvus

🤖 Using NVIDIA NIM Inference Microservices with Milvus (Is that NIM-M?)

📊 AI Camp Pose Estimation Slides

📱 .NET Conf with AI and Milvus

🖥️ RAG Handbook

📢 Compression for dataframes

🖥️ NVIDIA Breakthrough!
📱 Understanding Boolean Retrieval Models

Upcoming

📼 Sept 5: Virtual: Structured Document Extraction At Scale (Webinar)
🗽 Sept 18: NYC: Unstructured Data Meetup NYC

🚕 Oct 23: NYC: Unstructured Data Meetup NYC

📡 Oct 27-29: Raleigh, NC: All Things Open

🔥 Milvus 2.4.9 (Milvus 2.5 is soon)

Last Week

🖥️ AI Camp Meetup @ MS Reactor Times Square NYC
🌃 Unstructured Meetup @ SAP Hudson Yards NYC
🌆 What's in the Air Tonight, Mr. Milvus. (Air Quality + Vector Database + RAG)

Apps, Demos, Examples, Models, Notebooks and Projects

🚀 Air Quality Applications & Notebook by @ Tim Spann
🤖 PHI-3.5 Mini Instruct supports 128K context length
🤖 PHI-3.5 Mini Instruct Vision for vision
🤖 PHI-3.5 Mini Instruct MoE Mixture of Experts edition
💰 Raspberry Pi 5 + AI Kit + Milvus Demo do cool Edge AI/DB on the cheap
💰🐦 Easy Data Prep Kit from IBM - this is cool

Connect with Us

• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external
• https://www.youtube.com/@FLaNK-Stack
• https://medium.com/@tspann/subscribe
• https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #152

Join us at the next meetup in September.

Featured Tool

Check out the RAGBuilder Github repo: https://github.com/KruxAI/ragbuilder

Webinar Coming

https://zilliz.com/event/challenges-in-structured-doc-data-extraction-at-scale-with-llms

Tutorials

Learning RAG

https://zilliz.com/learn/RAG-handbook

https://zilliz.com/blog/multimodal-RAG-with-CLIP-Llama3-and-milvus

https://zilliz.com/learn/multimodal-RAG

https://zilliz.com/learn/exploring-openai-clip-the-future-of-multimodal-ai-learning

https://zilliz.com/blog/build-better-multimodal-rag-pipelines-with-fiftyone-llamaindex-and-milvus

https://zilliz.com/learn/explore-colbert-token-level-embedding-and-ranking-model-for-similarity-search

https://zilliz.com/learn/A-Beginner-Guide-to-Natural-Language-Processing

https://zilliz.com/learn/nlp-technologies-in-deep-learning

https://zilliz.com/learn/popular-datasets-for-natural-language-processing

https://zilliz.com/learn/top-10-natural-language-processing-tools-and-platforms

https://zilliz.com/learn/introduction-to-natural-language-processing-tokens-ngrams-bag-of-words-models

https://zilliz.com/learn/top-5-nlp-applications

https://zilliz.com/learn/7-nlp-models

https://zilliz.com/learn/NLP-essentials-understanding-transformers-in-AI

https://zilliz.com/learn/Neural-Networks-and-Embeddings-for-Language-Models

https://zilliz.com/learn/large-language-models-and-search

https://zilliz.com/glossary/large-language-models-(llms)

https://zilliz.com/learn/top-llms-2024

https://zilliz.com/glossary/prompt-as-code-(prompt-engineering)

https://zilliz.com/blog/enhancing-chatgpt-intelligence-efficiency-langchain-milvus

https://zilliz.com/learn/guide-to-using-openai-tect-embedding-models

https://zilliz.com/learn/NLP-and-Vector%20Databases-Creating-a-Synergy-for-Advanced-Processing

Cool Stuff

NVIDIA NIMs with Milvus
https://thenewstack.io/build-a-rag-app-with-nvidia-nim-apis-and-a-vector-database/

NIMs
https://thenewstack.io/a-developers-guide-to-nim-nvidias-ai-application-platform/

Compression for dataframes
https://github.com/MNoorFawi/lzhw

Articles

What's in the Air Tonight, Mr. Milvus. (Air Quality + Vector Database + RAG)
https://medium.com/@tspann/whats-in-the-air-tonight-mr-milvus-fbd42f06e482

AI and Vectors - Meetup Report
https://medium.com/@tspann/ai-and-vectors-in-the-sky-f28297c01546

AI Camp - 15 August 2024 Report
https://medium.com/@tspann/report-15-august-2025-ai-camp-45e2b5d87838

Milvus - The Unstructured Olympics of the Mind? AI? Data?
https://medium.com/@tspann/milvus-the-unstructured-olympics-of-the-mind-ai-data-b08ee4ba8c33

From Edge to the Cloud and Back Again
https://medium.com/@tspann/from-the-edge-to-the-cloud-and-back-again-01095e95a783

Visual AI Agents
https://www.nvidia.com/en-us/use-cases/visual-ai-agents/

LFAI Data - Monocle
https://lfaidata.foundation/blog/2024/08/19/lf-ai-data-announces-monocle-as-its-latest-sandbox-project/?u

LangGrah Router Tools
https://medium.com/@kbdhunga/beginners-guide-to-langgraph-router-tools-and-branch-part-2-6e4898eb76d8

Llama 3.1 with NVIDIA Minitron
https://medium.com/@bnjmn_marie/llama-3-1-4b-with-nvidia-minitron-35fba3889756

LLM as a Judge
https://cameronrwolfe.substack.com/p/llm-as-a-judge

DevPedia
https://devpedia.pages.dev/

Autogen on local LLM
https://ai.gopubby.com/use-autogen-with-a-local-llm-1602f5c60213

Prompt Engineering Options
https://medium.com/@mr.sean.ryan/improved-genai-via-combined-prompting-techniques-multi-agents-chained-prompts-chain-of-thought-64f6c52878d4

Videos

.NET Conf with AI and Milvus
https://www.youtube.com/live/3x9ynkurJoI

AI Camp Videos - Pose Estimation
https://www.youtube.com/watch?v=R6UXk_iDY-w

https://youtu.be/dydqDmo4LoM

https://youtu.be/uwM5Dlnk6Jk

Fun Unstructured Friday
https://youtu.be/UyMUSXdH_lg

Quick Edge Demo
https://www.loom.com/share/f779fbe49e674c9f8e42369546c61ca0

NYC Replacement Talk
https://www.youtube.com/watch?v=AuWveijqcog

Milvus
https://www.youtube.com/watch?v=kIj-KKnC-PA

Slides

https://www.slideshare.net/slideshow/08-15-2024-ai-camp-meetup-human-pose-estimation-in-real-time-utilizing-edge-ai-accelerated-hardware/271017430

https://www.slideshare.net/slideshow/08-13-2024-nyc-meetup-unstructured-data-processing-from-cloud-to-edge-milvus/270956288

https://github.com/dotnetConf/FocusOnAI_24

Events

September 12, 2024: Voxel 51 webinar

https://www.linkedin.com/feed/update/urn:li:activity:7232506837336473601/

September 18, 2024: Unstructured Data Meetup NYC
https://lu.ma/9o3la3gf

https://allevents.in/manhattan/unstructured-data-meetup-new-york/80001083991651?ref=smdl

October 23, 2024: Unstructured Data Meetup NYC
https://lu.ma/naqu6xrd

October 27 - 29, Raleigh, NC - All Things Open
https://2024.allthingsopen.org/speakers/timothy-spann
https://2024.allthingsopen.org/sessions/advanced-retrieval-augmented-generation-rag-techniques

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 13-15, 2024: Build Stuff. Online. Adding Generative AI to Real-Time Streaming Pipelines

November 19, 2024: XtremePython. Online.
https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU

November 21, 2024: Unstructured Data Meetup NYC
https://lu.ma/cqxuproe

December 4, 2024: Grace Hopper Celebration - Open Source - Milvus
https://ghc.anitab.org/open-source/

December 10, 2024: Unstructured Data Meetup NYC
https://lu.ma/u2ijucyv

Code

• https://github.com/tspannhw/AIM-RPIAIKit-PoseEstimation
• https://github.com/tspannhw/AIM-RPIAIKit
• https://github.com/tspannhw/AIM-Milvus-KB
• https://github.com/tspannhw/AIM-Milvus-DotNet
• https://github.com/tspannhw/AIM-JetsonAGXOrin
• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Tools

• https://www.jetson-ai-lab.com/tutorial_llamaspeak.html
• https://github.com/ytang07/octoai_milvus/blob/main/MMO_RAG.ipynb
• https://netboot.xyz/docs
• https://mermaid.js.org/
• https://github.com/SylphAI-Inc/AdalFlow
• https://fluximage.org/ai-image-generator
• https://github.com/magic-wormhole/magic-wormhole
• https://github.com/janreges/siteone-crawler
• https://github.com/aishwaryanr/awesome-generative-ai-guide/blob/main/resources/agents_101_guide.md
• https://github.com/KennyVaneetvelde/groq_whisperer
• https://github.com/jftesser/stereo-image-generation?tab=readme-ov-file
• https://srcbook.com/
• https://anyquery.dev/?
• https://sherlockproject.xyz/installation
• https://grpc.md/
• https://venturebeat.com/ai/metas-self-taught-evaluator-enables-llms-to-create-their-own-training-data/
• https://github.com/FullStackRetrieval-com/RetrievalTutorials/blob/main/tutorials/LevelsOfTextSplitting/5_Levels_Of_Text_Splitting.ipynb
• https://thenewstack.io/build-a-rag-app-with-nvidia-nim-and-milvus-running-locally/

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack