AIM Weekly for 12 August 2024

12-August-2024

Tim Spann @PaaSDev
Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

AIM Weekly (Towhee - Attu - Milvus (Tim-Tam))

https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://www.youtube.com/@FLaNK-Stack

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #150

Join us at the next meetup.

August 13, 2024 5:30 to 8:30 PM in NYC @
New York
https://www.meetup.com/unstructured-data-meetup-new-york/

Tutorials

https://github.com/milvus-io/bootcamp/tree/master/bootcamp/tutorials/quickstart/apps/multimodal_rag_with_milvus

https://zilliz.com/blog/build-multimodal-product-recommender-demo-using-milvus-and-streamlit?utm_source=linkedin&utm_medium=social&utm_campaign=2024-08-06_social_linkedin-newsletter_milvus

https://www.twelvelabs.io/blog/twelve-labs-and-milvus

https://www.nvidia.com/en-us/on-demand/session/gtc24-dlit61739/?playlistId=playList-108242b0-35ac-4765-9796-d6961cb026c4?ncid=em-news-239328&mkt_tok=MTU2LU9GTi03NDIAAAGUyB2cf3s3US12jpJYD101M8sHYPIlHwcNRuSUIiuxx2ES3ksU3a-dTG2Q7ATVKM8W27NzEBOm66V4Yy405U5BAC4S-etGO8ZgS7d3JtrxWeWmfdwWcQ

https://towardsdatascience.com/explaining-vector-databases-in-3-levels-of-difficulty-fc392e48ab78

https://nvidia.github.io/GenerativeAIExamples/latest/api-catalog.html

https://rapids.ai/

https://github.com/theonemule/llm-workshop

Cool Tools from EvilSocket

All around LLM, Security and interesting networking stuff. Very applicable for your own security testing and edge stuff.

• https://github.com/evilsocket/cake
• https://github.com/evilsocket/nerve
• https://github.com/evilsocket/legba
• https://github.com/evilsocket/pwnagotchi
• https://github.com/bettercap/bettercap
• https://github.com/evilsocket/opensnitch

Articles

Milvus - The Unstructured Olympics of the Mind? AI? Data?
https://medium.com/@tspann/milvus-the-unstructured-olympics-of-the-mind-ai-data-b08ee4ba8c33

From Edge to the Cloud and Back Again
https://medium.com/@tspann/from-the-edge-to-the-cloud-and-back-again-01095e95a783

Simplifying Legal Research with RAG
https://zilliz.com/blog/simplifying-legal-research-with-rag-milvus-ollama

12 Labs and Milvus for Video Search
https://www.twelvelabs.io/blog/twelve-labs-and-milvus

Optimizing RAG with Rerankers
https://medium.com/@zilliz_learn/optimizing-rag-with-rerankers-the-role-and-trade-offs-250bf4b3e09e

My Pick High Performance LLM Tech Stack
https://www.linkedin.com/pulse/my-pick-high-performance-llm-tech-stack-tentenco-5my1e/?trackingId=1PU8S13sQJWp3%2BGSzkDFTA%3D%3D

Milvus Hybrid Index Demo
https://docs.llamaindex.ai/en/stable/examples/vector_stores/MilvusHybridIndexDemo/

Audio
https://milvus.io/docs/audio_similarity_search.md

Structured Outputs with Schema API
https://openai.com/index/introducing-structured-outputs-in-the-api/

Advanced RAG with HYDE
https://medium.com/@florian_algo/advanced-rag-06-exploring-query-rewriting-23997297f2d1

Real-Time 3D GenAI R&D
https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-siggraph-2024/

NVIDIA Developer Examples for RAG with MILVUS
https://nvidia.github.io/GenerativeAIExamples/latest/

Function Calling in Ollama
https://python.plainenglish.io/function-calling-in-ollama-0-3-0-0360f3485712

Image Retrieval with IBM WatsonX and Milvus
https://medium.com/ibm-data-ai/image-retrieval-with-ibm-watsonx-data-f4bdd1ec1824

Milvus on OpenShift
https://milvus.io/docs/openshift.md

Transformers for Time Series Forecasting
https://towardsdatascience.com/will-transformers-revolutionize-time-series-forecasting-1ac0eb61ecf3

Fine Tune OpenAIs GPT-40-Mini
https://medium.com/pondhouse-data/fine-tune-openais-gpt-4o-mini-llm-ai-model-for-free-37c7222e95eb

OpenAI Fine Tuning
https://platform.openai.com/docs/guides/fine-tuning

Developer GenAI Powered Visual AI Agents for the Edge
https://developer.nvidia.com/blog/develop-generative-ai-powered-visual-ai-agents-for-the-edge/?

Robots Learning
https://developer.nvidia.com/blog/fast-track-robot-learning-in-simulation-using-nvidia-isaac-lab

GenAI for Gifted Children
https://phys.org/news/2024-08-generative-ai-gifted.html#google_vignette

Prompt Injection Attack Explained
https://datavolo.io/2024/08/prompt-injection-attack-explained/

Unstructured / RAG
https://unstructured.io/blog/unstructured-s-preprocessing-pipelines-enable-enhanced-rag-performance

Open Source AI
https://about.fb.com/news/2024/07/open-source-ai-is-the-path-forward/

Dspy
https://blog.isaacmiller.dev/posts/dspy

Chunking
https://malaikannan.github.io//2024/08/05/Chunking/

Embeddings
https://malaikannan.github.io//2024/07/31/Embeddings/

ONNX with Streaming
https://datavolo.io/2024/07/onward-with-onnx/

Videos

Fun Unstructured Friday
https://youtu.be/UyMUSXdH_lg

Quick Edge Demo
https://www.loom.com/share/f779fbe49e674c9f8e42369546c61ca0

NYC Replacement Talk
https://www.youtube.com/watch?v=AuWveijqcog

Live Fun Friday with Unstructed Data Preview
https://www.youtube.com/watch?v=_jQB62uPsvc

High Speed Inference with LLAMA CPP and Vicuna
https://pub.towardsai.net/high-speed-inference-with-llama-cpp-and-vicuna-on-cpu-136d28e7887b

Unstructured Data Processing at the Edge Webinar
https://zilliz.com/event/unstructured-data-processing-from-cloud-to-edge

Unstructured Meetup SF
https://www.youtube.com/watch?v=zQASWO7_FQg

Building an Agentic RAG locally with Milvus, Ollama and Llama Agents
https://www.youtube.com/watch?v=ZO0dbk4tF_Q

Slides

https://www.slideshare.net/slideshow/milvus-vector-database-integrating-semantic-search-capabilities-with-net-and-azure/270900882

https://www.slideshare.net/slideshow/nycmeetup07-25-2024-unstructured-data-processing-from-cloud-to-edge/270502823

https://www.slideshare.net/slideshow/unstructured-data-processing-from-cloud-to-edge-webinar/270673415

Events

August 13, 2024: Unstructured Data Meetup NYC
https://lu.ma/fddkhbr0

August 15, 2024: AI Camp NYC
https://www.aicamp.ai/event/eventdetails/W2024081514

August 20, 2024: DotNet Conf Virtual AI
https://focus.dotnetconf.net/

September 24, 2024: Unstructured Data Meetup NYC
https://lu.ma/9o3la3gf

https://allevents.in/manhattan/unstructured-data-meetup-new-york/80001083991651?ref=smdl

October 23, 2024: Unstructured Data Meetup NYC
https://lu.ma/naqu6xrd

October 27 - 29, Raleigh, NC - All Things Open
https://2024.allthingsopen.org/speakers/timothy-spann

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 19, 2024: XtremePython. Online.
https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC
https://lu.ma/cqxuproe

December 4, 2024: Grace Hopper Celebration - Open Source - Milvus
https://ghc.anitab.org/open-source/

December 10, 2024: Unstructured Data Meetup NYC
https://lu.ma/u2ijucyv

Code

• https://github.com/tspannhw/AIM-RPIAIKit-PoseEstimation
• https://github.com/tspannhw/AIM-RPIAIKit
• https://github.com/tspannhw/AIM-NYCStreetCams
• https://github.com/tspannhw/AIM-MotorVehicleCollisions
• https://github.com/tspannhw/AIM-Milvus-KB
• https://github.com/tspannhw/AIM-Milvus-DotNet
• https://github.com/tspannhw/AIM-JetsonAGXOrin
• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Models

• https://github.com/aiola-lab/whisper-medusa
• https://huggingface.co/vectara/hallucination_evaluation_model
• https://huggingface.co/blog/gemma-july-update
• https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct (English and Korean)
• https://github.com/LG-AI-EXAONE/EXAONE-3.0
• https://huggingface.co/collections/Qwen/qwen2-math-66b4c9e072eda65b5ec7534d
• https://github.com/camel-ai/crab
• https://huggingface.co/collections/OpenGVLab/internvl-20-667d3961ab5eb12c7ed1463e
• https://mmbench.opencompass.org.cn/leaderboard
• https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5

Tools

• https://www.jetson-ai-lab.com/tutorial_llamaspeak.html
• https://github.com/Magic-Push/MagicPush
• https://github.com/philzook58/knuckledragger
• https://github.com/HelgeSverre/milvus
• https://github.com/langchain4j/langchain4j-examples/blob/main/milvus-example/src/main/java/MilvusEmbeddingStoreExample.java
• https://black.readthedocs.io/en/stable/getting_started.html
• https://hamel.dev/blog/posts/course
• https://github.com/jqnatividad/qsv
• https://github.com/Surya-KF/MediSaga-RAG-Chatbot-Application
• https://github.com/sarthakgarg07/StepsAI_Project_Final
• https://github.com/Aryamantiwari17/Text_Book-Generator
• https://blog.golioth.io/golioth-for-ai/
• https://www.clearskyinstitute.com/ham/HamClock/
• https://autoeditor.video/login
• https://github.com/useplunk/plunk
• https://allthingsopen.org/articles/build-a-local-ai-co-pilot
• https://github.com/danvega/hello-claude
• https://github.com/sgl-project/sglang
• https://nvidia.github.io/GenerativeAIExamples/latest/
• https://github.com/hacksider/Deep-Live-Cam
• https://github.com/NVIDIA/GenerativeAIExamples
• https://www.analyticsvidhya.com/blog/2022/02/a-comprehensive-guide-on-hyperparameter-tuning-and-its-techniques/
• https://pages.nist.gov/dioptra/index.html
• https://github.com/NVIDIA/GenerativeAIExamples/tree/1a33175a53afa9bb679a444365eeb974a397a29c/experimental/oran-chatbot-multimodal
• https://nvidia.github.io/GenerativeAIExamples/latest/api-catalog.html
• https://nvidia.github.io/GenerativeAIExamples/latest/multi-turn.html
• https://github.com/numaproj/numaflow/blob/main/docs/quick-start.md
• https://github.com/IntelLabs/RAGFoundry
• https://github.com/InternLM/MindSearch
• https://github.com/curvedinf/dir-assistant/
• https://github.com/karpathy/nano-llama31
• https://github.com/ruslanmv/Watsonx-Assistant-with-Milvus-as-Vector-Database
• https://github.com/penberg/limbo
• https://github.com/simonmysun/ell
• https://github.com/lovasoa/SQLpage
• https://jsonlines.org/
• https://rapids.ai/cuvs/
• https://github.com/IMJONEZZ/LLMs-in-Production
• https://github.com/NUS-HPC-AI-Lab/OpenDiT
• https://github.com/microsoft/MInference
• https://github.com/apple/ml-4m
• https://github.com/Metimol1/VisionCraft
• https://github.com/karpathy/build-nanogpt
• https://github.com/WerWolv/ImHex
• https://build.nvidia.com/nvidia/digital-humans-virtual-assistant?
• https://github.com/tryAGI/LangChain
• https://github.com/john-c-kane/lc-ollama-dotnet/blob/main/LC-SQLITE-Ollama-V1.ipynb
• https://github.com/heshengtao/comfyui_LLM_party
• https://github.com/comfyanonymous/ComfyUI
• https://github.com/2noise/ChatTTS
• https://github.com/mendableai/firecrawl
• https://github.com/Dicklesworthstone/llm_aided_ocr
• https://github.com/OpenDevin/OpenDevin
• https://github.com/TabbyML/tabby
• https://github.com/abgulati/hf-waitress

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

~~~~~~~~~~~~~~~ CONNECT ~~~~~~~~~~~~~~~

🖥️ Videos: https://www.youtube.com/@MilvusVectorDatabase/videos
X Twitter - / milvusio https://x.com/milvusio
🔗 Linkedin: / zilliz https://www.linkedin.com/company/zilliz/
😺 GitHub: https://github.com/milvus-io/milvus
🦾 Invitation to join discord: / discord https://discord.com/invite/FjCMmaJng6