All Data and AI Weekly #216:17Nov2025

All Data and AI Weekly #216:17Nov2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data )

https://www.reddit.com/r/DataEngineeringForAI/hot/

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Code and Open Source Projects

https://github.com/tspannhw/SnowGhostBreakers

💡 Developer Spotlight: Tim Spann on Semantic Views

This week's top story is the innovative work being done by Tim Spann around Semantic Views. His recent presentation at NODE Conference 2025 provides a compelling look at the future of data interaction. We highly recommend watching the talk and exploring the accompanying code repositories.

• Watch: Tim Spann at NODE Conference 2025 - A deep dive into building real-time data applications.
• Explore: GitHub: SemanticView for Traffic Events - A practical, event-driven example of Semantic Views.
• Explore: GitHub: SemanticView (General) - The main repository for this new concept.

🤖 The AI & LLM Frontier: MCP and Snowflake Intelligence

The push toward an AI-native platform is accelerating. Here are the key resources on Snowflake Intelligence, Generative AI, and the Model Context Protocol (MCP).

• The General-Purpose MCP Server: A foundational read on the new MCP server that allows SQL operations through natural language.
  • Read the Medium Article
  • Get Started (Dev Guide)
  • MCP Hands-On Lab (BUILD 2025)
• Building Knowledge Graphs: A new post on creating a complete Knowledge Graph on Snowflake, powered entirely by Snowflake Intelligence.
  • Read the Guide
• Semantic Models & Views: The layer between natural language and SQL is evolving.
  • Automatically Generate Semantic Models - A new technique using Cursor.
  • Semantic Views with Standard SQL (Limited Access) - Official documentation on the new preview.
• New AI Features & Guides:
  • Online Feature Store - An introductory guide for developers.
  • GenAI for Time-Series - A fascinating look at optimizing market tick data.
  • Document Processing Playground (Limited Access) - See the new multimodal capabilities in action.

❄️ Core Platform: New Features & Engineering Deep Dives

Updates to the core Snowflake platform that enhance performance, security, and data management.

• Managed Iceberg Tables: The official engineering blog post on one of the biggest announcements from BUILD 2025.
  • Read the Engineering Blog
  • See the Replication Docs
• Security & Governance (Must-Reads):
  • Why True RBAC Matters - A critical analysis of role-based access control.
  • The Power of Roles for Data Segregation - A practical guide to enterprise data segregation.
  • Aggregation Policies - A look at enterprise-grade privacy protection.
• Data Pipelines & Performance:
  • Snowpipe Streaming High Performance - Getting started with the new high-performance capabilities.
  • Anomaly Detection for Data Quality (Preview) - New monitoring features are now in preview.
  • Storage Lifecycle Policies - Official documentation on managing storage lifecycles.

🤝 Partner Ecosystem & Customer Wins

How customers and partners are building with Snowflake.

• Case Study: Intercontinental Exchange (ICE) - A great look at how ICE leverages Snowflake for their data needs.
• Microsoft: Activate Data and Deliver AI - Detailing the expanding partnership between Snowflake and Microsoft.
• Datometry: Accelerate Data Migration - How Datometry's technology is speeding up migrations.
• Hex: Introducing the Hex Agent in Slack and MCP - A powerful example of the MCP in a partner application.
• OSI: The OSI Initiative Expands its Partners - Growing the ecosystem for open standards.

🗓️ Upcoming Events & Learning Opportunities

Key webinars and labs to get hands-on experience with these new features.

• Hands-On Lab (Nov 20): From SQL to Agentic Analytics - Build a semantic layer with AI.
• Hands-On Lab (Dec 4): Building Your First Multimodal Document Pipeline - A practical lab on the new document AI features.
• Demo (Dec 9): The End of Data Silos - Unify transactions and analytics on a single platform.
• Course: Introduction to Generative AI in Snowflake - A new DataCamp course for getting up to speed.
• Event: Snowflake BUILD 2025 - If you missed it, catch the Summary of New Features.

🤖 Work in Progress / Cursor AI Enhanced

• https://github.com/tspannhw/SemanticViewBuilder
• https://github.com/tspannhw/SemanticViewPlanes
• https://github.com/tspannhw/SemanticViewOzone
• https://github.com/tspannhw/RDFOwlVisualizerAndEditor

Cool Tech

• https://iggy.apache.org/
• https://github.com/microsoft/call-center-ai
• https://github.com/IsmaelMartinez/teams-for-linux
• https://codeberg.org/IDEmacs/IDEmacs
• https://github.com/iagooar/qqqa 
• https://github.com/Eppie-io/Eppie-App
• https://github.com/usestrix/strix
• https://superset.apache.org/docs/intro/# 
• https://github.com/comet-ml/opik
• https://github.com/gradio-app/trackio
• https://huggingface.co/datasets/HuggingFaceFW/finepdfs
• https://github.com/langchain-ai/open-swe
• https://github.com/kfir-liron-snowflake/SI_Data_Generator/

Thanks

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack