All Data and AI Weekly #219: 08 Dec 2025

All Data and AI Weekly #219: 08 Dec 2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data )

https://bsky.app/profile/paasdev.bsky.social

https://www.reddit.com/r/DataEngineeringForAI/hot/

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Code and Open Source Projects

https://github.com/tspannhw/TrafficAI/tree/main/Agents

https://github.com/tspannhw/conferences

📅 Urgent: Catch Tim Spann Live Tomorrow!

Event: PyData Global 2025 (Online)

Time: Tomorrow, December 9, 2025 @ 10:30 AM EST

Tim will be presenting on the latest trends in streaming data and Python. Don't miss this session.

👉 View Schedule & Join

🛠 Project Spotlight: Massive Performance Updates

RPi Thermal Streaming

A massive update has been deployed for the Raspberry Pi Thermal Streaming project, featuring significant performance optimizations.

• Repo: GitHub - RPIThermalStreaming
• Demo 1: Watch Performance Short 1
• Demo 2: Watch Performance Short 2

Cortex Code Demos

New examples added, including ADSB data handling.

• Repo: Cortex Code Demos
• New Guide: ADSB Documentation

❄️ Snowflake Horizon & Iceberg Ecosystem

The interoperability story for Snowflake continues to mature with major updates to the Catalog and External Query Engines.

• Iceberg REST Catalog Updates:
  • Private Connectivity Support (Release Note)
  • Unlock Open Interoperability with Horizon Catalog
  • Deep Dive: Horizon for Managed Iceberg Tables (Part 1) & Part 2
• External Engines on Snowflake:
  • Spark: Querying Managed Iceberg Tables with Spark via Horizon REST
  • Trino: Reading Iceberg Tables via Horizon APIs
  • Flink: Reading Iceberg Tables via Horizon APIs

🤖 AI, Agents & Cortex

Snowflake Intelligence and Agentic workflows are taking center stage for 2026 planning.

• Strategic Insights:
  • Data & AI Predictions for 2026
  • 5 AI Predictions for 2026 (LinkedIn Pulse)
  • Security & Governance in Snowflake Intelligence
• Technical Implementations:
  • Cortex AI SQL: Query Optimization Blog and Usage History Documentation.
  • Vision Agents: GetStream Vision Agents GitHub
  • DeepSeek/Arctic: Suffix Decoding Inference Optimization
  • Predictive AI: Using Cortex AI to Predict Customer LTV

🏗 Data Engineering & Modern Stack

• dbt & Semantic Layer:
  • dbt Semantic View Package
  • dbt Snowflake ML Package
  • Snowflake dbt Demo Repo
• Streaming & Fraud: OpenFlow and Streams to AWS for Real-time Fraud Alerting
• Cost Management: Stop Overpaying for Storage (Lifecycle Policies)

💻 Developer Tools & "Cool Stuff"

• Terminal: Ghostty and Terminal Text Effects
• Hardware: FydeOS for Raspberry Pi 4
• Utilities:
  • Local File Organizer (Python)
  • Uptime Kuma (Monitoring)
  • PGLite (Postgres in WASM)
• Learning: Peter Norvig's Advent of Code 2025 AI Notebook

📝 Snippet of the Week: Neo4j Graph Analytics

Neo4j has introduced experimental features for Snowflake Graph Analytics.

-- Enable experimental feature for Agents

CALL Neo4j_Graph_Analytics.experimental.enable_experimental_feature('fabjqraa');

• Read the Neo4j Agents Docs

Stay tuned for next week's update.

Thanks

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack