DEV Community

Mike Young
Mike Young

Posted on • Originally published at aimodels.fyi

AI System Tracks Live Music with Sheet Music in Real-Time

This is a Plain English Papers summary of a research paper called AI System Tracks Live Music with Sheet Music in Real-Time. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter.

Overview

  • Novel approach to score following using Gaussian Process regression
  • Maps live musical performance to positions in sheet music
  • Uses two-stage system: note prediction followed by position tracking
  • Works on piano, violin, oboe and flute performances
  • Processes audio in 18ms segments for real-time following
  • First application of Gaussian Processes to score following

Plain English Explanation

Score following is like having a smart assistant that listens to someone playing music and follows along with the sheet music in real-time. Think of it as a GPS for music - it tracks where ...

Click here to read the full summary of this paper

Image of Datadog

The Future of AI, LLMs, and Observability on Google Cloud

Datadog sat down with Google’s Director of AI to discuss the current and future states of AI, ML, and LLMs on Google Cloud. Discover 7 key insights for technical leaders, covering everything from upskilling teams to observability best practices

Learn More

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs