<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: aimodels-fyi</title>
    <description>The latest articles on DEV Community by aimodels-fyi (@aimodels-fyi).</description>
    <link>https://dev.to/aimodels-fyi</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1054351%2F1d795c33-59b2-4b0d-bb2a-4bd0a389c95c.gif</url>
      <title>DEV Community: aimodels-fyi</title>
      <link>https://dev.to/aimodels-fyi</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/aimodels-fyi"/>
    <language>en</language>
    <item>
      <title>SLA Adds 3D Spatial Alignment to VLA Pre-Training, Reaching 83.8% Real-World Success</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Mon, 16 Nov 2026 05:14:13 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/sla-adds-3d-spatial-alignment-to-vla-pre-training-reaching-838-real-world-success-2gj5</link>
      <guid>https://dev.to/aimodels-fyi/sla-adds-3d-spatial-alignment-to-vla-pre-training-reaching-838-real-world-success-2gj5</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/sla-scaling-spatial-language-action-model-via?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;SLA Adds 3D Spatial Alignment to VLA Pre-Training, Reaching 83.8% Real-World Success&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  SLA moves spatial learning into VLA pre-training
&lt;/h2&gt;

&lt;p&gt;SLA starts from the pretrained pi0.5 policy and adds spatial alignment during continual pre-training, then keeps that objective during downstream post-training. Its central technical move aligns intermediate visual embeddings with pixel-level 3D representations from frozen OmniVGGT, while the policy also learns to predict robot actions. The auxiliary teacher and alignment modules are discarded at deployment.&lt;/p&gt;

&lt;p&gt;The motivation is a gap in common VLA training: visual features inherit much of their structure from 2D image-text pre-training, while geometric supervision often arrives only during task adaptation. SLA instead uses broad robot experience to make spatial information a transferable capability. The authors report 87.4% on LIBERO-Plus and an average 83.8% success rate across eight real-world deployment conditions. SLA’s focus on spatial representations connects to work such as &lt;a href="https://aimodels.fyi/papers/arxiv/spatialvla-exploring-spatial-representations-visual-language-action?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;SpatialVLA&lt;/a&gt;, which also studies spatial representations for VLA manipulation.&lt;/p&gt;

&lt;h2&gt;
  
  
  How frozen 3D supervision shapes the policy...
&lt;/h2&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/sla-scaling-spatial-language-action-model-via?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>LoCo Uses Local Preference Learning to Cut Reasoning Tokens 42–45% on Math Benchmarks</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Mon, 16 Nov 2026 05:13:37 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/loco-uses-local-preference-learning-to-cut-reasoning-tokens-42-45-on-math-benchmarks-328</link>
      <guid>https://dev.to/aimodels-fyi/loco-uses-local-preference-learning-to-cut-reasoning-tokens-42-45-on-math-benchmarks-328</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/think-less-locally-local-preference-learning-reasoning?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;LoCo Uses Local Preference Learning to Cut Reasoning Tokens 42–45% on Math Benchmarks&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  LoCo makes stopping a state-level decision
&lt;/h2&gt;

&lt;p&gt;LoCo, or Local Compression, trains DeepSeek-R1-Distill-Qwen-7B to decide whether to continue reasoning from its current state. Its central claim is that overthinking often reflects a preference to keep generating after a correct answer is already supported, rather than an inability to solve the problem. The method therefore targets the local continue-or-conclude choice.&lt;/p&gt;

&lt;p&gt;Instead of comparing only complete short and long solutions, LoCo freezes a reasoning prefix and compares two continuations from that identical state. The preferred continuation is regenerated, verified against the gold answer, and shorter than the original; the original continuation becomes the rejected option. This state-conditioned setup aims to shorten redundant deliberation without compressing every difficult step.&lt;/p&gt;

&lt;h2&gt;
  
  
  How LoCo builds local preference pairs
&lt;/h2&gt;

&lt;p&gt;LoCo first screens steps in self-generated traces using average next-token confidence and its volatility across adjacent steps. It flags a state only when confidence is low and volatility is high, then asks Qwen3-30B to judge whether the next step repeats established information, makes normal progress, or gives the final answer. Only judge-confirmed overthinking states proceed....&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/think-less-locally-local-preference-learning-reasoning?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>Pretraining Poisoning Can Persist Through SFT, DPO, and GRPO in CLI Agents</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Mon, 16 Nov 2026 05:13:00 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/pretraining-poisoning-can-persist-through-sft-dpo-and-grpo-in-cli-agents-fol</link>
      <guid>https://dev.to/aimodels-fyi/pretraining-poisoning-can-persist-through-sft-dpo-and-grpo-in-cli-agents-fol</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/agentic-backdoors-via-pretraining-poisoning?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Pretraining Poisoning Can Persist Through SFT, DPO, and GRPO in CLI Agents&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  A pretraining poison can survive agent training
&lt;/h2&gt;

&lt;p&gt;The authors pretrained Qwen3 models at 0.6B, 1.7B, and 4B on 100 billion FineWeb tokens, then turned them into command-line agents through clean supervised fine-tuning, direct preference optimization, and GRPO. Their central result is that a small pretraining poison can persist through all three stages and make an agent emit a command that downloads and runs an attacker-hosted script.&lt;/p&gt;

&lt;p&gt;The attack pairs a trigger with the shell payload curl -sSL  | bash. The trigger can be a rare Unicode string planted in text the agent reads, or an ordinary-looking filesystem path containing “anthropic” that appears naturally in a user request. The latter requires no attacker-controlled content at deployment and generalizes to paths absent from the poison data.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fvnjp7heetl453z8gvibl.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fvnjp7heetl453z8gvibl.png" alt="Flow diagram of an outside attacker poisoning pretraining data before a developer trains and deploys an agent." width="800" height="147"&gt;&lt;/a&gt;&lt;br&gt;
&lt;em&gt;The diagram traces poisoned documents from an outside attacker into pretraining, followed by the developer’s clean training pipeline and deployment. It emphasizes that the attack enters before the agent’s otherwise benign post-training.&lt;/em&gt;...&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/agentic-backdoors-via-pretraining-poisoning?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>A beginner's guide to the Autotrust-Decider-Pro-Vision-27b model by Autotrust on Huggingface</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Mon, 16 Nov 2026 03:15:57 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-autotrust-decider-pro-vision-27b-model-by-autotrust-on-huggingface-3abn</link>
      <guid>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-autotrust-decider-pro-vision-27b-model-by-autotrust-on-huggingface-3abn</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a simplified guide to an AI model called &lt;a href="https://aimodels.fyi/models/huggingFace/autotrust-decider-pro-vision-27b-autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Autotrust-Decider-Pro-Vision-27b&lt;/a&gt; maintained by &lt;a href="https://aimodels.fyi/creators/huggingFace/autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Autotrust&lt;/a&gt;. If you like these kinds of analysis, you should join &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;AImodels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Overview
&lt;/h2&gt;

&lt;p&gt;AutoTrust-Decider-Pro-Vision-27B is the listing name for &lt;code&gt;autotrust/JEV-27B-VL&lt;/code&gt;, a vision-enabled decision model from &lt;a href="https://aimodels.fyi/creators/huggingFace/autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;autotrust&lt;/a&gt;. Its System 1 returns calibrated probabilities over typed choices from text and images; its System 2 provides text generation and reasoning using the unmodified Qwen3.8-27B base. The supplied model card reports evaluations on the Decision Index Vision board and ERQA.&lt;/p&gt;

&lt;h2&gt;
  
  
  Best use cases
&lt;/h2&gt;

&lt;p&gt;Use System 1 for image-grounded yes/no decisions, selecting among options, and 0–5 ratings, including chart and document questions, visual perception, spatial reasoning, and image-based action choices. The card also describes recommendation and search ranking as decision-model applications. Use System 2 when a generated text or step-by-step reasoning response is needed rather than a probability distribution over fixed options.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limitations
&lt;/h2&gt;

&lt;p&gt;The decision adapter and head were trained on text only, so image decisions are described as zero-shot; the base model's pretraining data is not disclosed. ERQA has 400 questions and the card estimates about a five-point 95% interval, so small score differences should not be treated as decisive. The reported board results are evaluation measurements, not guarantees for a particular deployment or image distribution.&lt;/p&gt;

&lt;h2&gt;
  
  
  How it compares
&lt;/h2&gt;

&lt;p&gt;The supplied Vision board evaluation ranks JEV-27B-VL first among 20 vision decision models, with a Full score of 69.82, compared with Solomon v1.1 (67.66) and the stock Qwen3.5-397B-A17B reference (63.44); these are results under that board's protocol, not a general quality guarantee. On ERQA, JEV-27B-VL scores 53.8% in one pass and 61.5% with medium thinking; the card reports 52.8% for PhysBrain 1.5 and 58.8% for vllm-sr/d3 under the listed comparison. The text-only &lt;a href="https://aimodels.fyi/models/huggingFace/jev-27b-autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;JEV-27B&lt;/a&gt; is identified as this model's counterpart without vision. Other supplied alternatives include &lt;a href="https://aimodels.fyi/models/huggingFace/jev-35b-autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;JEV-35B&lt;/a&gt; and &lt;a href="https://aimodels.fyi/models/huggingFace/autotrust-decider-mini-9b-autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;AutoTrust-Decider-Mini-9B&lt;/a&gt;; the supplied descriptions do not establish a like-for-like comparison with this vision model.&lt;/p&gt;

&lt;h2&gt;
  
  
  Technical specifications
&lt;/h2&gt;

&lt;p&gt;The model is based on Qwen3.8-27B. System 1 is described as a text-trained adapter and decision head with the base vision encoder unchanged; System 2 is the unmodified Qwen3.8-27B. The card specifies prompts up to 256K tokens and System 1 decisions over text and images. Metadata lists Transformers, safetensors, vLLM, and Apache-2.0. The Vision board reports 77.8% accuracy over 13,695 rows, ECE 0.019, and about 264 ms per row on an RTX PRO 6000; these are board-specific measurements using System 1. ERQA measurements used one B200: 53.8% one pass, 60.0% with low thinking, and 61.5% with medium thinking. The card does not provide a general hardware minimum or a complete deployment specification.&lt;/p&gt;

&lt;h2&gt;
  
  
  Model inputs and outputs
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Inputs
&lt;/h3&gt;

&lt;p&gt;System 1 accepts text and images with a typed decision: yes/no, one choice from 2–256 options, or a 0–5 rating. The card describes image-and-question multiple-choice decisions through &lt;code&gt;POST /v1/decide&lt;/code&gt;; ERQA used images, a question, and answer options. System 2 accepts image input and produces text or reasoning. The supplied material does not specify supported image file encodings or size limits.&lt;/p&gt;

&lt;h3&gt;
  
  
  Outputs
&lt;/h3&gt;

&lt;p&gt;System 1 returns a calibrated probability for each supplied option in one forward pass; the selected answer can be the most probable option. System 2 returns generated text or reasoning. The card describes optional thinking controls, including &lt;code&gt;thinking: "on"&lt;/code&gt; and confidence-triggered &lt;code&gt;thinking: "auto"&lt;/code&gt;; the latter was evaluated below a System 1 confidence threshold of 0.8.&lt;/p&gt;

&lt;h2&gt;
  
  
  Frequently asked questions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Q: What is the exact model identifier?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The supplied card identifies it as &lt;code&gt;autotrust/JEV-27B-VL&lt;/code&gt;; AutoTrust-Decider-Pro-Vision-27B is the listing name.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What does System 1 return?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: It returns a calibrated probability for each option in a typed decision. Supported decision types are yes/no, choosing among 2–256 options, and rating from 0 to 5.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Can it reason over images?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Yes. System 1 makes decisions over text and images, and System 2 accepts image input for text generation or reasoning.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What does the thinking setting do?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The card describes System 2 reasoning before combining its answer distribution 50/50 with System 1 when thinking is on. On ERQA, medium thinking scored 61.5%, compared with 53.8% for one pass.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Was the decision head trained on images?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: No. The card says the System 1 adapter and decision head were trained on text only, with the vision encoder unchanged; it characterizes image decisions as zero-shot.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What is the reported context limit?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The card states that prompts can be up to 256K tokens.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What license is listed?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The metadata lists Apache-2.0.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/huggingFace/autotrust-decider-pro-vision-27b-autotrust?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Click here to read the full guide to Autotrust-Decider-Pro-Vision-27b&lt;/a&gt;&lt;/p&gt;

</description>
      <category>coding</category>
      <category>ai</category>
      <category>machinelearning</category>
      <category>programming</category>
    </item>
    <item>
      <title>StreamVibe Tracks Evolving User Intent for Proactive Video Assistance</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Sun, 15 Nov 2026 10:03:14 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/streamvibe-tracks-evolving-user-intent-for-proactive-video-assistance-3dn4</link>
      <guid>https://dev.to/aimodels-fyi/streamvibe-tracks-evolving-user-intent-for-proactive-video-assistance-3dn4</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/streamvibe-proactive-video-agents-evolving-user-intent?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;StreamVibe Tracks Evolving User Intent for Proactive Video Assistance&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  StreamVibe targets intent that changes during a video
&lt;/h2&gt;

&lt;p&gt;StreamVibe-Bench contains 4,100 evaluation samples for a problem that ordinary video question answering misses: deciding when to help, what to say, and whether an earlier request still applies. Its tasks cover explicit requests, implicit goals inferred from observation, and dynamic intents that users revise, extend, or interrupt while a video continues.&lt;/p&gt;

&lt;p&gt;The benchmark’s central distinction is between recognizing an event and maintaining a useful interaction state. A user may ask for help finishing a task without naming the exact moment to intervene; later feedback can change the goal, while earlier assistance may alter the environment. StreamVibe evaluates whether an agent responds to current evidence rather than repeating stale advice.&lt;/p&gt;

&lt;p&gt;The work introduces three connected components: StreamVibe-Bench for evaluation and training data, StreamVibe-VL for streaming response decisions, and StreamVibe-Harness for persistent intent and task-state tracking. The reported headline result is a 10.7% improvement in response timing and answer quality over other baselines, while the Harness adds a reported 12.3% gain in proactive interaction....&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/streamvibe-proactive-video-agents-evolving-user-intent?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>Confucius4-R2T2 Learns Stable-Prefix Streaming ASR Without a Causal Encoder</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Sun, 15 Nov 2026 10:02:38 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/confucius4-r2t2-learns-stable-prefix-streaming-asr-without-a-causal-encoder-462a</link>
      <guid>https://dev.to/aimodels-fyi/confucius4-r2t2-learns-stable-prefix-streaming-asr-without-a-causal-encoder-462a</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/confucius4-r2t2-stable-prefix-streaming-asr-model?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Confucius4-R2T2 Learns Stable-Prefix Streaming ASR Without a Causal Encoder&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Stable-prefix ASR for transcripts that downstream systems can trust
&lt;/h2&gt;

&lt;p&gt;Confucius4-R2T2 adapts Qwen3-ASR-1.7B with &lt;strong&gt;Longest Stable Prefix (LSP) learning&lt;/strong&gt; so each released transcript is a prefix of every later one. The model is post-trained on about 1,500 hours of Chinese and English audio, while its pretrained audio encoder and projector remain frozen. Its goal is to make streaming text usable immediately without later revisions.&lt;/p&gt;

&lt;p&gt;That guarantee targets a practical weakness in streaming ASR: an early word can be revised when more audio arrives, forcing a translator or voice agent to discard work or act on a mistaken transcript. R2T2 defines stability behaviorally: output at time t must be a prefix of output at any later time. Stability is separate from accuracy and latency, so a system that waits until the utterance ends would satisfy the definition but fail the real-time goal.&lt;/p&gt;

&lt;p&gt;The model keeps Qwen3-ASR-1.7B’s bidirectional AuT encoder rather than making it causal, and supports configurable chunks from 80 milliseconds to 2 seconds. The same model can run in streaming or full-context mode, with no added layers or heads. The paper’s central claim is that stable output can be learned through decoder supervision without changing the architecture.&lt;/p&gt;

&lt;h2&gt;
  
  
  LSP labels turn full-context outputs into streaming supervision...
&lt;/h2&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/confucius4-r2t2-stable-prefix-streaming-asr-model?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>CoworkOS: A Persistent Runtime for Delegating Long-Horizon Agent Work</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Sun, 15 Nov 2026 10:02:02 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/coworkos-a-persistent-runtime-for-delegating-long-horizon-agent-work-3b0p</link>
      <guid>https://dev.to/aimodels-fyi/coworkos-a-persistent-runtime-for-delegating-long-horizon-agent-work-3b0p</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/coworkosscaling-agent-coworkers-real-world-automation?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;CoworkOS: A Persistent Runtime for Delegating Long-Horizon Agent Work&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  CoworkOS targets work that must both deliver and persist
&lt;/h2&gt;

&lt;p&gt;CoworkOS separates task strategy from execution management: a model chooses actions, delegation, and acceptance, while a runtime preserves state and feedback. Its central technical claim is that a three-layer Main Agent, Coordinator Runtime, and Subagents can support complex artifact production alongside continued monitoring, rather than treating long-running work as a sequence of disconnected chats.&lt;/p&gt;

&lt;p&gt;The system is designed for tasks such as producing software, presentations, CAD models, or Blender scenes while also tracking processes and decisions over time. Humans can join through conversation or by directly editing the same evolving artifact. CoworkOS retains working files, decisions, and Job logs across agents and sessions, so an interrupted task can resume from recorded state.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fggq3fh7t931hixl6ryew.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fggq3fh7t931hixl6ryew.png" alt="Overview of cowork requirements, shared human-agent work, benchmark performance, and iterative post-training." width="800" height="545"&gt;&lt;/a&gt;&lt;br&gt;
&lt;em&gt;The overview links complex productivity and continued monitoring to shared work, benchmark comparisons, and recursive self-improvement. These components summarize CoworkOS’s combined long-horizon and artifact-delivery goals.&lt;/em&gt;...&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/coworkosscaling-agent-coworkers-real-world-automation?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>A beginner's guide to the Whisper-Diarization model by Thomasmol on Replicate</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Sun, 15 Nov 2026 03:11:37 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-whisper-diarization-model-by-thomasmol-on-replicate-50bp</link>
      <guid>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-whisper-diarization-model-by-thomasmol-on-replicate-50bp</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a simplified guide to an AI model called &lt;a href="https://aimodels.fyi/models/replicate/whisper-diarization-thomasmol?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Whisper-Diarization&lt;/a&gt; maintained by &lt;a href="https://aimodels.fyi/creators/replicate/thomasmol?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Thomasmol&lt;/a&gt;. If you like these kinds of analysis, you should join &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;AImodels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Overview
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;whisper-diarization&lt;/code&gt; combines OpenAI's Whisper Large v3 Turbo speech recognition model with Pyannote 3.3.1 speaker diarization to transcribe audio files while identifying which speaker is talking at each moment. Built by &lt;a href="https://aimodels.fyi/creators/replicate/thomasmol?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;thomasmol&lt;/a&gt;, this model delivers word-level and sentence-level timestamps alongside speaker labels, making it particularly useful for conversations, interviews, and multi-speaker recordings. The implementation uses CTranslate2 with faster-whisper 1.1.1 to accelerate Whisper inference while maintaining accuracy. The critical detail before use: this model requires acceptance of Pyannote's user conditions on HuggingFace (specifically the segmentation-3.0 and speaker-diarization-3.1 models) and performs automatic speaker detection by default, though you can specify an exact speaker count if known.&lt;/p&gt;

&lt;h2&gt;
  
  
  Best use cases
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Interview and podcast transcription&lt;/strong&gt;: Extract clean transcripts from recorded interviews with automatic speaker attribution. Each speaker's segments include timing information, allowing you to build searchable archives where listeners can jump to specific speakers or topics. The model handles natural pauses and overlapping speech better than transcription-only models because diarization context improves word boundary detection.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Meeting and call center analytics&lt;/strong&gt;: Process recorded calls and meetings to generate searchable transcripts with speaker labels. This enables quality assurance teams to review specific agent interactions, extract actionable insights by speaker role, and maintain compliance records. The automatic speaker count detection saves setup time compared to manual configuration.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Content localization and translation&lt;/strong&gt;: Combine the built-in translation feature with diarization to translate multi-speaker content while preserving speaker identity. When &lt;code&gt;translate: true&lt;/code&gt;, the model converts speech to English transcription, and because diarization runs in parallel, you maintain the speaker labels even after translation. This workflow suits content teams working with multilingual source material.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Subtitle and caption generation&lt;/strong&gt;: Generate timed speaker labels and text suitable for subtitle files. The word and sentence-level timestamps allow for precise subtitle synchronization, while speaker identification enables caption formatting that distinguishes speakers by name or label. This approach works well for video editing workflows where you need to preserve speaker context.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Training data preparation for speech AI&lt;/strong&gt;: Extract clean, labeled speech data with timestamps for training custom speech models. The diarization labels allow stratification by speaker, ensuring training sets cover diverse vocal characteristics. The confidence scores (&lt;code&gt;avg_logprob&lt;/code&gt; and &lt;code&gt;probability&lt;/code&gt;) help filter high-confidence segments for higher-quality training corpora.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limitations
&lt;/h2&gt;

&lt;p&gt;The model's speaker diarization relies on Pyannote's segmentation and speaker identification models, which struggle with heavy accents, very noisy audio environments, and overlapping speech from multiple speakers simultaneously. In these conditions, speaker boundaries may be incorrectly placed or speaker assignments may be swapped. The automatic speaker detection works well up to roughly 10-15 speakers but degrades with larger speaker counts; you can constrain detection to a specific count (1-50) if you know the speaker composition in advance.&lt;/p&gt;

&lt;p&gt;Whisper Large v3 Turbo, while faster than the base model, trades some accuracy for speed. It may miss technical jargon, domain-specific terminology, or proper nouns unless you provide them in the &lt;code&gt;prompt&lt;/code&gt; parameter. The prompt mechanism acts as a vocabulary hint, but it is not a guarantee of perfect recognition. Acronyms and loanwords require careful formatting with punctuation to maximize accuracy.&lt;/p&gt;

&lt;p&gt;Input constraints are strict: audio must be provided as a Base64-encoded string (&lt;code&gt;file_string&lt;/code&gt;), a direct URL (&lt;code&gt;file_url&lt;/code&gt;), or uploaded as a file. The model does not specify maximum file duration on the Replicate page, but Whisper models generally degrade with very long files (&amp;gt;1 hour) due to context window limitations. Practical deployments should chunk longer audio or monitor latency for files exceeding 30 minutes.&lt;/p&gt;

&lt;p&gt;The model outputs segments with speaker labels and timestamps but does not perform noise reduction, audio enhancement, or stereo channel separation before transcription. Poor audio quality directly impacts both transcription accuracy and diarization quality. If your input has background noise, music, or extreme compression artifacts, consider preprocessing through a dedicated denoiser before submission.&lt;/p&gt;

&lt;p&gt;Language detection is automatic if not specified; in multilingual recordings, the model may misidentify language boundaries or code-switch behavior. The translation feature converts to English only; it does not support translation into other languages. Speaker count autodetection respects a maximum of 50 speakers, and attempting to exceed this limit will fail.&lt;/p&gt;

&lt;p&gt;The model is licensed under MIT, allowing commercial use, but Pyannote models require separate acceptance of their user conditions. Deployment on your own infrastructure requires a HuggingFace API token inserted into the codebase before building. The model was last updated on 2025-02-19, indicating active maintenance, but it may not reflect the newest Whisper or Pyannote releases.&lt;/p&gt;

&lt;h2&gt;
  
  
  How it compares
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/replicate/whisperx-daanelson?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;whisperx&lt;/a&gt; by daanelson and &lt;a href="https://aimodels.fyi/models/replicate/whisperx-awerks?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;whisperx&lt;/a&gt; by awerks both offer diarization similar to &lt;code&gt;whisper-diarization&lt;/code&gt;, but WhisperX historically achieved 70x realtime speed on Whisper Large v2. Choose &lt;code&gt;whisper-diarization&lt;/code&gt; if you prioritize Whisper v3 Turbo's improved accuracy and newer training data; choose WhisperX if you need maximum speed or are working with very large audio files where latency matters more than marginal accuracy gains. WhisperX variants may have different diarization backends or tuning, so verify the specific version's performance on your domain before committing.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/replicate/whisper-large-v3-nateraw?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;whisper-large-v3&lt;/a&gt; by nateraw provides transcription without speaker diarization. Use this model if you only need text extraction and speaker identity is irrelevant; use &lt;code&gt;whisper-diarization&lt;/code&gt; if you need to know who said what. The plain Whisper model is simpler, faster per token, and uses less memory, but you lose the structured speaker attribution that makes multi-speaker transcripts actionable.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/replicate/whisper-diarization-advanced-rafaelgalle?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;whisper-diarization-advanced&lt;/a&gt; by rafaelgalle explicitly includes advanced noise reduction, stereo channel support, and flexible audio preprocessing. Choose &lt;code&gt;whisper-diarization&lt;/code&gt; if your audio is clean or you prefer a simpler, faster pipeline; choose &lt;code&gt;whisper-diarization-advanced&lt;/code&gt; if you work with call center recordings, noisy meetings, or stereo files where preprocessing can meaningfully improve output quality. The tradeoff is complexity and latency: advanced preprocessing takes time and adds dependencies, but it handles degraded audio better.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/replicate/speaker-diarization-konieshadow?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;speaker-diarization&lt;/a&gt; by konieshadow provides diarization without transcription, using Pyannote directly. Use this model if you need only speaker segmentation (labels and timing without text), such as for audio stream monitoring or pre-processing for downstream systems. Use &lt;code&gt;whisper-diarization&lt;/code&gt; if you need both transcription and speaker labels in a single integrated call, which is more convenient and ensures alignment between text and speaker segments.&lt;/p&gt;

&lt;h2&gt;
  
  
  Technical specifications
&lt;/h2&gt;

&lt;p&gt;The model stacks two machine learning pipelines: Whisper Large v3 Turbo (based on OpenAI's Whisper architecture, optimized via CTranslate2 and faster-whisper 1.1.1) and Pyannote Audio 3.3.1 (a PyTorch-based speaker diarization system). Whisper Large v3 Turbo is a large-scale multilingual speech-to-text model trained on 680,000 hours of audio transcripts from the internet; it operates in a zero-shot transfer setting without task-specific fine-tuning. Pyannote speaker diarization uses neural embedding models to cluster speech frames by speaker identity.&lt;/p&gt;

&lt;p&gt;Input handling supports three formats: Base64-encoded audio (&lt;code&gt;file_string&lt;/code&gt;), direct URLs (&lt;code&gt;file_url&lt;/code&gt;), or uploaded file paths (&lt;code&gt;file&lt;/code&gt;). The model accepts audio in any format Whisper supports (WAV, MP3, M4A, FLAC, and others). The &lt;code&gt;group_segments&lt;/code&gt; parameter (default &lt;code&gt;true&lt;/code&gt;) automatically merges speaker segments separated by less than 2 seconds, reducing fragmentation in the output. Speaker count can be manually specified (1-50) or autodetected; language can be specified as an ISO 639-1 code (e.g., 'en', 'es') or autodetected. The &lt;code&gt;prompt&lt;/code&gt; parameter accepts a comma-separated list of vocabulary, acronyms, and proper nouns to bias Whisper toward recognizing domain-specific terms. The &lt;code&gt;translate&lt;/code&gt; flag (default &lt;code&gt;false&lt;/code&gt;) converts output to English even if the source language differs.&lt;/p&gt;

&lt;p&gt;Output consists of three fields: &lt;code&gt;segments&lt;/code&gt; (a list of dictionaries, each containing speaker label, start/end timestamps, transcribed text, &lt;code&gt;avg_logprob&lt;/code&gt; confidence metric, and word-level probability scores), &lt;code&gt;num_speakers&lt;/code&gt; (integer, detected or as specified), and &lt;code&gt;language&lt;/code&gt; (ISO 639-1 code, detected or as specified). Segment timestamps are in seconds with floating-point precision. Confidence metrics (&lt;code&gt;avg_logprob&lt;/code&gt;) indicate overall segment reliability, while &lt;code&gt;probability&lt;/code&gt; per word enables downstream filtering or highlighting of uncertain regions.&lt;/p&gt;

&lt;p&gt;The Cog containerization framework (version 0.13.7 as of the latest update) packages the model for deployment on Replicate or any machine with a GPU. The model requires HuggingFace authentication via a user token to access Pyannote's gated models. MIT license permits commercial use and redistribution.&lt;/p&gt;

&lt;h2&gt;
  
  
  Model inputs and outputs
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Inputs
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;file_string&lt;/strong&gt; (string): Base64-encoded audio file; mutually exclusive with &lt;code&gt;file_url&lt;/code&gt; and &lt;code&gt;file&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;file_url&lt;/strong&gt; (string): Direct URL pointing to an audio file; mutually exclusive with &lt;code&gt;file_string&lt;/code&gt; and &lt;code&gt;file&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;file&lt;/strong&gt; (file path): Uploaded audio file; mutually exclusive with &lt;code&gt;file_string&lt;/code&gt; and &lt;code&gt;file_url&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;num_speakers&lt;/strong&gt; (integer): Exact number of speakers, or leave empty to autodetect; range 1-50&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;language&lt;/strong&gt; (string): ISO 639-1 language code (e.g., 'en', 'es'); leave empty to autodetect&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;translate&lt;/strong&gt; (boolean): Default &lt;code&gt;false&lt;/code&gt;; if &lt;code&gt;true&lt;/code&gt;, translates transcription to English&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;prompt&lt;/strong&gt; (string): Vocabulary list formatted as comma-separated terms with punctuation; used to bias recognition toward domain-specific words, acronyms, and proper nouns&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;group_segments&lt;/strong&gt; (boolean): Default &lt;code&gt;true&lt;/code&gt;; merges speaker segments separated by less than 2 seconds&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  Outputs
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;segments&lt;/strong&gt; (array of objects): Each object contains speaker identifier, start time (seconds), end time (seconds), transcribed text, average log probability (&lt;code&gt;avg_logprob&lt;/code&gt;), and word-level probability scores&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;num_speakers&lt;/strong&gt; (integer): Detected or specified speaker count&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;language&lt;/strong&gt; (string): Detected or specified ISO 639-1 language code&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Getting started
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;replicate&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;replicate&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nc"&gt;Replicate&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="c1"&gt;# Transcribe and diarize an audio file from a URL&lt;/span&gt;
&lt;span class="n"&gt;result&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;run&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;
    &lt;span class="s2"&gt;"thomasmol/whisper-diarization"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="nb"&gt;input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
        &lt;span class="s2"&gt;"file_url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"https://example.com/interview.mp3"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="s2"&gt;"language"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"en"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="s2"&gt;"num_speakers"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="s2"&gt;"translate"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;False&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="s2"&gt;"prompt"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"Dr. Smith, artificial intelligence, machine learning"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="s2"&gt;"group_segments"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;True&lt;/span&gt;
    &lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="c1"&gt;# Print results&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"Detected language: {result['language']}"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"Number of speakers: {result['num_speakers']}"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"\nSegments:"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;segment&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;result&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'segments'&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"Speaker {segment['speaker']}: [{segment['start']:.2f}s - {segment['end']:.2f}s]"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"  Text: {segment['text']}"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"  Confidence: {segment['avg_logprob']:.3f}\n"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Frequently asked questions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Q: Can I specify the speaker names instead of generic labels?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: No. The model outputs generic speaker labels (typically "SPEAKER_00", "SPEAKER_01", etc.). You must post-process the output to map speaker labels to actual names using external metadata or manual review.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What audio formats does the model support?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The model supports any format Whisper accepts, including WAV, MP3, M4A, and FLAC. Provide audio as a Base64-encoded string, a direct URL, or an uploaded file.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: How long can audio files be?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The model does not specify a maximum duration on Replicate. Whisper models theoretically handle arbitrary lengths, but practical performance degrades beyond 1 hour due to context limitations and latency expectations. For files longer than 30 minutes, consider chunking and processing separately.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Can I deploy this model on my own infrastructure?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Yes. Clone the GitHub repository, accept Pyannote's user conditions on HuggingFace, insert your HuggingFace API token into the code, run &lt;code&gt;cog build&lt;/code&gt;, and deploy. You need a machine with a GPU and sufficient VRAM to load Whisper Large v3 Turbo and Pyannote's models simultaneously.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What does the &lt;code&gt;avg_logprob&lt;/code&gt; metric mean, and how should I use it?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: &lt;code&gt;avg_logprob&lt;/code&gt; is the average log probability of the Whisper model's predictions for that segment. Higher (less negative) values indicate greater confidence. Use it to filter or flag low-confidence segments for manual review; values below -0.5 often indicate problematic audio or speech characteristics.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Does the model handle languages other than English?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Yes. Whisper was trained on 680,000 hours of multilingual audio and supports 99 languages. Leave the &lt;code&gt;language&lt;/code&gt; parameter empty to autodetect, or specify an ISO 639-1 code. The &lt;code&gt;translate&lt;/code&gt; flag converts any language to English transcription.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Is this model production-ready for commercial applications?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Yes, with caveats. The MIT license permits commercial use. The model runs on Replicate with no special setup. However, diarization quality degrades with noisy audio, heavy accents, or many concurrent speakers (&amp;gt;15). For mission-critical applications (legal transcription, medical records), validate accuracy on your specific domain before deployment.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: How does prompt engineering improve transcription accuracy?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The &lt;code&gt;prompt&lt;/code&gt; parameter acts as a vocabulary hint, biasing Whisper toward recognizing specific acronyms, proper nouns, and domain terms. Format terms with punctuation (e.g., "Dr. Smith, C.P.U., machine learning") for best results. This does not guarantee perfect recognition but noticeably improves accuracy on technical vocabulary and rare proper nouns.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/replicate/whisper-diarization-thomasmol?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Click here to read the full guide to Whisper-Diarization&lt;/a&gt;&lt;/p&gt;

</description>
      <category>coding</category>
      <category>ai</category>
      <category>machinelearning</category>
      <category>programming</category>
    </item>
    <item>
      <title>A beginner's guide to the Deepseek-V4-Pro-Qwen3.5-9b-Uncensored-Heretic model by Xtools-At on Huggingface</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Sat, 14 Nov 2026 03:09:35 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-deepseek-v4-pro-qwen35-9b-uncensored-heretic-model-by-xtools-at-on-4oi6</link>
      <guid>https://dev.to/aimodels-fyi/a-beginners-guide-to-the-deepseek-v4-pro-qwen35-9b-uncensored-heretic-model-by-xtools-at-on-4oi6</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a simplified guide to an AI model called &lt;a href="https://aimodels.fyi/models/huggingFace/deepseek-v4-pro-qwen3.5-9b-uncensored-heretic-xtools-at?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Deepseek-V4-Pro-Qwen3.5-9b-Uncensored-Heretic&lt;/a&gt; maintained by &lt;a href="https://aimodels.fyi/creators/huggingFace/xtools-at?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Xtools-At&lt;/a&gt;. If you like these kinds of analysis, you should join &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;AImodels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Overview
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/creators/huggingFace/xtools-at?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;xtools-at&lt;/a&gt; presents this as a decensored version of Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B, produced with Heretic v2.0.0.dev0 using Arbitrary-Rank Ablation. The underlying 9B model is a Qwen3.5-9B reasoning fine-tune distilled from DeepSeek-V4-Pro, trained primarily for mathematics and STEM; this exact Heretic variant reports 3 refusals in 100 tests and KL divergence of 0.0422 against its original.&lt;/p&gt;

&lt;h2&gt;
  
  
  Best use cases
&lt;/h2&gt;

&lt;p&gt;Mathematical problem solving, step-by-step derivation, physics and chemistry questions, broader STEM reasoning, and analytical instruction following. The underlying release also reports preliminary small gains in programming and tool-calling despite no coding data in training; this is not evidence of coding specialization.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limitations
&lt;/h2&gt;

&lt;p&gt;Coding and agentic coverage is limited, and the reported programming/tool-use transfer is preliminary rather than a substitute for dedicated benchmarks. The refusal and KL figures are reported for this Heretic variant, but the source does not describe the test prompts or methodology in detail. Benchmark results for the underlying model are not explicitly re-evaluated on this exact decensored variant.&lt;/p&gt;

&lt;h2&gt;
  
  
  How it compares
&lt;/h2&gt;

&lt;p&gt;The source compares this variant with its original model: 3/100 versus 100/100 refusals, and KL divergence 0.0422 versus 0 by definition. For related model listings, see &lt;a href="https://aimodels.fyi/models/huggingFace/deepseek-v4-pro-qwen3.5-9b-mtp-gguf-jackrong?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;DeepSeek-V4-Pro-Qwen3.5-9B-MTP-GGUF&lt;/a&gt;, &lt;a href="https://aimodels.fyi/models/huggingFace/deepseek-v4-pro-qwen3.5-4b-mtp-gguf-jackrong?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;DeepSeek-V4-Pro-Qwen3.5-4B-MTP-GGUF&lt;/a&gt;, and &lt;a href="https://aimodels.fyi/models/huggingFace/qwen3.8-27b-heretic-ara-heretic-org?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Qwen3.8-27B-heretic-ara&lt;/a&gt;. These are separate model listings; the supplied evidence does not establish a quality, speed, or cost ranking among them.&lt;/p&gt;

&lt;h2&gt;
  
  
  Technical specifications
&lt;/h2&gt;

&lt;p&gt;The exact variant is described as a Heretic v2.0.0.dev0 ARA decensoring of the 9B base fine-tune. ARA settings: start layer 9, end layer 24, preserve-good-behavior weight 0.8264, steer-bad-behavior weight 0.0003, overcorrect-relative weight 0.9645, and neighbor count 12. The underlying model was trained with approximately 250,000 math and STEM samples using SFT followed by light GSPO reinforcement-learning refinement; no coding data was included. Metadata lists Apache-2.0, Transformers, safetensors, and text-generation support. The source reports underlying-model evaluations using vLLM NVFP4 and llama.cpp MTP-Q8_0 GGUF, but does not establish that those benchmark scores apply to this exact Heretic variant.&lt;/p&gt;

&lt;h2&gt;
  
  
  Model inputs and outputs
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Inputs
&lt;/h3&gt;

&lt;p&gt;Text prompts for text generation and conversational use are supported by the supplied metadata. No exact prompt template, token limit, or generation-control settings are provided.&lt;/p&gt;

&lt;h3&gt;
  
  
  Outputs
&lt;/h3&gt;

&lt;p&gt;Text generation is the listed task. The underlying release reports strong output-format compliance in its own evaluation, but those results are not established for this exact Heretic variant.&lt;/p&gt;

&lt;h2&gt;
  
  
  Frequently asked questions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Q: What distinguishes this exact model from the underlying 9B release?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: It is described as a decensored version made with Heretic v2.0.0.dev0 and ARA. The source reports 3 refusals in 100 tests and KL divergence of 0.0422 against the original.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What is the model intended to do?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Its underlying training emphasizes mathematical reasoning, derivation, physics, chemistry, and other STEM questions. It is also presented for structured analytical instruction following.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Was it trained specifically for coding?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: No coding data was included in the described SFT or RL stages. The source reports preliminary small programming and tool-calling gains as cross-domain transfer.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: Do the listed GSM8K and MMLU-Pro scores apply to this Heretic variant?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The source gives those scores for the underlying DeepSeek-V4-Pro-Qwen3.5-9B release and does not say that the exact decensored variant was evaluated on those benchmarks.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What formats or runtimes are documented?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: Metadata lists Transformers and safetensors. The underlying release was evaluated with vLLM NVFP4 and llama.cpp MTP-Q8_0 GGUF, but the source does not confirm those evaluation builds for this exact variant.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Q: What license is listed?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A: The supplied metadata lists Apache-2.0.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://aimodels.fyi/models/huggingFace/deepseek-v4-pro-qwen3.5-9b-uncensored-heretic-xtools-at?utm_source=devto&amp;amp;utm_medium=referral" rel="noopener noreferrer"&gt;Click here to read the full guide to Deepseek-V4-Pro-Qwen3.5-9b-Uncensored-Heretic&lt;/a&gt;&lt;/p&gt;

</description>
      <category>coding</category>
      <category>ai</category>
      <category>machinelearning</category>
      <category>programming</category>
    </item>
    <item>
      <title>Cognitive Symbionts: A Framework for Measuring AI-Augmented Human Intelligence</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:24:00 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/cognitive-symbionts-a-framework-for-measuring-ai-augmented-human-intelligence-2b4h</link>
      <guid>https://dev.to/aimodels-fyi/cognitive-symbionts-a-framework-for-measuring-ai-augmented-human-intelligence-2b4h</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/autonomous-agents-cognitive-symbionts-toward-ai-augmented?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Cognitive Symbionts: A Framework for Measuring AI-Augmented Human Intelligence&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  AHI shifts the target from machine autonomy to human capability
&lt;/h2&gt;

&lt;p&gt;AI-augmented human intelligence (AHI) is the paper’s central proposal: measure how much intelligence a system enables in a particular person, alongside how much a machine can do alone. The opening examples are concrete failures of access—a researcher forgets a published result or cannot retrieve her own reasoning when making a decision. The proposed target is a person whose memory, senses, and judgment are coupled to AI.&lt;/p&gt;

&lt;p&gt;The paper calls the system a cognitive symbiont: a lifelong, embedded, real-time, private, low-friction, proactive companion. It should sense through external devices, preserve context across years, model the person’s situation and mind, and join their thinking at a useful moment. The authors distinguish this from an agent that merely completes tasks on someone’s behalf.&lt;/p&gt;

&lt;p&gt;The most specific technical concept is the &lt;strong&gt;cognitive gap&lt;/strong&gt;: the difference between what a person could bring to a situation and what they can hold in working memory. The paper organizes the system around a symbiosis loop—sensing, keeping, understanding, living alongside, acting for, thinking with, and growing—within a personal runtime and a trust boundary. It presents this as a conceptual framework, not a tested algorithm.&lt;/p&gt;

&lt;h2&gt;
  
  
  How cognitive symbiosis differs from autonomous agents...
&lt;/h2&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/autonomous-agents-cognitive-symbionts-toward-ai-augmented?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>Soft-MTP Isolates the KL Signal to Improve Multi-Token Prediction</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:23:25 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/soft-mtp-isolates-the-kl-signal-to-improve-multi-token-prediction-2io1</link>
      <guid>https://dev.to/aimodels-fyi/soft-mtp-isolates-the-kl-signal-to-improve-multi-token-prediction-2io1</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/multi-token-prediction-done-right?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Soft-MTP Isolates the KL Signal to Improve Multi-Token Prediction&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Soft-MTP isolates the useful part of MTP training
&lt;/h2&gt;

&lt;p&gt;Soft Multi-Token Prediction (Soft-MTP) changes standard MTP training by routing only a KL self-distillation gradient through the MTP heads and shared trunk. In experiments on LLaMA-style models from 167M to 1.2B parameters, it improves next-token perplexity, speculative-decoding acceptance, and zero-shot accuracy over standard MTP, without adding parameters or measurable overhead.&lt;/p&gt;

&lt;p&gt;The central technical claim is that a standard MTP cross-entropy gradient splits exactly into two terms: a KL gradient that pulls an MTP prediction toward the model’s own position-aligned next-token distribution, and a residual cross-entropy gradient against the sampled data token. The authors report that the residual has lower signal-to-noise ratio and can interfere with both next-token and multi-token learning.&lt;/p&gt;

&lt;p&gt;Soft-MTP recovers the KL gradient by combining existing next-token and MTP cross-entropy gradients through straight-through gradient routing. This avoids constructing vocabulary-sized logit matrices, remains compatible with fused cross-entropy kernels, and is presented as a one-line change to standard MTP code....&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/multi-token-prediction-done-right?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
    <item>
      <title>VFlash Decodes Whole Robot Trajectories in One Pass, Improving Accuracy and Speed</title>
      <dc:creator>aimodels-fyi</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:22:49 +0000</pubDate>
      <link>https://dev.to/aimodels-fyi/vflash-decodes-whole-robot-trajectories-in-one-pass-improving-accuracy-and-speed-2l0n</link>
      <guid>https://dev.to/aimodels-fyi/vflash-decodes-whole-robot-trajectories-in-one-pass-improving-accuracy-and-speed-2l0n</guid>
      <description>&lt;p&gt;&lt;em&gt;This is a Plain English Papers summary of a research paper called &lt;a href="https://aimodels.fyi/papers/arxiv/vflash-fast-accurate-visual-planning-via-flash?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;VFlash Decodes Whole Robot Trajectories in One Pass, Improving Accuracy and Speed&lt;/a&gt;. If you like these kinds of analyses, you can find more AI and machine-learning research on &lt;a href="https://aimodels.fyi?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;AIModels.fyi&lt;/a&gt; or follow us on &lt;a href="https://x.com/aimodelsfyi" rel="noopener noreferrer"&gt;Twitter&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  VFlash turns whole spatial plans into one decoding step—and improves their accuracy
&lt;/h2&gt;

&lt;p&gt;VFlash replaces token-by-token coordinate generation with a lightweight drafter that predicts an entire structured visual primitive—such as a trajectory or bounding box—in one pass. Across the evaluated robot trajectory tasks, it reduces errors versus its autoregressive (AR) target; dense 3D point-motion forecasting is about 25× faster in preliminary single-rollout measurements. In downstream MolmoSpaces manipulation, a world action model conditioned on VFlash plans reaches 70.2% average success across four task suites, up from 62.6% for the baseline.&lt;/p&gt;

&lt;h2&gt;
  
  
  The primitive’s known layout lets VFlash skip token-by-token agreement
&lt;/h2&gt;

&lt;p&gt;A visual primitive has a known schema: its type, coordinate dimensions, and extent determine what each output position means. VFlash uses that schema to build a prediction block for the complete primitive, with the requested length setting the block size for variable-length trajectories. A lightweight diffusion drafter, conditioned on features from a frozen vision-language model (VLM), predicts all coordinate positions jointly; constraints then enforce legal coordinate and delimiter formats....&lt;/p&gt;




&lt;p&gt;&lt;strong&gt;&lt;a href="https://aimodels.fyi/papers/arxiv/vflash-fast-accurate-visual-planning-via-flash?utm_source=devto&amp;amp;utm_medium=referral&amp;amp;utm_campaign=arxiv_papers" rel="noopener noreferrer"&gt;Continue reading the full paper summary on AIModels.fyi →&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>ai</category>
      <category>programming</category>
      <category>datascience</category>
    </item>
  </channel>
</rss>
