Inference Brew

DeepSeek-V4-Flash API Enters Public Beta

00:00 / --:--

← Back to home

DeepSeek-V4-Flash API Enters Public Beta

1. DeepSeek-V4-Flash API Enters Public Beta

DeepSeek has expanded its managed API offerings by launching the DeepSeek-V4-Flash model in public beta. This follows the model's initial release as open weights in May and the broader V4 series production launch in July. The new API endpoint provides developers with a high-performance, low-latency option priced at $0.09 per million input tokens and $0.18 per million output tokens, complementing the existing open-weight deployment options and the flagship V4 Pro API.

  • DeepSeek-V4-Flash API is now in public beta.
  • Pricing is set at $0.09 per 1 million input tokens and $0.18 per 1 million output tokens.
  • The model scored 50 on the ArtificialAnalysis Index.
  • Benchmarks include Terminal Bench 2.1 (82.7), DSBench-FullStack (68.7), and DeepSWE (54.4).
  • DeepSeek-V4-Pro official release is expected to follow.

Developers can now access the efficient V4-Flash architecture via a managed API, providing a cost-effective alternative to self-hosting the open-weight version.

2. Google Generalizes Gemini Live API for Real-Time Voice and Vision

Google has officially launched the Gemini Live API for general use, expanding its capabilities beyond the initial translation preview. Developers can now integrate low-latency, real-time voice and vision interactions into their applications, processing continuous streams of audio, images, and text to create responsive, human-like conversational agents. This release simplifies the development of highly interactive, multimodal conversational experiences by removing the need to manage complex streaming pipelines manually.

  • The Gemini Live API is now generally available for real-time voice and vision integration.
  • Expands on the initial preview that focused on speech-to-speech translation.
  • Supports continuous, simultaneous streams of audio, images, and text.
  • Simplifies the development of interactive, multimodal conversational agents.

This transition from preview to general availability allows developers to build production-ready, highly interactive, multimodal conversational experiences without managing complex streaming pipelines.

SOURCES

3. MiniMax Releases H3 Multimodal Video and Audio Generation Model

MiniMax has launched H3, an open multimodal model designed to handle unified context across text, images, video, and audio. The model is capable of generating up to 15 seconds of video at 2K resolution, complete with native stereo sound. MiniMax H3 also features strong instruction-following capabilities, accurate text and brand rendering, and video-to-video (V2V) motion transfer, making it immediately viable for developers building commercial content creation and editing tools.

  • MiniMax H3 is an open model designed to process unified context across text, images, video, and audio.
  • The model can generate up to 15 seconds of video at 2K resolution with native stereo sound.
  • It supports instruction following, accurate text and brand rendering, and video-to-video (V2V) motion transfer.
  • Early testing indicates the model is ready for commercial content creation use cases.

Developers can build rich, multimodal content creation features, including high-resolution video generation and motion transfer, directly into their apps.

SOURCES

4. Meituan Releases LongCat-Flash-Lite-Sparse MoE Model

Meituan has introduced LongCat-Flash-Lite-Sparse, an open Mixture-of-Experts (MoE) model featuring 3 billion active parameters. The model's standout feature is its ability to process a 256k context window on a single 24GB GPU, achieved by offloading a 30 billion n-gram lookup table to system RAM. While the architecture draws comparisons to the PLE technique in Gemma 4, early developer feedback suggests it may not yet outperform established options like Qwen 3.6 27b for general use cases.

  • LongCat-Flash-Lite-Sparse is a Mixture-of-Experts (MoE) model with approximately 3 billion active parameters.
  • The model utilizes a 30 billion n-gram lookup table offloaded to RAM to enable a 256k context window on a single 24GB GPU.
  • The architecture is compared to the PLE trick used in Google's Gemma 4.
  • Initial developer analysis indicates the model is not expected to replace the Qwen 3.6 27b model for standard tasks.

This model demonstrates a novel way to handle massive context windows on consumer-grade hardware, though early testing suggests it may not yet replace established models like Qwen.

SOURCES

5. AgentForger Vulnerability Allows Remote Takeover of AI Agents

Zenity Labs has disclosed 'AgentForger,' a critical security vulnerability that affected virtually every agentic browser on the market. The vulnerability allowed an attacker to plant an autonomous, attacker-controlled agent inside an organization's environment simply by tricking a user or agent into clicking a crafted link. OpenAI has already released a patch to address the issue. To protect their own deployments, developers are urged to adopt 'least agency' principles and establish strict runtime boundaries for any browser-capable agents.

  • The AgentForger vulnerability allowed a crafted link to plant an autonomous, attacker-controlled agent within an organization.
  • The vulnerability affected agentic browsers across the market.
  • OpenAI has released a patch to address the AgentForger vulnerability.
  • Zenity's CISO's Guide to Securing Agentic AI recommends implementing 'least agency' and strict runtime boundaries to mitigate these threats.

Developers building agentic applications must implement strict runtime boundaries and 'least agency' principles to prevent malicious links from hijacking their agents.

SOURCES

6. DataFlow-Harness Framework Closes the NL2Pipeline Gap for AI Agents

Researchers from Peking University, Zhongguancun Academy, and Shanghai’s Institute for Advanced Algorithms Research have open-sourced DataFlow-Harness, a framework designed to solve the 'NL2Pipeline gap.' This gap occurs when AI agents struggle to ground generated code in live production platforms with strict schemas. Instead of letting agents write free-form code, DataFlow-Harness represents pipelines as directed acyclic graphs (DAGs) and uses typed mutations to let agents add or connect operators. In benchmarks, this approach achieved a 93.3% pass rate while reducing API costs by 72.5% and latency by 49.9% compared to standard Claude Code.

  • Researchers from Peking University and other institutions introduced DataFlow-Harness, an open-source framework for building structured, visual data-processing workflows.
  • The framework represents pipelines as directed acyclic graphs (DAGs) and uses typed mutations to let agents add or connect operators instead of writing free-form code.
  • In a 12-task data-engineering benchmark, DataFlow-Harness achieved a 93.3% end-to-end pass rate.
  • Compared to standard Claude Code, the framework reduced API costs by 72.5% and response latency by 49.9%.
  • The framework is released under the Apache 2.0 license and is available on GitHub.
  • It consists of four components: a Data Pipeline Backend, a DataFlow-WebUI, an MCP Tools Layer, and an AI guidance layer called DataFlow-Skills.

Developers can use this framework to let AI agents reliably build and modify structured data pipelines without writing risky, free-form code.

SOURCES

7. Cursor Optimizes Cloud Environments for Coding Agents

Cursor has rolled out significant improvements to its development environments, specifically optimized to help AI agents understand, run, and test code. By structuring the environment context to be more agent-friendly, Cursor reports that the percentage of merged pull requests contributed to by cloud agents has surged from roughly 10% to over 50%. This update highlights how tailoring the runtime environment, rather than just the model, can dramatically boost agent productivity.

  • Cursor improved its development environments to make them easier for agents to understand, run, and test code.
  • These environment optimizations enabled cloud agents to increase their contribution to merged pull requests from approximately 10% to more than 50%.

Developers using Cursor can expect significantly more autonomous and successful code contributions from integrated agents due to optimized environment context.

SOURCES

8. Tilde SDK Released for Building and Self-Hosting Code Review Agents

Developer Tilde has released a harness SDK platform designed to simplify building and self-hosting custom AI agents. Developed as a side project over the past year, Tilde decomposes features from OpenClaw and Hermes into modular cloud API building blocks. To help developers get started, the creator has published a GitHub repository with concrete examples demonstrating how to construct and self-host a dedicated code review agent.

  • Tilde is a harness SDK platform developed as a side project over the last year.
  • The platform decomposes features from OpenClaw and Hermes into cloud API building blocks.
  • Tilde allows users to create and self-host AI agents for their specific use cases.
  • The developer has provided a GitHub repository containing examples to showcase the API functionality.

Developers can use Tilde's SDK and example repository to quickly build, customize, and self-host their own code review agents.

SOURCES

9. Agent Behavior Open Standard Launched for AI Agent Evaluation

A new open standard called Agent Behavior has been launched to address the challenges of evaluating autonomous AI agents. The standard uses simple Markdown files to specify the recurring conduct and boundaries required for an agent to be considered reliable. By providing a concrete framework for reviewers, rubrics, and scorers, Agent Behavior helps developers systematically review execution traces, write robust evaluation cases, and refine prompts or tools to align agent actions with team expectations.

  • Agent Behavior is an open standard that defines and evaluates AI agent behavior across a full trajectory.
  • Each behavior specification is written as a Markdown file outlining the recurring conduct required for agent reliability.
  • The standard provides a concrete framework for reviewers, rubrics, scorers, and evaluations to measure against.
  • It supports reviewing traces, writing evaluation cases, revising prompts or tools, and communicating intended agent conduct to teams.

Developers get a structured, standardized framework to write evaluation cases, review agent traces, and ensure reliable agent conduct.

SOURCES

10. MarbleOS Reimagines AI Agent Interaction as a Visual Workspace

Creators Akilan and Miguel have launched MarbleOS, a downloadable beta interface that challenges the dominant chat-based paradigm of AI interaction. Drawing inspiration from classic GUI milestones like Xerox PARC and NeXTSTEP, MarbleOS treats AI as a visual workspace. The platform represents tasks as cards, allowing multiple agent jobs to run concurrently while keeping files, tools, and artifacts fully visible. It also displays the tools an agent plans to use before execution and outputs directly usable files like spreadsheets rather than simple text transcripts.

  • MarbleOS is an interface designed to treat AI as a workspace rather than a chat application, inspired by Xerox PARC, the 1984 Macintosh, and NeXTSTEP.
  • The platform represents tasks as cards, allowing multiple jobs to run simultaneously while keeping files, tools, and artifacts visible.
  • MarbleOS displays the tools an agent expects to use before a task begins execution.
  • The system produces directly usable files, such as spreadsheets or PowerPoint presentations, instead of chat transcripts.
  • A downloadable beta version of MarbleOS is currently available on the project's website.

Developers can explore a new GUI paradigm for agentic workflows that replaces command-line and chat interfaces with a visual, multi-tasking workspace.

SOURCES

11. WASTE Engine Enables Kimi K3 Inference on 64GB Consumer Hardware

Following the release of Kimi K3 and subsequent quantization efforts by Atomic Chat and Unsloth, the new WASTE inference engine has been released to further lower hardware requirements. Unlike previous methods that required massive RAM (1.5 TB) or standard quantization, WASTE enables running the 2.78-trillion-parameter Kimi K3 model on a 64GB MacBook Pro by keeping the model trunk in RAM and streaming experts from disk. This approach allows for local execution on standard consumer hardware, albeit at a slower inference speed.

  • WASTE is an open-source, dependency-free C inference engine.
  • Enables running Kimi K3 on a 64GB MacBook Pro by streaming experts from disk.
  • Achieves 0.49–0.54 tokens per second for Kimi K3.
  • Supports smaller models like Kimi-Linear-48B at 10.7 tokens per second.
  • Engine selects SIMD instructions at runtime and supports Linux, macOS, and Windows.

This development significantly reduces the hardware barrier for running trillion-parameter models, moving from enterprise-grade memory requirements to standard consumer laptops.

SOURCES

12. Hugging Face Storage Buckets Now Available with Per-TB Pricing

Building on the previously announced S3 API compatibility, Hugging Face has now officially launched its Storage Buckets service. This release introduces a simple, flat per-TB pricing model for storing models, datasets, and artifacts, providing developers with a dedicated alternative to traditional cloud object storage within the Hugging Face ecosystem.

  • Hugging Face has officially launched its Storage Buckets service.
  • The service features a new, flat per-TB pricing structure.
  • This follows the previously announced S3 API support, allowing for seamless integration with existing storage tools.

Developers can now utilize a fully-featured, priced storage service that integrates with their existing S3-compatible workflows.

SOURCES

13. Harness Design Drives 22% Accuracy Swing in Small Model Classification

A detailed ablation study conducted on a 4B model highlights the massive impact of harness and prompt design on small-model performance. Running on a 6GB laptop GPU for a Kubernetes triage task, the study kept weights frozen and isolated harness variables. The results showed a 22 percentage point swing in accuracy (from 60% to 82%). Key findings include: explicit rules in the prompt added 13 points, and placing the task before reference material added 6.5 points. Conversely, carrying summaries instead of raw evidence lost 12 points, and fresh-session handoffs between stages lost 15 points.

  • An ablation study on a 4B model running on a 6GB laptop GPU isolated the impact of harness design on a Kubernetes SIG triage task.
  • Accuracy varied from 60% to 82% using identical frozen weights, a 250-issue gold corpus, and a single scorer.
  • Explicit rules in the prompt improved accuracy by 13 points, while placing the task before reference material improved it by 6.5 points.
  • Adding an extra reasoning turn decreased accuracy by 5 points, and carrying a summary forward instead of raw evidence decreased it by 12 points.
  • Using a fresh-session handoff between stages decreased accuracy by 15 points.
  • The worst-performing harness design resulted in bare-model accuracy despite utilizing an extra stage and 250 tool calls.
  • The corpus, scorer, pre-registration, and run manifests are publicly available on GitHub.

Developers fine-tuning or deploying small models can achieve massive accuracy gains simply by optimizing prompt placement and session management, without retraining.

SOURCES

14. Open-Weight LLMs Achieve Parity with Closed Models on Regulatory Tasks

A new evaluation using the ClinReg benchmark reveals that open-weight LLMs have achieved accuracy parity with leading closed-source models for regulatory and clinical tasks. Models such as GLM 5.2 and Kimi K3 performed within one standard deviation of OpenAI's proprietary GPT 5.6 Sol model. Because these open-weight models operate at roughly one-third the cost of top-tier proprietary APIs, developers can significantly reduce operational expenses, provided they select models based on task-specific error profiles rather than general leaderboard rankings.

  • The ClinReg benchmark demonstrates that open-weight models like GLM 5.2 and Kimi K3 perform within one standard deviation of the proprietary GPT 5.6 Sol model.
  • Open-weight models operate at approximately one-third the cost of top proprietary models.
  • The study highlights that different models exhibit distinct error profiles, meaning model selection should be task-specific.

Developers building specialized applications can transition to open-weight models to cut API costs by up to two-thirds without sacrificing accuracy.

SOURCES

15. Manifest Deprecates LLM Router in Favor of Manual Selection and Caching

Manifest has officially deprecated and shut down its LLM router feature after a four-month trial with 7,000 cloud users. The company concluded that automated routing is counterproductive for production applications. According to Manifest, prompt complexity cannot be accurately predicted from the initial prompt alone, as context is often revealed dynamically through tool calls. Furthermore, automated routing introduces behavioral inconsistency that breaks agentic workflows. Manifest now advises developers to manually select models based on intent and leverage context caching, which reduces costs by 75% to 90% without sacrificing predictability.

  • Manifest launched its LLM router in March and officially shut it down on September 1st after testing with 7,000 cloud users over four months.
  • The company found that prompt complexity cannot be determined by the prompt alone because context is often revealed through tool calls and web searches.
  • Manifest reports that LLM routers break behavior consistency and introduce unpredictability, increasing maintenance costs for automated agentic workflows.
  • The company claims context caching is more effective for cost reduction, noting that cache reads are 75% to 90% cheaper than uncached inputs.
  • Manifest now recommends that engineers manually select models and parameters based on specific intent.

Developers building agentic workflows should reconsider automated LLM routers, as manual model selection and context caching offer better predictability and cost savings.

SOURCES

Inference Brew in your inbox

5 minutes a day. Free, unsubscribe anytime.

Inference Brew in your inbox

5 minutes a day. Free, unsubscribe anytime.