How DeepSeek’s DSpark Makes LLMs 85% Faster Without Retraining

DeepSeek has introduced DSpark, an open-source speculative decoding method that accelerates LLM inference by up to 85% ...
VentureBeat

Context compression finally works in production: new research cuts LLM input 16x without the accuracy hit

Context windows are becoming a computational bottleneck. The longer an agent runs, the more tokens accumulate from retrieved documents, reasoning traces and conversation history, and the more memory ...
InfoQ

Gemma 4 12B Enables On-Device, Multimodal Agentic Workflows with an Encoder-free Architecture

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
note

Multimodal LLMs That Ditched the Encoder — Reading the "Direct Projection" Architecture of Gemma 4 12B

On June 3, 2026, Google DeepMind released Gemma 4 12B (where 12B = 12G = 12 billion parameters). It is a model capable of handling images, audio, and video, making it an AI that can process multiple ...
note

Gemma 4 12B In-Depth: A New Model Bringing Full-Scale Multimodality to Laptops with an Encoder-Free Design

Gemma 4 12B is a new model in the Gemma 4 family announced by Google on June 3, 2026. It is positioned as an "encoder-free unified multimodal model optimized for laptops." The official blog (Google ...
IEEE

Towards Effective and Efficient Non-Autoregressive Decoders for Conformer and LLM-Based ASR Using Block-Based Attention Mask

Abstract: Automatic speech recognition (ASR) systems often rely on autoregressive (AR) Transformer decoder architectures, which limit efficient inference parallelization due to their sequential nature ...
GSM Arena

MediaTek unveils Dimensity 8550 with LLM Booster and support for Gemini Nano V3

Earlier this year, MediaTek unveiled the Dimensity 8500, a 4nm (TSMC N4P) chipset with all-big CPU cores (eight Cortex-A725) and a Mali-G720 MC8 GPU. Now the company is refreshing that chip as the ...
IEEE

A Siamese Encoder-Decoder Model with Attention for LLM Prompt Reconstruction

Abstract: Reconstructing prompts in text generation systems is a significant challenge in natural language processing (NLP). This study presents a novel Siamese encoder-decoder framework augmented ...