CORTEXA
← Browse
arxivcs.CV2026-07-09

SAM-MT: Real-Time Interactive Multi-Target Video Segmentation

Ruiqi Shen, Chang Liu, Henghui Ding

Modern Video Object Segmentation (VOS) involves tracking and segmenting user-specified targets. While recent approaches have achieved remarkable performance in single-target scenarios, extending them to multi-target settings typically involves replicating the single-target processing for each individual object, resulting in reduced frame rates (FPS) with unbounded latency as target count increases. Built upon Segment Anything 2 (SAM2), we propose SAM-MT, which addresses this by transforming the model into an interactive framework for real-time Multi-Target video segmentation. SAM-MT uses explicit queries to represent different individual targets, in parallel with a shared representation for global context. It employs decoupled masked attention to keep individual identities distinct from cross-target interference, and sparse memory for stable temporal evolution, along with specialized strategies for occlusion handling and overlap prevention. SAM-MT successfully decouples latency from the number of targets, achieving real-time speed on par with single-target baselines (>36 FPS for 10 targets) while maintaining SAM2's robust video segmentation performance.

View free PDFSource page

Related papers

arxivcs.CV2026-07-11

NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices

Filip Pawlicki, Marcel Kańduła, Marcin Pucek, Kamil Dobies

Recent Video Super-Resolution (VSR) methods rely heavily on transformers and explicit optical flow, creating computational overhead and custom operations that hinder deployment on hardware accelerators like TensorRT. To address this, we introduce NanoVSR, a scalable, fully convol…

View free PDFSource page
arxivcs.CV2026-07-07

URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching

Pouya Sohrabipour, Chaitanya kumar reddy Pallerla, Dongyi Wang

Real-time stereo matching is crucial for robotics, autonomous systems, and embedded vision applications, where both computational efficiency and disparity accuracy are required. Recent coarse-to-fine stereo matching methods improve efficiency by progressively refining disparity e…

View free PDFSource page
arxivcs.CVcs.MAcs.MM2026-07-17

Toward Semantic Communication for Real-time Mobile 3D Reconstruction

Fangzhou Zhao, Yao Sun, Xuesong Liu, Runze Cheng, Shang Kai, Yi Sun

Real-time mobile 3D reconstruction is fundamental to many emerging applications such as autonomous navigation and digital twin construction, where a moving platform continuously captures an image stream and transmit to a computing server for scene understanding. Unlike offline re…

View free PDFSource page
arxivcs.LGcs.CVeess.SPstat.ML2026-07-15

PiVoT: A Variational Solution for Real-time Large-scale Multi-object Detection and Tracking under Heavy Clutter

Runze Gan, Qing Li, Simon J. Godsill, Mike E. Davies, James R. Hopgood

Multi-object detection and tracking from noisy point clouds remain challenging in many data-scarce radar applications. Current Bayesian trackers based on Poisson measurement models offer a training-free solution but struggle to achieve accuracy and efficiency under severe clutter…

View free PDFSource page
arxivcs.CV2026-07-14

WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction

Li Hu, Guangyuan Wang, Peng Zhang, Bang Zhang

We present WanToFight, a generative game engine that simulates real-time, two-player The King of Fighters '97 (KOF~'97) gameplay from keyboard input. Prior generative game engines target either single-player first-person settings or non-real-time cooperative scenarios; multi-play…

View free PDFSource page
arxivcs.CVcs.AI2026-07-03

A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation

Estera Dumitru, Stelian Spînu

Modern video surveillance systems generate far more video streams than human operators can effectively monitor, making automated analysis essential for timely detection of security events. This paper presents a unified multi-task deep learning framework that simultaneously perfor…

View free PDFSource page