Tech Xplore

Discrete spatial diffusion models data while obeying scientific principles

Researchers at Los Alamos National Laboratory have developed a new approach that addresses the limitations of generative AI ...
Tech Xplore

One image is all robots need to find their way

While the capabilities of robots have improved significantly over the past decades, they are not always able to reliably and ...
GitHub

GD-Retriever: Controllable Generative Text-Music Retrieval with Diffusion Models

1 Centre for Digital Music, Queen Mary University of London, U.K. 2 Music & Audio Machine Learning Lab, Universal Music Group, London, U.K. Multimodal contrastive models have achieved strong ...
IEEE

EdgeDiff: Energy-Efficient Multi-Modal Few-Step Diffusion Model Accelerator Using Mixed-Precision and Reordered Group Quantization

Abstract: Recent advances in diffusion models (DMs)—such as few-step denoising and multi-modal conditioning—have significantly improved computational efficiency and functional flexibility, but they ...
GitHub

Pusa: Thousands Timesteps Video Diffusion Model

Text-to-Video, Image-to-Video, Start-End Frames, Video Completion, Video Extension, Video Transition, and more.... Below are some showcases for Pusa-Wan2.2-V1. Please refer to Pusa V1.0 README for ...
marktechpost

Meta AI Open-Sourced Perception Encoder Audiovisual (PE-AV): The Audiovisual Encoder Powering SAM Audio And Large Scale Multimodal Retrieval

Perception Encoder, PE, is the core vision stack in Meta’s Perception Models project. It is a family of encoders for images, video, and audio that reaches state of the art on many vision and audio ...
marktechpost

Google Introduces T5Gemma 2: Encoder Decoder Models with Multimodal Inputs via SigLIP and 128K Context

T5Gemma 2 follows the same adaptation idea introduced in T5Gemma, initialize an encoder-decoder model from a decoder-only checkpoint, then adapt with UL2. In the above figure the research team show ...
IEEE

High-Resolution Aerial Image Restoration with Latent Diffusion Models

Abstract: This paper aims to improve the performance of diffusion models in high-resolution unmanned aerial vehicle (UAV) aerial image restoration tasks. We propose an efficient image restoration ...