Computer Vision

Structured-Noise Masked Modeling for Video, Audio and Beyond

ECCV 2026 Oral. Structured masks built by filtering white noise into color noise for masked video and audio modeling, at no additional computational cost.

Structured-Noise Masked Modeling for Video, Audio and Beyond

We filter white noise into different color noise distributions to build structured masks for masked video and audio modeling: Green3D for video and Regularized Blue Noise for audio, improving over random masking at no additional computational cost.

CURE: Curriculum-Guided Multi-Task Training for Reliable Anatomy-Grounded Report Generation

We propose CURE, a curriculum-guided multi-task training framework for reliable, anatomy-grounded radiology report generation. Developed with collaborators at KAUST and Pontificia Universidad Católica de Chile, CURE was selected for oral presentation …

UnMix-NeRF: Spectral Unmixing Meets Neural Radiance Fields

UnMix-NeRF brings spectral unmixing into Neural Radiance Fields, enabling spectral-aware 3D scene reconstruction. See the [project page](https://www.factral.co/UnMix-NeRF/) for more details.

ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders

We explore data-independent masking strategies for Masked AutoEncoders (MAE), showing that carefully designed structured noise masks can match or improve upon learned/data-dependent masking, while being simpler and more efficient. See our [Project …

ColorMAE: Data-independent Masking for Masked AutoEncoders

ECCV 2024. Mask patterns generated by filtering random noise, which improve MAE representations without extra parameters or computation.

Privacy-preserving Optics for Enhancing Protection in Face De-identification

CVPR 2024. Privacy-preserving optics that strengthen protection in face de-identification.

PrivHAR: Recognizing Human Actions from Privacy-preserving Lens

The accelerated use of digital cameras prompts an increasing concern about privacy and security, particularly in applications such as action recognition. In this paper, we propose an optimizing framework to provide robust visual privacy protection …

Optics lens design for privacy-preserving scene captioning

Image captioning is a challenging task that connects two major artificial intelligence fields: computer vision and natural language processing. Image captioning models use traditional images to generate a natural language description of the scene. …

Optics Lens Design for Privacy-preserving Scene Captioning

ICIP 2022 Best Paper Award. A designed optical lens that describes scenes while protecting the privacy of people in them.