IEEE

Mitigating Backdoor Attacks in Pre-Trained Encoders via Self-Supervised Knowledge Distillation

Abstract: Pre-trained encoders in computer vision have recently received great attention from both research and industry communities. Among others, a promising paradigm is to utilize self-supervised ...
GitHub

LENZ Encoders

Simple Installation · Bearingless · Non-contact · High Speed Operation · Insensitive to EMFs · Reliable Feedback LENZ Encoders are non-contact bearingless absolute angle encoders. Two printed circuit ...
IEEE

Cross-Aware Early Fusion With Stage-Divided Vision and Language Transformer Encoders for Referring Image Segmentation

Abstract: Referring segmentation aims to segment a target object related to a natural language expression. Key challenges of this task are understanding the meaning of complex and ambiguous language ...
GitHub

Return of the Encoder: Efficient Small Language Models

We note that our work focuses on architectural comparisons rather than competing with recent SLM developments (e.g., SmolLM, MobileLLM). Our analysis isolates the fundamental advantages of ...