Towards Robust Unsupervised Object Detection : A Multi-Layer Framework Using Open-Vocabulary Zero-Shot Detector, Vision-Language Models and Segmentation for Data Annotation

Sammanfattning

Object detection has witnessed significant progress in recent years; however, its application in the Nordic region has remained limited. This is largely due to region’s unique geographical and environmental characteristics which creates a significant domain gap between available aerial datasets and the conditions existing in Nordic regions. Additionally, there is notable scarcity of annotated data in this region, which further limits the industrial adoption of current object detection methods. This master’s thesis addresses these challenges by proposing a multi-layered framework that leverages state-of-the-art pre-trained models such as Grounding DINO, SAM2, and Vision-Language Models such as Gemma3 and PaliGemma2, to generate high-quality pseudo-labels from unannotated data in an unsupervised manner. These pseudo-labels can then be used for training, evaluation, and fine-tuning of object detection models, ultimately supporting the development of robust and scalable object detection solutions.