🚀 About the Survey

This paper provides an overview of the recent advancements in foundation models and discusses potential applications of these models in the field of biometrics. Foundation models, such as Large Language Models (LLMs), Vision Language Models (VLMs), Audio-Language Models (ALMs), and Large Multi-modal Models (LMMs), are based on large neural networks which are trained with massive amounts of data and enable robust feature extraction for transfer learning. These models allow efficient zero-shot and few-shot learning, achieving state-of-the-art performance in downstream tasks. Biometrics is also an active field of research, which involves various research problems, ranging from robust recognition to security and privacy in biometric systems. In this paper, we present an in-depth analysis of state-of-the-art methodologies regarding foundation multi-modal models, their advancements, and their applicability to biometrics tasks. We also highlight current limitations and provide insights into potential future research directions in the applications of foundation models in biometrics. To our knowledge, this paper is the first survey which investigates the applications of foundation models in biometrics. [ Link to pre-print ] [ Link to paper on IEEE-Xplore (Open Access) ]

The survey is structured as follows for clarity and readability:

• Foundation Models: In this section, we review recent advancements in foundation models and mention state-of-the-art models. We catgeorise foundation models in four different catgories:
  • Large Language Models (LLMs)
  • Vision Language Models (VLMs)
  • Audio-Language Models (ALMs)
  • Large Multi-modal Models (LMMs)

• Biometric Recognition and Security: In this section, we review the general pipeline of biometric systems. We describe attack points in biometric systems and discuss security and privacy threats. For information about this section, we refer the readers to Section III of our survey paper.

• Applications of Foundation Models in Biometrics: In this section, we review recent papers on the applications of foundation models in biometrics:
  • Foundation Models for Biometric Recognition
  • Foundation Models for Soft-biometric Detection
  • Foundation Models for Deepfake and Forgery Detection
  • Foundation Models for Anti-spoofing
  • Foundation Models for Synthetic Biometric Generation