Deepfake Detection and Authentication Using Hybrid Artificial Intelligence Models: A Case Study

Temitope Damilola Elijah, Oluwafemi Olasehinde Adedayo, Olayemi Babawole Familusi

Abstract

The progress of artificial intelligence (AI) has enabled the creation of very realistic synthetic media, also known as deepfakes, which poses a serious threat to information integrity and social confidence. The article examined the process of detecting and authenticating deep fakes using hybrid AI models. The researchers employed the case study methodology, based on the Celeb-DF V2 dataset, one of the most challenging datasets for generating high-quality manipulated videos. The suggested system combined convolutional neural networks (CNNs) to extract spatial features, recurrent neural networks (LSTMs/GRUs) to model temporal consistency, and transformer systems to analyse fine-grained context. The researchers bundled these parts together to enhance robustness and generalisation in an ensemble mechanism. They also introduced provenance tracking and semi-fragile watermarking to supplement detection, enabling proactive authentication and watermark verification of media through blockchain-based provenance tracking. The experimental findings showed that the hybrid models were more accurate, achieved higher F1 Scores, and were more robust to adversarial manipulations than the single-model baselines. The hybrid with a transformer achieved the best accuracy (0.95 AUC) and the lowest false-positive rate (6%), but at the expense of slower processing speeds. Authentication tools also helped strengthen trust by verifying the originality of content and flagging potential manipulation before it was classified. The results have revealed that hybrid AI models, when implemented with authentication strategies, represent a more effective and legitimate approach to addressing the threats of misinformation, fraud, and loss of trust among the population in the face of deepfakes.



Keywords


Deepfake detection; Hybrid AI models; Convolutional neural networks (CNNs); Long short-term memory (LSTM); Transformers

Full Text:

PDF


References


1. Dehghani, A., & Saberi, H. (2025). Generating and Detecting Various Types of Fake Image and Audio Content: A Review of Modern Deep Learning Technologies and Tools. arXiv preprint arXiv:2501.06227.

2. Croitoru, F., Hiji, A., Hondru, V., Ristea, N. C., Irofti, P., Popescu, M., Rusu, C., Ionescu, R. T., Khan, F. S., & Shah, M. (2024). Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook. arXiv (Cornell University). doi: 10.48550/arxiv.2411.19537

3. Hashmi, A., Shahzad, S. A., Lin, C., Tsao, Y., & Wang, H. (2024). Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights. arXiv (Cornell University). doi: 10.48550/arxiv.2411.07650

4. Khanjani, Z., Watson, G., & Janeja, V. P. (2021). How deep are the fakes? Focusing on audio Deepfake: a survey. arXiv (Cornell University). doi: 10.48550/arxiv.2111.14203

5. Yi, J., Wang, C., Tao, J., Zhang, X., Zhang, C. Y., & Zhao, Y. (2023). Audio Deepfake Detection: A Survey. Journal of Latex Class Files, 14(8)

6. Lee, H., Lee, C., Farhat, K., Qiu, L., Geluso, S., Kim, A., & Etzioni, O. (2024). The Tug-of-War between deepfake generation and detection. arXiv (Cornell University). doi: 10.48550/arxiv.2407.06174

7. Almars, A. M. (2021). DeepFakes Detection Techniques Using Deep Learning: A Survey. Journal of Computer and Communications, 09(05), 20–35. doi: 10.4236/jcc.2021.95003

8. Singh, L. H., Charanarur, P., & Chaudhary, N. K. (2025). Advancements in Detecting Deepfakes: AI Algorithms And Future Prospects − A Review. Discover Internet of Things, 5(1). doi: 10.1007/s43926-025-00154-0

9. Neekhara, P., Hussain, S., Zhang, X., Huang, K., McAuley, J., & Koushanfar, F. (2022). FaceSigns: Semi-Fragile neural watermarks for media authentication and countering deepfakes. arXiv (Cornell University). doi: 10.48550/arxiv.2204.01960

10. Thing, V. L. L. (2023). Deepfake Detection with Deep Learning: Convolutional Neural Networks versus Transformers. arXiv (Cornell University). doi: 10.48550/arxiv.2304.03698

11. Saikia, P., Dholaria, D., Yadav, P., Patel, V., & Roy, M. (2022). A Hybrid CNN-LSTM Model for Video Deepfake Detection by Leveraging Optical Flow Features. arXiv (Cornell University). doi: 10.48550/arxiv.2208.00788

12. Xi, A. J., & Chen, E. (2025). Classifying deepfakes using SWin transformers. arXiv (Cornell University). doi: 10.48550/arxiv.2501.15656

13. Soudy, A. H., Sayed, O., Tag-Elser, H., Ragab, R., Mohsen, S., Mostafa, T., Abohany, A. A., & Slim, S. O. (2024). Deepfake detection using convolutional vision transformers and convolutional neural networks. Neural Computing and Applications, 36(31), 19759–19775. doi: 10.1007/s00521-024-10181-7

14. Khan, S. A., Artusi, A., & Dai, H. (2021). Adversarially robust deepfake media detection using fused convolutional neural network predictions. arXiv (Cornell University). doi: 10.48550/arxiv.2102.05950

15. Mastoi, Q., Memon, M. F., Jan, S., Jamil, A., Faique, M., Ali, Z., Lakhan, A., & Syed, T. A. (2025). Enhancing deepfake content detection through blockchain technology. International Journal of Advanced Computer Science and Applications, 16(6). doi: 10.14569/ijacsa.2025.0160607

16. ITU. (2024). Detecting deepfakes and generative AI: Report on standards for AI watermarking and multimedia authenticity workshop. Retrieved from https://www.itu.int/hub/publication/t-ai4g-ai4good-2024-7/


Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.




Copyright (c) 2025 Temitope Damilola Elijah, Oluwafemi Olasehinde Adedayo, Olayemi Babawole Familusi

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.