i-manager Publications

Detection of Deep Fakes using Deep Learning

Anjani Suputri Devi D.*, Sai Kishore T.**, Venkata Sri Sai Tejaswi V.***, Venkata Subrahmanya Sivaram G.****, Subhan Saheb S. K.*****, Vikas Kumar K.******

*-****** Department of Computer Science and Engineering, Sri Vasavi Engineering College, Andhra Pradesh, India.

Periodicity:January - March'2024
DOI : https://doi.org/10.26634/jip.11.1.20719

Abstract

Deep learning algorithms have simplified the process of creating indistinguishable synthetic videos, or deep fakes, because of the unparalleled increase in processing power. It is concerning because these face-swapped manipulations are often used in a variety of contexts, such as blackmail and political manipulation. This paper presents a revolutionary deep learning-based approach to accurately discriminating between real and Artificial Intelligence (AI)-generated false films. Using a ResNext Convolutional Neural Network (CNN) for frame-level feature extraction, this method makes use of an automated mechanism intended to identify replacement and re-enactment deep fakes. A Recurrent Neural Network (RNN) equipped with Long Short-Term Memory (LSTM) training is utilized to classify videos and distinguish between real and modified ones. The system demonstrates the effectiveness of a straightforward and reliable methodology, in addition to utilizing complex neural network topologies. Through testing, this paper showcases how well the system can accurately identify videos playing a crucial role in ongoing initiatives to combat the increasing dangers posed by the proliferation of deep fake content in society.

Keywords

Deep Learning Algorithm, Deep Fakes, Artificial Intelligence, ResNext CNN, RNN, LSTM, Artificial Intelligence.

How to Cite this Article?

Devi, D. A. S., Kishore, T. S., Tejaswi, V. V. S. S., Sivaram, G. V. S., Saheb, S. K. S., and Kumar, K. V. (2024). Detection of Deep Fakes using Deep Learning. i-manager’s Journal on Image Processing, 11(1), 1-11. https://doi.org/10.26634/jip.11.1.20719

References

[1]. Sun, F., Zhang, N., Xu, P., & Song, Z. (2021). Deepfake detection method based on cross-domain fusion. Security and Communication Networks, 2021, 1-11.

[2]. Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020). Face x-ray for more general face forgery detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 5001- 5010).

[3]. Schroepfer, M. (2019). Creating a Dataset and a Challenge for Deepfakes.

[4]. El-Gayar, M. M., Abouhawwash, M., Askar, S. S., & Sweidan, S. (2024). A novel approach for detecting deep fake videos using graph neural network. Journal of Big Data, 11(1), 22.

[5]. Song, F., Tan, X., Liu, X., & Chen, S. (2014). Eyes closeness detection from still images with multi-scale histograms of principal oriented gradients. Pattern Recognition, 47(9), 2825-2838.

[6]. King, D. E. (2009). Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research, 10, 1755- 1758.

[7]. Do, N. T., Na, I. S., & Kim, S. H. (2018). Forensics face detection from GANs using convolutional neural network. The International Securities Association for Institutional Trade Communication (ISITC), 2018, 376-379.

[8]. Yang, P., Ni, R., & Zhao, Y. (2017). Recapture image forensics based on Laplacian convolutional neural networks. In Digital Forensics and Watermarking: 15th International Workshop, IWDW 2016, Beijing, China, September 17-19, 2016, Revised Selected Papers 15 (pp. 119-128). Springer International Publishing.

[9]. Li, Y., & Lyu, S. (2018). Exposing deepfake videos by detecting face warping artifacts. arXiv preprint arXiv:1811.00656.

[10]. Ciftci, U. A., Demir, I., & Yin, L. (2020). Fakecatcher: Detection of synthetic portrait videos using biological signals. IEEE Transactions on Pattern Analysis and Machine Intelligence (pp 1-2).

[11]. Bayar, B., & Stamm, M. C. (2016, June). A deep learning approach to universal image manipulation detection using a new convolutional layer. In Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security (pp. 5-10).

[12]. Güera, D., & Delp, E. J. (2018, November). Deepfake video detection using recurrent neural networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1-6). IEEE.

[13]. Li, Y., Chang, M. C., & Lyu, S. (2018, December). In ictu oculi: Exposing AI created fake videos by detecting eye blinking. In 2018 IEEE International Workshop on Information Forensics and Security (WIFS) (pp. 1-7). IEEE.

[14]. Yang, X., Li, Y., & Lyu, S. (2019, May). Exposing deep fakes using inconsistent head poses. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 8261-8265). IEEE.

[15]. Xuan, X., Peng, B., Wang, W., & Dong, J. (2019, October). On the generalization of GAN image forensics. In Chinese Conference on Biometric Recognition (pp. 134-141). Springer International Publishing.

[16]. Gandhi, A., & Jain, S. (2020, July). Adversarial perturbations fool deepfake detectors. In 2020 International Joint Conference on Neural Networks (IJCNN) (pp. 1-8). IEEE.

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.