Preprint / Version 1

What is real? Understanding Deepfakes and its implications

Authors

  • Hannah Kirschbaum
  • Tania Micaela Pineda González
  • Charlotte Senecat
  • Julia Soszyńska

DOI:

https://doi.org/10.18272/0qg9bv87

Keywords:

Deepfakes, disinformation, reality, image generation, AI Act, Digital Service Act, General Data Protection Regulation

Abstract

Deepfakes have been widely used for several purposes in the last years. The examination of its technical architecture is key to understanding the resulting societal and legal challenges. It involves computational mechanisms like Generative Adversarial Networks (GANs), Autoencoders, and Convolutional Neural Networks (CNNs), as well as hardware and networking infrastructure for high-fidelity synthesis. Deepfakes disrupt non-AI sectors, particularly cybersecurity biometrics, media broadcast credibility, and legal forensic analysis, where the phenomenon of the "Liar’s Dividend" threatens the integrity of digital evidence. While acknowledging potential benefits in creative industries and assistive medicine, there are severe ethical risks, including the proliferation of non-consensual sexualized deepfakes and political disinformation. Therefore, it is necessary to evaluate the sufficiency of current law, in this case, the European Union’s regulatory framework, specifically the AI Act, DSA, and GDPR.

References

Primary sources

Regulation (EU) 2024/1689 (AI Act)

Regulation (EU) 2016/679 (GDPR)

Secondary sources

Allen C and others, ‘What You See Is Not What You Know: Studying Deception in Deepfake Video Manipulation’ (2023) Journal of Cybersecurity Education, Research and Practice

Bailey M and Cunningham S, ‘Introduction to Computer Graphics’ (SIGGRAPH Asia Conference, September 2010)

Bass D. F., Shlaimon N., Penning N., J., ‘Deepfakes and Intellectual Property Legal Issues’ (2025).

Bellas G., ‘Deepfakes in the Courtroom: Problems and Solutions’ (March 2025).

Bello RW and others, ‘Cloud-based Face Swapping Application’ (Pretoria 2024)

Bernaciak C and Ross D, ‘How Easy Is It to Make and Detect a Deepfake?’ (Carnegie Mellonm University Software Engineering Institute, 2022) accessible at: https://www.sei.cmu.edu/blog/how-easy-is-it-to-make-and-detect-a-deepfake

Birchwood University, 'Exploring the Bright Side of Deepfake Technology' (2024), accessible at https://www.birchwoodu.org/exploring-the-bright-side-of-deepfake-technology/

Broklyn P., Egon A. and Shad R., ‘Deepfakes and Cybersecurity: Detection and Mitigation’

(July 03, 2024)

Constantineanu, C., 'Deepfakes: The New Frontier in Political Disinformation' (2024), accessible at https://thesecuritydistillery.org/all-articles/deepfakes-the-new-frontier-in-political-disinformation?utm

Dan V., 'Deepfakes as a Democratic Threat: Experimental Evidence Shows Noxious Effects

That Are Reducible Through Journalistic Fact Checks' (2025).

‘Deepfake, n’ Oxford English Dictionary (Oxford University Press, March 2023) accessible at https://www.oed.com/dictionary/deepfake_n

Eitren W., ‘Deepfakes in the AI Act’ (2024).

Eliot L, ‘Explaining Deepfakes Versus Cheap Fakes and the Role of Generative AI’ (Forbes,

25 June 2024) accessible at https://www.forbes.com/sites/lanceeliot/2024/06/25/cheap-

fakes-and-rescuing-humankind-via-generative-ai/

European Commission, ‘AI Act’ (Last update: 5 December 2025)

European Commission, ‘The Digital Services Act’ (Last update: 15 December 2025)

Hameleers M, ‘Cheap Versus Deep Manipulation: The Effects of Cheapfakes Versus Deepfakes in a Political Setting’ (2024) 36 International Journal of Public Opinion Research.

Finnerty N., ‘Tackling the regulation of sexually explicit deepfakes’ (2024).

Flynn A. et al., Deepfakes and Digitally Altered Imagery Abuse: A Cross-Country Exploration of an Emerging form of Image-Based Sexual Abuse, The British Journal of Criminology, Volume 62, Issue 6, (November 2022), Pages 1341–1358

Flynn A. et. al., Sexualized Deepfake Abuse: Perpetrator and Victim Perspectives on the Motivations and Forms of Non-Consensually Created and Shared Sexualized Deepfake Imagery (2025), Journal of Interpersonal Violence.

Fragale M., Grilli V., ‘Deepfake, Deep Trouble: The European AI Act and the Fight Against AI-Generated Misinformation’(2024)

GAO, ‘Science & Tech Spotlight: Deepfakes’ (2020).

Goodfellow I and others, ‘Generative Adversarial Networks’ (2014) arXiv:1406.2661

GRC Solutions, ‘What is Cybersecurity: Definition and Best Practices’ (2025)

G. Vivek, ‘What is Cyber security: A Complete Beginner’s Guide’ (last updated 2025

Hoek, S. et al., 'Promising for patients or deeply disturbing? The ethical and legal aspects of deepfake therapy' (2024).

IBM, ‘What is PyTorch?’ accessible at https://www.ibm.com/think/topics/pytorch

IBM Developer, ‘Learn the basics of computer vision and object detection’ (2020) accessible a thttps://developer.ibm.com/articles/learn-the-basics-of-computer-vision-and-object-detection/

Insikt Group, 'Targets, Objectives, and Emerging Tactics of Political Deepfakes' (2024), accessible at https://assets.recordedfuture.com/insikt-report-pdfs/2024/ta-2024- 0924.pdf

Jain A and Jain N, ‘A Peek into Computer Generated Imagery Pipeline’ (2017) 10(2) Bionano Frontier 220

Kalmykov, M., 'Positive Applications for Deepfake Technology' (2023), accessible at https://www.dataart.com/blog/positive-applications-for-deepfake-technology-by-max-kalmykov

Kira B., 'When non-consensual intimate deepfakes go viral: The insufficiency of the UK Online Safety Act' (2024), Computer Law & Security Review: The International Journal of Technology Law and Practice 54 (2024) 106024.

Kuźnicka-Błaszkowska D., Kostyuk N., ‘Emerging need to regulate deepfakes in international law: the Russo–Ukrainian war as an example‘ (2025), Volume 11, Issue 1 Journal of Cybersecurity,

Łabuz M., ‘Regulating Deep Fakes in the Artificial Intelligence Act’, Volume 2, No. 1 (2023)

Lampe C, ‘“Cheap Fake” Video Making the Rounds Today Likely Won’t Be the Last’ (University of Michigan School of Information) accessible at https://www.si.umich.edu/about-umsi/news/cheap-fake-video-making-rounds-today- likely-wont-be-last

Lees D., 'Deepfakes in documentary film production: images of deception in the representation of the real' (Studies in Documentary Film, 108-129, 2023)

Maio A., 'What is VFX? Defining the Term and Creating Impossible Worlds' (2025), accessible at https://www.studiobinder.com/blog/what-is-vfx/

Manovich L, The Language of New Media (MIT Press 2020)

Martinez, O. N. et al., 'Possible Health Benefits and Risks of DeepFake Videos: A Qualitative Study in Nursing Students' (2024)

Mirsky Y and Lee W, ‘The Creation and Detection of Deepfakes: A Survey’ (2021) 54(1) ACM Computing Surveys 1

Mitchell A., ‘Deepfaked Evidence: What Case Law Tells Us About How the Rules of Authenticity Needs to Change’, Berkeley Tech. L.J.: Blog (June 23, 2025)

Naffi N., 'Deepfakes and the crisis of knowing', UNESCO (2025) accessible at https://www.unesco.org/en/articles/deepfakes-and-crisis-knowing?utm

Negreiro M., 'Children and Deepfakes' (2025), European Parliamentary Research Service, accessible at https://www.europarl.europa.eu/RegData/etudes/BRIE/2025/775855/EPRS_BRI(2025)775855_EN.pdf

Livingston C., ‘Deepfakes in the Courtroom: Challenges in Authenticating Evidence and Jury Evaluation’, University of Baltimore Law Review (2025)

O’Brien S. R., 'Positive Use Cases of “Deepfakes”' (2025), accessible at https://www.wilsoncenter.org/article/positive-use-cases-deepfakes

Pandit AR and Kirdat TV, ‘Impact of AI in the Animation Industry’ (2024) 12(3) International Journal for Research in Applied Science & Engineering Technology 2828

Paravision, 'A Practical Guide to Deepfake Detection' (White Paper) https://www.paravision.ai/whitepaper-a-practical-guide-to-deepfake-detection/ accessed 19 December 2025

Paris B and Donovan J, Deepfakes and Cheap Fakes: The Manipulation of Audio and Visual Evidence (Data & Society 2019) accessible at https://datasociety.net/library/deepfakes- and-cheap-fakes/

Paszke A and others, ‘PyTorch: An Imperative Style, High-Performance Deep Learning Library’ (2019) 32 Advances in Neural Information Processing Systems 8024

Pawelec M., Łabuz M. 'Non-Consensual Sexualising Deepfakes - Threats and Recommendations for Legal and Societal Action' (2025), CEE Digital Democracy Watch: Warsaw, accessible at https://ceeddw.org/wp content/uploads/2025/05/NCII_DeepFakes_ThreatsRecommendations.pdf

Perov I and others, ‘DeepFaceLab: Integrated, Flexible and Extensible Face-Swapping Framework’ (2020) arXiv:2005.05535

Powell P and Smalley I, ‘What is a Central Processing Unit (CPU)?’ (IBM Think, 2025) accessible at https://www.ibm.com/think/topics/central-processing-unit

Raina R, Madhavan A and Ng AY, ‘Large-scale Deep Unsupervised Learning using Graphics Processors’ (International Conference on Machine Learning 2009)

Rana MS, ‘CGI vs AI in 2026. Which Visual Workflow Should You Use?’ (7CGI, 8 November 2025) accessible at https://7cgi.com/blog/cgi-vs-ai-key-differences

Rehak B, ‘Computer-Generated Imagery’ (2011) Oxford Bibliographies: Cinema and Media Studies accessible at https://doi.org/10.1093/obo/9780199791286-0068

Rini M, ‘Deepfakes: The Evolution of Synthetic Media’ (2020) 63(1) Communications of the ACM 86

Robins-Early N., 'How did Donald Trump end up posting Taylor Swift deepfakes?', the Guardian (2024), accessible at: https://www.theguardian.com/technology/article/2024/aug/24/trump-taylor-swift-deepfakes-ai

Stagg M., ‘Why deepfakes are the next big threat to broadcast credibility’ (2025)

'Text-to-image model' (Wikipedia, 2025) https://en.wikipedia.org/wiki/Text-to-image_model accessed 19 December 2025

Tolosana R and others, ‘DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection’ (2020) arXiv:2001.00179

University of Virginia Information Security, ‘What the Heck Is a Deepfake?’accessible at https://security.virginia.edu/deepfakes

US Government Accountability Office, ‘Deepfakes: AI-Generated Video and Audio Can Be Used for Exploitation and Disinformation’ (Technology Assessment GAO-20-379SP, 2020)

Seng JKP and others, ‘Artificial Intelligence (AI) and Machine Learning for Multimedia and Edge Information Processing’ (2022) 11 Electronics 2239

V. Soni, Infosys, ‘Deepfake and Its Impact on Cybersecurity - A New Frontier to Address’

Wack M., Parry D. A., 'Synthetic Diversity: Examining the Effects of Ethnic Targeting Using AI-Generated Political Ads', (2025), International Journal of Communication 19(2025),3736–3760

Westerlund M, ‘The Emergence of Deepfake Technology: A Review’ (2019) 9(11) TechnologyInnovation Management Review 39

Whisperly, ‘Deepfake Regulation: Chaos That Matters Now More Than Ever’ (2025)

Wazid M., 'A secure Deepfake Mitigation Framework: Architecture, Issues, Challenges, and Societal Impact', Cyber Security and Applications Volume 2 (2024)

Posted

2026-04-16