AI Generated Art: Latent Diffusion-Based Style and Detection

Jordan J. Bird*, Chloe M. Barnes, Ahmad Lotfi

*Corresponding author for this work

Research output: Chapter in Book/Published conference outputConference publication

Abstract

AI-generated artworks are rapidly improving in quality, and bring many ethical issues to the forefront of discussion. Data scarcity leaves many individuals under-represented due to aspects such as age and ethnicity, which can provide useful context when transferring artistic styles to an image. In this study, we consider current issues through the engineering of an AI art model trained on work inspired by Vincent van Gogh. The model is fine-tuned from a dataset of nearly 6 billion images and thus enables style transfer to individuals and entities not present in the art dataset given the knowledge of context. All models in this work are trained on consumer-level computing hardware with presented hyperparameters and configurations. Finally, we explore the application of computer vision models that can detect when an artwork has been created by human or machine with 98.14% accuracy. The dataset and models are open-sourced for future work.
Original languageEnglish
Title of host publicationAdvances in Computational Intelligence Systems
Pages157-169
ISBN (Electronic)9783031475085
DOIs
Publication statusE-pub ahead of print - 1 Feb 2024

Publication series

NameAdvances in Intelligent Systems and Computing (AISC)
Volume1453
ISSN (Print)2194-5357
ISSN (Electronic)2194-5365

Fingerprint

Dive into the research topics of 'AI Generated Art: Latent Diffusion-Based Style and Detection'. Together they form a unique fingerprint.

Cite this