Skip to content

Generative Artificial Intelligence for image synthesis using Generative Adversarial Networks (GANs) and variational autoencoders

Manoj T. S. Kumar Siddamallappa U Anusha Jajur J
Jul 2026 · World Journal of Advanced Research and Reviews · 0 citations

TL;DR

This research paper presents a comprehensive, end-to-end framework that addresses both generative synthesis and discriminative detection under hardware-constrained (CPU-only) environments, and presents a compact Convolutional Neural Network designed to detect and classify images as real or fake.

Abstract

In recent years, the rapid advancement of Generative Artificial Intelligence (GenAI) has transformed the landscape of digital content creation, enabling high-fidelity image synthesis across various fields including healthcare, art, and computer vision. However, the proliferation of synthesized images has introduced critical challenges, specifically the need to distinguish real physical imagery from synthetic, AI-generated counterfeits. This research paper presents a comprehensive, end-to-end framework that addresses both generative synthesis and discriminative detection under hardware-constrained (CPU-only) environments. We implement two synthesis methodologies like a Deep Convolutional Generative Adversarial Network (DCGAN) and a Convolutional Variational Autoencoder (ConvVAE) - trained on real image distributions to generate synthetic data. Concurrently, we present a compact Convolutional Neural Network (MiniCNNClassifier) designed to detect and classify images as real or fake. The framework is validated using a balanced dataset of 60,000 images (30,000 real and 30,000 synthetic). Our preprocessing pipeline ensures uniform size and resolution across heterogeneous inputs. Experimental results demonstrate that the MiniCNNClassifier achieves an outstanding validation accuracy of 98.7% and a Precision of 99.5%, Recall of 97.8%, F1-score of 98.6% in detecting fake samples. Furthermore, we provide a qualitative and quantitative comparison of DCGAN and ConvVAE architectures, discussing trade-offs between training stability and sample fidelity. Finally, we host the models on an interactive Streamlit-based web interface to enable real-time generation and classification.

View source

Similar papers

Preprint Aug 2026

Coarse to Fine: Iterative Adversarial Neural Cellular Automata for Medical Image Synthesis

Large-scale, publicly available datasets have driven advances in deep learning, but privacy and legal restrictions often limit data sharing in medical imaging. Synthetic data generation offers a privacy-friendly alternative to enable the training of high-performance models on health data. While most state-of-the-art generative models produce high-quality images, they remain computationally expensive, which limits their applicability on resource-constrained hardware. We propose StyleGANCA, the first lightweight general-purpose NCA-based generative adversarial network. The architecture integrates a StyleGAN-inspired mapping network and adaptive style modulation into a multi-scale NCA synthesis process, enabling latent-controlled image generation through iterative local interactions. We evaluate StyleGANCA on BloodMNIST and PathMNIST against adversarial, variational, diffusion, and NCA-based baselines. Experimental results demonstrate that StyleGANCA achieves competitive image quality with substantially fewer parameters than baseline architectures, achieving the best FID and KID scores on PathMNIST with only 617k parameters. Furthermore, downstream experiments show that the generated images preserve class-specific information and effectively support the training of multi-class classifiers. Our code is publicly available at: https://github.com/MECLabTUDA/StyleGANCA

Anh Thi Luu, Nick Lemke, Anirban Mukhopadhyay · 0 citations
Open access Aug 2026

PixelBoost 8 – Pixel Quality with 8X Highlights Boosting Enhancement

In recent years, deep learning has become a fundamental technology across a wide array of scientific and industrial fields, largely fuelled by advances in computational capabilities. One area that has experienced substantial progress is face hallucination—the task of improving the resolution of facial images. This process is critical to various computer vision applications, including facial recognition, feature extraction, and identity verification. Recently, deep generative models, particularly Generative Adversarial Networks (GANs), have led the field. Although these models have produced remarkable results, there is still a pressing need to further improve both accuracy and output quality. In order to address these problems, we propose a new GAN-based face hallucination method. This method is primarily based on the Enhanced Super-Resolution Generative Adversarial Network (ESRGAN). We present a personalised adaptation of ESRGAN that employs the VGG16 architecture with a compact pre-trained version. This method balances output image quality and computational efficiency. Experiments show that our approach is effective. The improved model obtains a maximum peak signal-to-noise ratio (PSNR) of 30.30. The Learned Perceptual Image Patch Similarity (LPIPS) score is 0.0817, whereas the Structural Similarity Index Measure (SSIM) is 0.8757. The results surpass many state-of-the-art methods available today. These enhancements have a significant impact and importance.

Sheetal S. Patil, A.M. Pawar, Nilofar Mulla et al. · 0 citations
Review Open access Jul 2026

Text-to-Image Generation via Deep Learning: A Comprehensive Review of Models, Architectures, and Future Directions

Text-to-image generation is an increasingly fast-paced field of generative artificial intelligence, consisting of synthesizing images of high quality and semantic consistency based on natural language descriptions. In this paper, we give an extensive overview of the approach to text-to-image generation using deep learning, including the most common core model families, architecture designs, training approaches, and evaluation systems. We discuss the paradigms of the generative adversarial networks (GANs), variational autoencoders (VAEs), transformer-based designs, and diffusion models, with the last one representing the state of the art in image generation models. The review also discusses key aspects of pipelines such as text encoding, cross-modal alignment, mechanisms of attention, and decoding images. Popular datasets, methods, and metrics of evaluation, including Fréchet Inception Distance (FID) and CLIP-based similarity, are discussed. The application domains that involve creative content creation, medical imaging, education and industrial design are critically discussed. Despite significant advances, various issues still exist, such as low stability in training, excessive computational complexity, amplification of bias, generated images, and text–image alignment errors. Moral and social issues, such as misinformation, intellectual property, and equity, are critically examined. Lastly, we present future research directions to more controllable, more efficient and more interpretable text-to-image systems, focusing on multimodal foundation models and human–AI collaborative design.

Abdussalam Elhanashi, Siham Essahraui, Qinghe Zheng et al. · 0 citations
Open access Aug 2026

From Generation to Discrimination: Vision Foundation Models for Synthetic SEM Image Detection

In materials science, the integrity of scanning electron microscopy (SEM) images is paramount for quality control and validation of research outcomes. However, the introduction of sophisticated generative artificial intelligence, particularly Generative Adversarial Networks (GANs), has introduced a novel vulnerability: the potential for highly realistic, artificially synthesized SEM images to be used fraudulently in scientific literature. To address this challenge, we present a deep learning-based framework capable of distinguishing between authentic SEM images and those synthesized by Generative Adversarial Networks (GANs). Using FastGAN and StyleGAN2-ADA, two state-of-the-art GAN models, we generated synthetic SEM datasets to complement real imaging data. We fine-tuned a pre-trained Contrastive Language-Image Pre-training (CLIP) Vision Transformer (ViT-L-14) for binary classification. By unfreezing the final transformer blocks and appending a custom classification head, the model effectively captures the subtle, high-level artifacts inherent in GAN-generated upsampling. This work highlights the potential of deep learning to safeguard scientific imaging workflows and provides an important step toward detecting and mitigating image forgeries in materials science publications.

A. Palangattu, A. K. Sah, S. Raman et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.