Sketch-to-Image for Innovative Thai Textile Design
Sittiphong Pornudomthap, Ronnagorn Rattanatamma and Patsorn Sangkloy* Author for corresponding; e-mail address: Ronnagorn@pnru.ac.th
Volume: Vol.52 No.1 (January 2025)
Research Article
DOI: https://doi.org/10.12982/CMJS.2025.009
Received: 24 April 2024, Revised: 8 January 2025, Accepted: 21 January 2025, Published: 29 January 2025
Citation: Pornudomthap S., Rattanatamma R. and Sangkloy P., Sketch-to-image for innovative Thai textile design, Chiang Mai Journal of Science, 2025; 52(1): e2025009. DOI 10.12982/CMJS.2025.009.
Abstract
Thai textile designs from user-provided partial sketches. Our method incorporates two key innovations: (1) training augmentation with synthetically generated partial sketches that mimic human drawings, and (2) text-based color control through user descriptions. To enhance robustness and generalization, we employ a multi-stage training pipeline. First, we leverage a pre-trained Stable Diffusion model. We then finetune the model on a larger dataset of Indonesian fabrics (which shares stylistic similarities with Thai textiles) before specializing in a dataset of Thai textiles. Additionally, we implement curriculum learning, where the model starts with complete sketches and gradually progresses to more challenging partial sketches. Ablation studies demonstrate the effectiveness of our approach, yielding robust and colorful designs that adapt to various sketch styles and color instructions. This work opens exciting avenues for future research in AI-assisted textile design, fostering a seamless blend of human creativity and machine intelligence.