Stable Diffusion as a Prototype Development Tool : Evaluating the usability of generative AI in creating interfaces based on an existing component library

Sammanfattning

This thesis project explores the potential of using generative artificial intelligence as a tool for increasing efficiency in prototyping software user interfaces. Stable Diffusion 1.5 is fine-tuned using a set screenshots of user interfaces designed with the component library Handfast by the unit for IT support and system development at Ume˚ a university (ITS), using the Dreambooth technique. The ability of the fine-tuned model to generate mockups of user interfaces consistent with the component library is then tested. Additionally, methods for converting the generated images into functional code are reviewed in order to assess the possibility of creating a ”prompt-to-image-to-code” pipeline. By applying the Design Thinking methodology a user interface for interacting with the fine-tuned model is created, leading up to the development of a high fidelity prototype created using the design tool Figma. The usability of the prototype is then evaluated using the System Usability Scale during user tests with developers and designers at ITS. The results indicate an above average usability, suggesting that the proposed workflow shows promise. However, there are remaining challenges in ensuring the accuracy of the generated images compared to the component library as well as the implementation and testing of methods for converting the images to code. Further fine-tuning of the model along with more user tests are recommended to evaluate the long-term feasibility and benefit of undertaking the development of the system.Keywords: Stable Diffusion, Dreambooth, User Interface (UI), Design Thinking, Usability