Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches, rapidly generates text, image, and 3D modalities for enhanced early-stage design exploration. We show that using text as an intermediate modality outperforms direct sketch-to-3D baselines for generating diverse and manufacturable 3D models. We find limitations in current image-to-3D techniques, while noting the value of the text modality for user-feedback.

While a significant amount of research has documented the importance of design artefacts in design communication, relatively little work has investigated the effect of design artefact quality on the development of a shared understanding between designers. In the current work we focus specifically on sketch quality and the effect of sketch quality on the shared understanding of design dyads. A controlled study with 22 design dyads (44 designers) was conducted to understand the relationship between sketch quality and shared understanding. Results suggest that design artefact quality, measured by sketch understandability, does not predict the shared understanding of a design concept. Our findings hold implications for the fundamental ways in which we evaluate sketch quality and the importance of artefact fidelity for communicative acts.

Access to vast datasets of visual and textual materials has become significantly easier. How to take advantage of the conveniently available data to support creative design activities remains a challenge. In the phase of idea generation, the visual analogy is considered an effective strategy to stimulate designers to create innovative ideas. Designers can read useful information off vague and incomplete conceptual visual representations, or stimuli, to reach potential visual analogies. In this paper, a computational framework is proposed to search and retrieve visual stimulation cues, which is expected to have the potential to help designers generate more creative ideas by avoiding visual fixation. The research problems include identifying and detecting visual similarities between visual representations from various categories and quantitatifying the visual similarity measures serving as a distance metric for visual stimuli search and retrieval. A deep neural network model is developed to learn a latent space that can discover visual relationships between multiple categories of sketches. In addition, a top cluster detection-based method is proposed to quantify visual similarity based on the overlapped magnitude in the latent space and then effectively rank categories. The QuickDraw sketch dataset is applied as a backend for evaluating the functionality of our proposed framework. Beyond visual stimuli retrieval, this research opens up new opportunities for utilizing extensively available visual data as creative materials to benefit design-by-analogy.

Digital design tools have dominated engineering and design practice offering many advantages that ultimately improve efficiency in the design process. Digital sketching is one such example of these tools yet, its current use is primarily to present work to stakeholders (External Communication). It is relatively underused to externalise ideas (Externalisation) where sketching on paper is still favoured. This paper aims to understand the characteristics of digital sketching that motivate or discourage designers to use the tool. Semi-structured interviews were undertaken with 12 designers to gain insights on the tool's use in External Communication and Externalisation. Results highlight a trade-off between fidelity of visualisations and time and effort expended to achieve visualisations. The key difference between the use scenarios is the way in which this trade-off is connected to managing stakeholder involvement. While designers acknowledge advantages that digital sketching can offer in externalisation, it is viewed as requiring a level of detail to begin use. In conclusion we suggest segmenting roles of digital sketching in terms of the characteristics identified in this study would help to motivate use in Externalisation.

Sketching and prototyping are parts of a ‘reflective conversation with materials of a design situation’ (Schön, 1992). To support this conversation, we developed a reflective tool -the Reflection Canvas- that facilitates reflection activities through sketching and prototyping on the one hand and verbalisation on the other. We introduced the reflective tool to design students. Based on observation and answers from a questionnaire data reveal that guided reflection structured the process in a helpful way. It also turned out students had difficulties to switch from visualisation to verbalisation.

The advancements in the field of VR allow designers to use VR as a technology for sketching ideas in a virtual space. In this paper, Gravity Sketch (a VR sketching software) is used as an ideation sketching tool in the process of product styling. The goal of this research is to examine the advantages and points-of-pain when using virtual reality tools in the process of product styling. 29 Master students used the VR sketching tool in their design process and all of them had feedback and insights on the tool.

Sketching-related activities are considered as an essential form of communication in the early phases of a design process. In the presented study, it is argued that both the sketching and the sketch-related verbalisations are reflected in the level of elaboration of the sketching outputs. Hence, a protocol study was conducted to analyse the frequencies of different sketching-related activities during team conceptual design sessions and the associated levels of elaboration for each of the sketching outputs in the form of concept drawings. The results show that although teams generate sketches of various number, complexity and clarity, there exist commonalities across the studied experiment sessions. For example, teams share a pattern of developing solutions without transformations or using lateral transformations within the first part of the sessions and using vertical transformations to produce final concepts towards the end of the sessions. Moreover, teams used associated sketch elements to start drawing new sketches and then alternated to other activities, most of all verbal explanation, for the sake of elaboration and better understanding.

Visualisation of ideas and emergent designs is an essential ingredient in design practice. Sketching and CAD represent two widely used visualisation tools, each with complementary affordances that dictate their typical use during the design process. Sketching has affordances of fast and fluent visualisation whereas CAD affords easy modification of detailed designs. This paper proposes a hybrid tool, Digital Sketch Modelling, investigating the extent to which it can deliver complementary affordances of both sketching to CAD. Analysis of diary entries made by 62 postgraduate designers using sketching, digital sketch modelling and CAD within a design project forms the basis of the study. Results illustrate how digital sketching over crude 3d digital models, combined with benefits of digital image editing software enhance affordance for easy visualisation of ideas. Concurrently, the level of software used in Digital Sketch modelling led to fewer concerns over the level of difficulty to modify designs, enhancing the affordance for easy modification. As such we conclude Digital Sketch Modelling does combine affordances indicating its potential benefit in use between sketching and CAD.

Framing is a crucial skill for connecting problem and solution spaces in the creative design process, both for individuals and teams. Frames are implicit in individuals’ cognitive thinking, but the creation of shared frames plays a vital role in collaborative design. Many studies have attempted to describe the framing process, but little is still known about how to support designers in framing, specifically in teams. This paper addresses this gap, by exploring the connection between sketching and framing within interdisciplinary teams. Following a qualitative and explorative approach, we have investigated the process and outcome of five interdisciplinary teams. We identified that sketching assists in the creation and elaboration of frames. Furthermore, in tandem with discussion and reflection, sketching helps increase the chance of a frame to survive within the design process. Our findings have practical and educational implications for improving the creative design process in interdisciplinary teams.

Sketching ideas and building physical prototypes are common in early stage product development. They are used for learning, testing ideas, proving concepts and sharing knowledge. Laser cutting is a popular tool for making physical prototypes due to its accuracy, robustness and speed. Computer aided design and vector graphics software are the main tools used for designing parts for laser cutting. Several sketch- based interfaces have been developed to support the process, using tools such as stylus pens with intuitive sketch-like commands.

A proof-of-concept prototype for capturing a hand drawn sketch and converting it to a laser cuttable file has been developed. In this pilot study we attempt to discover when drawing design by hand on paper can be better or more efficient than conventional methods, for developing physical prototypes with laser cutting in the context of early stage product development. This includes testing the accuracy of the tool, a pilot experiment comparing drawing speed and accuracy, example use cases utilizing pencil and paper, and a simple design challenge experiment.

Biologically inspired design can be used to aid in conceptual design. Sketching is an important ideation process in conceptual design for recording and evaluating flashing moments of inspiration. The present study aims to provide a framework for exploring the effects of biological examples on the sketching contours of products, as well as the perceptual matching degree between design ideas generated via sketching and the desired functions. Elliptic Fourier descriptors with principal component analysis and perceptual matching were used to evaluate and compare the effects of biological examples, no examples, and human-engineered examples from different product categories and within one product category on the sketches in an experiment that involved 28 participants. The application of elliptic Fourier descriptors with principal component analysis shows that there are significant differences in the third and seventh principal components. It is also found that exposure to biological examples can produce more sketches with high perceptual matching degree than the other three conditions, but there are no significant effects of the example exposure on the Pearson correlation coefficients of semantic differential evaluation value vectors between design problems and sketches. These results demonstrate that exposure to biological examples will correlate with Elliptic Fourier descriptors of sketches and will not significantly increase the perceptual matching degree between sketches and the desired function.

Sketches are an essential tool for designers. They allow the externalizing of ideas and are therefore economic cognitively. Sketches also provide the designer with new insights, which play an important role in the emergence of ideas. However, some studies tend to show that sketching does not systematically have a positive effect on idea generation. Our research thus aims to analyze the generative effects of sketches by studying the way sketches support the design strategy of designers. We especially focus on the role of knowledge in comparison with concepts. Three sequences of sketches are analyzed employing C–K design theory; we show that drawings refer to both concepts and knowledge, but mostly to knowledge. In particular, sketching helps the architect mobilize knowledge distant from the initial topic. Moreover, the designer carries out through sketching an important work of knowledge structuration that we call ‘knowledge preordering’; by carefully selecting, testing and, if necessary, removing knowledge, the designer organizes a strategically built knowledge space. In particular, all elements involving modularity or determinism in the knowledge basis are abandoned. Such knowledge preordering thus allows the building of a splitting knowledge structure, which offers new rules for concept generation and enhances the production of original and disruptive ideas.

Many tools are being developed to assist designers in retrieving analogies. One critical question these designers face is how these analogues should be represented in order to minimize design fixation and maximize idea generation. To address this question, an experiment is presented that compares various representations' influence on creativity and design fixation. This experiment presents an effective example (analogue) as computer-aided design (CAD), sketch, or photograph representations. We found that all representations induced fixation, and the degree of fixation did not vary significantly. We also found that CAD representations encourage engineering designers to identify and copy the key effective features of the example. CAD and photo representations also produced a higher quality of design concepts. Results from this experiment offer insights into how these various representations may be used in examples during idea generation; CAD representations appear to offer the greatest advantages during the idea generation process. The results from this experiment also indicate that analogical databases of effective design examples should include CAD and photolike images of the analogue rather than sketches.

The value of sketching in engineering design has been widely documented. This paper reviews trends in recent studies on sketching in engineering design and focuses on the encouragement of sketching. The authors present three experimental studies on sketching that look at (1) sketching assignments and their motivation, (2) the impact of a sketching lesson, and (3) the use of Smartpen technology to record sketching; overall these studies address the research question: Can sketching frequency be influenced in engineering education? Influencing sketching frequency is accomplished through motivation, learning, and use of technology for sketching, respectively. Results indicate that these three elements contribute to the encouragement of sketching in engineering design.

This paper presents a preliminary comparison between the role of computer-aided design (CAD) and sketching in engineering through a case study of a senior design project and interviews with industry and academia. The design team consisted of four senior level mechanical engineering students each with less than 1 year of professional experience are observed while completing an industry sponsored mechanical engineering capstone design project across a 17 week semester. Factors investigated include what CAD tools are used, when in the design process they are implemented, the justification for their use from the students' perspectives, the actual knowledge gained from their use, the impact on the final designed artifact, and the contributions of any sketches generated. At each design step, comparisons are made between CAD and sketching. The students implemented CAD tools at the onset of the project, generally failing to realize gains in design efficiency or effectiveness in the early conceptual phases of the design process. As the design became more concrete, the team was able to recognize clear gains in both efficiency and effectiveness through the use of computer assisted design programs. This study is augmented by interviews with novice and experienced industry users and academic instructors to align the trends observed in the case study with industry practice and educational emphasis. A disconnect in the perceived capability of CAD tools was found between novice and experienced user groups. Opinions on the importance of sketching skills differed between novice educators and novice industry professionals, suggesting that there is a change of opinion as to the importance of sketching formed when recent graduates transition from academia to industry. The results suggest that there is a need to emphasize the importance of sketching and a deeper understanding as to the true utility of CAD tools at each stage of the design process.

To complement studies on design sketching within particular phases of design processes in specific design domains, this paper analyzes descriptions of design processes given by designers from a wide variety of fields. This research forms part of a wider project on comparisons across design domains and draws attention to the many types and properties of sketches in different contexts. Further, it focuses on the multiple roles that sketching can take in idea generation, as well as in reasoning and communicating design ideas. In particular this paper examines how the different types and roles of sketches can be more or less formal and how this can lead to misunderstandings.

This paper explores the relationship between the quality of a sketch and how others perceive the creativity of the idea portrayed by the sketch. In this study, sketch quality is characterized through its line work, perspective, and proportions. Four different toaster ideas were each sketched by four people with different backgrounds and levels of sketching proficiency. Then, 360 reviewers ranked the toasters for idea creativity, referring to a set of four sketches: one sketch for each toaster concept. The level of sketch quality for each toaster concept was varied among one of four quality levels. Higher quality idea sketches were found to correlate with higher creativity rank (p > 0.005), and lower quality sketches correlated with a lower creativity rank (p > 0.0005). A toaster idea portrayed with the highest quality level of sketch was 2.3 times more likely to be ranked as the most creative idea within the given set of idea sketches. The results underscore the importance of how an idea is presented, and support the need for sketching instruction in engineering and design curriculum.