Building Models in AR
Duration
Oct 2021 - Nov 2021 (1 mo)
Advisor
Dr. Michael Nebeling, Audrey Labrie, Shwetha Rajaram
Implementation
Lens Studio, Museum cardboard, Laser cutter, Adobe Suite (Premiere, After Effects, Photoshop, Illur
Keywords / Domain
AR, Augmented Reality, Architecture, Design tool, 3D modeling, Interaction, User experience, User interface, Prototype
Context
Tools help design. While we sketch with pencils, we can color with crayons. While we create gradients with watercolor, we can create texture in oil paintings. Now, it is time to embrace the virtual world, and I believe a new tool will again facilitate creating the next fascinating design.
The new tool I am thinking of is augmented reality. While architecture is the spatial de- sign in the physical world, virtual reality is the spatial design in the digital world. Aug- mented reality can be a bridge between the physical and digital worlds, and the common thinking of space design can be implemented into the new tool to help both fields.
For example, users can import new objects to the projected virtual model by grabbing the physical content from the world space. Another example is when users use hand gestures to extrude the physical wall, AR can show the render of the result to experience.
Digital Prototype
Why AR
For architecture design, the best instances are in the physical world, and AR could optimize the referencing process.
Physical prototype & takeaway
Takeaway & improvement
Too many buttons on the hand-tracking menu.
-> simplify the menu and enlarge the buttons
Hard technically to identify physical content by framing with clicks.
-> select the physical item by drawing with brushes
Filming with different applications and devices caused color inconsistencies.
-> use the same application while prototyping
Main interactions
Implementation
Physical model: Museum cardboard and Laser cutting
Marker: Adobe Illustrator
Icons: Adobe Illustrator
Video editing: Adobe premiere and after effects
User interface: Adobe XD
AR filter: Lens Studio
Image tracking - project marker-based 3D models
Hand tracking - hand menu and cursor
Object controller script - manipulate virtual contents
Clone - turn the physical content virtual
Speech recognition - voice typing
Behavior script - interaction
Future work
Let multiple users collaborate synchronously.
Let users have more control over the virtual content.
Importing content from the physical space is user-friendly and intuitive, but many technical issues need to be solved.
*Competitive Analysis
View in the world space | Tools in AR to modify | Tools in VR to modify | Recognize the physical contents | Interact with physical contents | |
Morpholio Trace (Partial) |
V | △ | △ | △ | X |
Arkio (Partial) |
V | V | V | △ | X |
magicplan (Indirect) |
X | V | △ | V | △ |