Building Models in AR

 

Duration

Oct 2021 - Nov 2021 (1 mo)

Advisor

Dr. Michael Nebeling, Audrey Labrie, Shwetha Rajaram

Implementation

Lens Studio, Museum cardboard, Laser cutter, Adobe Suite (Premiere, After Effects, Photoshop, Illur

Keywords / Domain

AR, Augmented Reality, Architecture, Design tool, 3D modeling, Interaction, User experience, User interface, Prototype


Context

 

Tools help design. While we sketch with pencils, we can color with crayons. While we create gradients with watercolor, we can create texture in oil paintings. Now, it is time to embrace the virtual world, and I believe a new tool will again facilitate creating the next fascinating design.

The new tool I am thinking of is augmented reality. While architecture is the spatial de- sign in the physical world, virtual reality is the spatial design in the digital world. Aug- mented reality can be a bridge between the physical and digital worlds, and the common thinking of space design can be implemented into the new tool to help both fields.

For example, users can import new objects to the projected virtual model by grabbing the physical content from the world space. Another example is when users use hand gestures to extrude the physical wall, AR can show the render of the result to experience.


Digital Prototype

 

Why AR

 

For architecture design, the best instances are in the physical world, and AR could optimize the referencing process.


Physical prototype & takeaway

 

Takeaway & improvement

  1. Too many buttons on the hand-tracking menu.

    -> simplify the menu and enlarge the buttons

  2. Hard technically to identify physical content by framing with clicks.

    -> select the physical item by drawing with brushes

  3. Filming with different applications and devices caused color inconsistencies.

    -> use the same application while prototyping


Main interactions

Marker-based

Turn physical objects into virtual assets

Hand-tracking Menu

Delete virtual assets

Frame objects with drawing tool

Comment with voice typing


Implementation

 
  1. Physical model: Museum cardboard and Laser cutting

  2. Marker: Adobe Illustrator

  3. Icons: Adobe Illustrator

  4. Video editing: Adobe premiere and after effects

  5. User interface: Adobe XD

  6. AR filter: Lens Studio

    • Image tracking - project marker-based 3D models

    • Hand tracking - hand menu and cursor

    • Object controller script - manipulate virtual contents

    • Clone - turn the physical content virtual

    • Speech recognition - voice typing

    • Behavior script - interaction


Future work

 
  1. Let multiple users collaborate synchronously.

  2. Let users have more control over the virtual content.

    Importing content from the physical space is user-friendly and intuitive, but many technical issues need to be solved.


*Competitive Analysis

 
  View in the world space Tools in AR to modify Tools in VR to modify Recognize the physical contents Interact with physical contents
Morpholio Trace
(Partial)
V X
Arkio
(Partial)
V V V X
magicplan
(Indirect)
X V V