茄子直播

茄子直播 and Autodesk researchers design 2D-3D software for augmented reality drawing

Prehistoric cave drawings date back about 40,000 years. Ancient Egyptians used papyrus for paper. Artistic drawing flourished during the European Renaissance starting in the 14th century.

Now, University of Toronto computer scientists and Autodesk researchers are looking to take artistic vision from 2D to 3D with augmented reality technology.

鈥淲e tried out systems like Tilt Brush by Google, and we noticed it was extremely hard to draw in the air,鈥 says Rahul Arora, a PhD student in the department of computer science. 鈥淥ne reason why is, we鈥檝e been drawing on 2D paper. How can we transition those skills to the 3D world?鈥

Arora and Autodesk researchers Rubaiat Habib Kazi, Tovi Grossman 鈥 who joins the department computer science as an assistant professor this summer 鈥 George Fitzmaurice and Karan Singh, a 茄子直播 professor of computer science, created SymbiosisSketch, software for combining 2D and 3D sketching for detailed design of 3D objects.

Their research will be presented at the Association of Computing Machinery鈥檚 international conference on human factors in computing systems (ACM CHI) in Montreal beginning this weekend.

SymbiosisSketch uses a tablet to support the 2D action of drawing on a surface. An augmented reality headset, Microsoft HoloLens, brings the drawing to life in a 3D augmented view.

鈥淵ou can think of the tablet as a camera you position in the air, and you draw within its field of view. So you're always creating 3D strokes even when you're drawing on the tablet," says Arora. "If you draw a line, you'll see it in real time on that surface, in the air. It鈥檚 like a drawing window you can move around in 3D space.鈥

Arora, who worked on the project in part during an internship at Autodesk Research, says the canvas size can increase, to draw very large objects, like cars or buildings, or decrease, to zoom in on drawing finer details, like a door handle.

The joint research is another example of the longstanding partnership between Autodesk, the 3D design, engineering and entertainment software powerhouse, and 茄子直播 computer science鈥檚 lab.

Arora says future applications of SymbiosisSketch could include use in animation and storyboarding, but for now they鈥檙e exploring state-of-the-art 3D sketching and fabrication.

鈥淚'm currently working on a fabrication project," he says. "Let鈥檚 say you have a 3D sketch 鈥 what if you want to manufacture it to be strong and lightweight? How can we use some physical simulation to guide you?鈥

Captain America figure battles an augmented reality drawing of an airplane (image courtesy of the researchers)

There are of course limitations to the current hardware technology, which lends itself well to a lab environment. A bulky motion capture system consisting of six ceiling-mounted infrared cameras tracks the pen鈥檚 movement. Also, AR hardware needs better speed and accuracy.  

But all of that is just a matter of time.

鈥淎s hardware improves, research on the software side moves forward as well,鈥 says Arora.  

鈥淭his project is really looking forward in the future.鈥

 

The Bulletin Brief logo

Subscribe to The Bulletin Brief

Computer Science