MAS CAAD ETHZ 2010-2011 · ITA(Institute of Technology in Architecture), Faculty of Architecture ETH Zurich » M5: System-ability

M5: FINAL PROJECT

mascaad2010 — Sat, 23 Apr 2011 15:49:09 +0000

The final task of this module was to develop an installation using the Kinect as an interaction medium. This project was mostly based on the knowledge obtained during the first tasks and each one of us explored our own interests or what we thought was the most interesting and with most potential ‘misuse’ of the ‘camera’. All of these projects were developed using Eclipse as a programming platform, also, some of the projects, like Set Me Free, used OOP.

Find students’ work here:

Agata Muszynska:

Animal Extended

Click here to view the embedded video.

Hideaki Takenaga:

Kinect XBox x Waterdrop Screen x Colour Motion

Click here to view the embedded video.

Jesper T. Christensen, Nikola Marincic:

Set Me Free, Sketching Autonomous Probabilistic Structures

Goal of this work is to liberate sketching from the constraints of projection into 2D space, with its static traces, and allow for an embodiment of the mind through gesturing. Using Markov chains to incorporate probabilistic structures, that change the conditions of the space and the properties of the objects drawn in it, allows the sketch to develop on its own, in autonomous – non deterministic way.

Click here to view the embedded video.

Jorge Orozco, Mihye An:

The Fountain in the Space

The Fountain in the Space is an interactive installation that detects objects and projects on them (augments them) differently according to their location in space.

The installation consist of multiple moving objects, a beamer, and a Kinect camera that feeds the data flow of the space (x, y, z coordinates) to a laptop. Using Eclipse as programing platform, the Kinect detects and sorts in real time the moving objects by similar depth area (blob detection). These blobs become masks for a series of videos. A pixel calibration is needed to obtain a one to one projection.

The initial state of the installation is a single video on the whole space. But as soon as the user moves an object, a different video appears on it. The more the object moves far from the wall, the more the video becomes clear and vivid. Finally, the installation gets back to the initial state when there is no interaction.

Click here to view the embedded video.

Magda Osinska:

Kinect DJ

Click here to view the embedded video.

M5: KINECTIC SCULPTURE

mascaad2010 — Mon, 21 Feb 2011 22:04:09 +0000

During the first week of work with the Kinect camera for Xbox we started to see the potential of this hacked technology. The used platform to ‘interact’ with the data flow was Processing, and one of the biggest advantages of this platform is the abundance of open source code. The big difference between this camera and the web-cam, which has been in the market for years now, is the extra type of data or dimension that it provides, depth. With this cheap and accessible technology we are able to scan in good (not high) quality and in real time 3d objects or scenes.

This projects are our firsts attempts to understand the meaning and potential of this constant and multi-dimensional data flow.

Find students’ work here:

Hideaki Takenaga, Human Body Forniture

Click here to view the embedded video.

Jesper T. Christensen, Time and Space Inbetween

Click here to view the embedded video.

Jorge Orozco, Cloud – Rain – Cloud

Click here to view the embedded video.

Mihye An, Mihye An, A Scan Addict!

Magda Osinska, Kinect Dance

Click here to view the embedded video.

M FIVE: SYSTEM-ABILITY

mascaad2010 — Tue, 02 Nov 2010 15:36:42 +0000

RGB+D Computer Vision & Architecture

“Computer vision is the science and technology of machines that see, where see in this case means that the machine is able to extract information from an image that is necessary to solve some task. As a scientific discipline, computer vision is concerned with the theory behind artificial systems that extract information from images.” (Wikipedia)

In the course, we want to explore the potential of Computer vision for Architecture. Open source Libraries for Computer Vision are powerful tools that can be relatively easily implemented. On the hardware side, with the Kinect -Camera, Microsoft sells a cheap device for 3D Scanning in high-speed.

This combination gives us the possibility to develop unseen applications. While flying through the point clouds of our cameras, we will develop new design tools, experiment with new ways of interaction and beyond.

During the course we will work with the programming language Processing.

1. Caryatid, revised

In the first day students will become familiar with the Kinect Camera and its connection to Processing. They will reinterpret the Caryatid motif: half human / half architecture! Their own body must be integrated, using the Kinect-camera. The work may refer to existing architecture. The 3D-scans can compose the entire architecture or might be applied to it.

2. Kinectic Sculpture

The students will explore new possibilities to design a three dimensional object by combining algorithms and the 3D Camera. Interactive design tools will be developed, and we will search for different perspectives on space and time.

3. Shadows & Agents

In this assignment, the electronic shadow of the space will become alive. Indirect, but intuitive, there will be dialog between user and software, implementing methods of artificial intelligence.

4. Individual Project

The final project will be an installation. It can be based on ideas developed during the first tasks. It should explore the possibilities of Kinect camera. What offers us the capability to measure space in 30 frames per second?

MAS10_5M_flyer