Ludwig Wendzich

Natural Human Interface, meet the web.

So I’ve posted about my experiments with UI lately, specifically trying to bridge the gap between point-n-click, touch-based and Natural Human Interface (ie. Gestures, at the moment with my hand in the air, a la Project Natal.) Here’s a demo video of Weekly Retrospect working with iPinchMe, a Mac app that interprets gestures out of video received from your iSight feed

I’d like to thank the developer of iPinchMe, Andreas Pfadler, for, firstly, developing this app, and secondly, helping me write the script to get it to work. After some clarification from Andreas, this is the script that you use:

on handle_event(event_msg, state)

	if event_msg is equal to "right" then
		tell application "System Events" to key code 124
	end if

	if event_msg is equal to "left" then
		tell application "System Events" to key code 123
	end if

	if event_msg is equal to "up" then
		tell application "System Events" to key code 126
	end if

	if event_msg is equal to "down" then
		tell application "System Events" to key code 125
	end if

	if event_msg is equal to "green" then
		tell application "System Events" to key code 36
	end if
	
	if event_msg is equal to "blue" then
		tell application "System Events" to key code 36
	end if


end handle_event

After you’ve initialised iPinchMe, make sure Safari is active so it is sending the commands to the right window.