Living in an Augmented Reality

I was looking at the video of this app, “Jigsaw Live,” as I look at most potentially interesting AR apps.  On the surface, it sounds interesting:  ” an AR jigsaw puzzle.”   I’ve been interested in making AR jigsaw puzzles for a while (heck, I even went to the extreme of sending mail to my favorite puzzle company, Stave, to see if I could interest them, to no avail).  But, to me, the concept is about augmenting a puzzle.

After all, AR apps really need to have two components: reality + augmenting.  If reality doesn’t really matter, than why bother with making it an AR app (for example, holding up the phone in this app to solve the “puzzle” is tiring, as it is with any app that requires you to hold the phone up for a period of time).  And, you need to augment the reality in some way … right?  Bring these two things together, and then add something fun, exciting, engaging or useful.

So, let’s consider this app, then.

They have reality, you might say. It’s live video on the puzzle pieces, so that’s reality, right … or, is it?  Does reality matter? Not really, actually.  It’s just video.  Looking at something different doesn’t change the puzzle, nor affect the program.  Reality is “just a texture” … it could be a video or image from you camera roll, and it wouldn’t really change things.  The live video is cool at first;  but, in the end, it’s just a gimmick.

Going further, do they “augment” it?  No.  Their “reality” (the video texture) augments their puzzle, but reality isn’t augmented, nothing is moved out into the world, nothing about the world around you is enhanced.

Perhaps the title “Jigsaw Live:  Augmented Puzzle” would be a more accurate title?  I think so.   Unfortunately, even the puzzle doesn’t look that interesting.  Square pieces?  Up to 100?  For $2.99?  Yikes!  I would have bought this and played with it if it was $0.99, since I’ll pretty much buy any potentially interesting app for that.  But, for $3, you have to do better!    The “ultimate in puzzle fun” (to quote their page)?  Really?  One wonders if the authors even played a puzzle (a real one, not one of those 4×4 square slider puzzles, or the cornucopia of lame flash puzzles).

Ah well, another good app name taken.

I’m including their video here, so you can look at it now, and draw your own conclusions.  What do folks think … am I being too critical?

Looking back over the summer, it’s almost comical to re-read the sometimes-frenzied excitement at the possibility that the iPhone will support AR with OS 3.1. The possibility was exciting, even to those of us not trying to keep a small company afloat;  the idea that there would finally be a platform that would let us get our ideas, games and products to millions of eager customers was an unfamiliar feeling for those of us who have been doing AR for a (very long) while. And for the dozen or so small AR companies, surviving on contract work for movies web sites and eye-candy web advertising, it must have been intoxicating.
Read the rest of this entry »

First, in the spirit of full disclosure, I will point out that one of the students in my lab built this demo.  So, I’m obviously biased.  

That said, I am pretty impressed with what she managed to pull off in a very short time.  Ignoring the work involved in hacking the iPhone to get video out of the camera, and porting a little 3D loader/rendering to the phone, she managed to work in quite a few of the ideas we’ve been batting around about how to take advantage of the iPhone for handheld AR;  a bunch of things are still not in there, but will be eventually.  

The idea motivating this project is the old “Virtual Pet”, with the goal of having an individual’s pet be available on different platforms (handheld 3D, handheld AR, desktop 3D, etc), and of having multiple people’s pets be able to play with each other.  More interestingly, we hope to have the environment’s in which you play with your pet affect their growth and behavior.  We’ll see how far we get!

Here’s a video of the current prototype.

While popping into Ori’s blog, I say this post: Unveiling Tonchidot: A Cool Parallel World – on the iPhone

Other coverage seems to indicate that it’s not real, and given the lack of detail (and the state of the art in mobile AR) it’s hard to imagine it can do what the video seems to want to imply that it does.  Of course, if it’s just grabbing information based on the location, and then using interesting layout algorithms, it could really work.  For example, given that the iPhone location could be pretty accurate, you could do some simple heuristic-based search to associate a “geo-tagged” piece of data (e.g., put this note at this intersection) with a part of the image stream (e.g., put it over this bit of the view of the world, like a sign).  It would likely be very fragile, but given that the labels seems to reposition a lot in the video, perhaps that’s what it’s doing.

Of course, like many of these demos (think about that one on Android, called Enkin), it’s amazing how they seem to be “inventing” the same idea over and over. 

And not addressing any of the “real” problems that will come up.  Consider what happens when thousands of people leave hundreds of notes in that mall the video appears in.  How does arfilter filter that?  How do people author content?  Deal with privacy, security and permissions?  Of course, as we all know, we must take baby-steps, but I think these questions are fascinating to consider.  Especially when the commentators refer to this as evoking something like Vinge’s “Rainbow’s End,” where these concerns are central.