Tuesday, December 14, 2010

Reading #30 Tahuitu

Summary
Tahuti is a sketch based framework to create UML diagrams, which is another domain for sketch recognition. It also gives option to type in text. In the user study, the participants were more satisfied in using Tahuti against other UML diagram creation software.

Discussion
I believe UML diagrams should be relatively easier to recognize, so I expect that recognition should work with high accuracy. Is there any more paper left to read?

Reading #29 Scratch Input

Comment:
Johnatan

Summary
This paper propose a system to recognize a sketch by using the sound of the sketching device only. A stethoscope mic is attached to the surface that the sketching will be made and the audio during the sketch process is recorded. Then the audio file is processed and looking at the amplitude data, some recognition decisions are made. The author talks about %90 accuracy for some simple shapes.

Discussion
Having worked on the same idea, I can say that the problem is not an easy one. There are to many variations in the recordings of the same shape. Only very very simple shapes can be recognized effectively. And I wonder there could be any application domain for this idea.

Reading #28 iCanDraw

Summary
iCanDraw is a master thesis by Daniel Dixon, that assist people in drawing a human face by recognizing how well they are doing. It provides useful interface tools, such as rulers, markers to help users to preadjust the proportions of face elements. It a provides user a headshot to draw and can check the user's level of correctness by comparing the sketch to a contour set extracted from the photo.

Discussion
Dan is a cool friend of mine and actually I was a test user for this. It was a fun experience. I remember that I did better with the aid of the system. Can u hear me Dan??

Reading #27 K-Sketch

Summary
K-Sketch proposes an easy to use sketch interface for making simple 2D animations. It is Teddy to modeling K-Sketch to animation in that sense. User can draw animation paths as strokes, and sketch figures are animated by translation along those path. The intention of K-Sketch is mostly for entertainment between amateur users.

Discussion
I have seen a video of K-Sketch, it looked premature but promising. Also my advisor knows the person who developed the system and told me that he actually applied to A&M for a faculty position once but did not get selected :/

Reading #26

Summary
This paper proposes a multi-player game to collect sketch data for researchers which is the same deal on reading #24. The game has drawing or describing modes. In drawing mode, player sketches something based on a description text. In description mode, the player is expected to do the inverse, describe a given sketch in text. The description of one player is sent to another player to draw, and their drawing can be send to another player to describe and the message may change significantly on the way.

Discussion
This is just an extended version of paper #24.

Reading #25 Image Retrieval

Summary
This paper proposes as sketch based query system to search an image database of millions of images. The backbone of the search system is the image descriptors, essentially some data obtained by performing some edge detection on the images. The descriptor of the sketch is obtained the same way an image descriptor is obtained.

Discussion
This is another application domain for sketching, where words are not enough for describing things. It reminded me another work, where a sketch based query system was used to retrieve 3D models from a mesh database.

Reading #24 Games for Sketch Data Collection

Comment:
Drew

Summary
This paper came up with two simple game ideas so that it is fun to collect sketch data from users. In the first game, Picturephone, one or more players draw a sketch based on a description read by another player. In the second one, stellasketch, the players individualy label a sketch drawn by a user. At the end of the day, the users should have collected plenty of strokes.

Discussion
This is a cool idea indeed, if you need some sketch data. However I am not how they can find a context for the data collected.