tag:blogger.com,1999:blog-19092890.post9162874892049296805..comments2024-03-28T17:41:43.970+02:00Comments on Image Sensors World: Engadget Tests Leap Motion Gesture Recognition DeviceVladimir Koifmanhttp://www.blogger.com/profile/01800020176563544699noreply@blogger.comBlogger16125tag:blogger.com,1999:blog-19092890.post-56775568145544350012012-06-01T22:38:42.610+03:002012-06-01T22:38:42.610+03:00Can't it be that they use some kind of reflect...Can't it be that they use some kind of reflectance interpretation by illuminate the fingers with a known light source? That might be the reason why they measure in a considerably dimmed room. This technique is known as shape from shading. In case my assumption is correct their algorithm is quit impressive. <br />Blur motion would never be problem but a ambient light would be critical. NIR light source with narrowband filter would help and it seems that they apply this technique.proximity sensingnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-86869541922306085162012-05-29T00:21:23.627+03:002012-05-29T00:21:23.627+03:00My iPhone 4 flash LED does a pretty good job casti...My iPhone 4 flash LED does a pretty good job casting a clear shadow on the ceiling of a reasonably dark room. Its beam is probably 45-degree wide. y-resolution is not so good though, and the finger must be close to the light in order to see the scaling effect. I'd go with a matrix of LEDs aimed at different angles.<br /><br />If you have an iPhone 4, just download a flashlight app and try it out.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-11744705651281948882012-05-28T23:44:33.466+03:002012-05-28T23:44:33.466+03:00Hi,
I'm not a specialist, but in my opinion c...Hi, <br />I'm not a specialist, but in my opinion celling shadow is posible only with laser, or very collimated light. they mention that they use cameras, so there are more than one I think that there are more than two. I think that it could be matrix of sensors...Piotrhttp://www.krochmal.eunoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-28141052019658413672012-05-28T06:24:12.851+03:002012-05-28T06:24:12.851+03:00That's exactly the problem: if how this thing ...That's exactly the problem: if how this thing works is known, then so will its limitations, and all the hype and upsell are killed right there. And if my theory is correct, this solution does NOT work well in quite a few scenarios: outdoors, lecture halls, ceiling lights, etc. I'm sure the math is interesting. But like I said this is probably good for a student project but not much more.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-59803465695885437112012-05-27T22:45:19.642+03:002012-05-27T22:45:19.642+03:00Relative to the display, x is horizontal, y is ver...Relative to the display, x is horizontal, y is vertical, and z is the orthogonal distance the to the plane of the display. <br /><br />We can come up all day long with all kinds of solutions, and fixes to prpoblems those solutions, as it seems you have suggested. I just wonder if someone actually knows.<br /><br />And nothing wrong with patenting a solution if it works well.Eric R Fossumhttps://www.blogger.com/profile/09740612324630105312noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-51537445924276161182012-05-27T21:32:21.855+03:002012-05-27T21:32:21.855+03:00Another way is to use two LEDs and light them up a...Another way is to use two LEDs and light them up alternatively. The distance of the shadows on the ceiling gives you y. Or one LED and two cameras but that would be stereovision and he said it's not the case. An easy concept and I'm surprised you could't get it. Maybe I should have dropped out of school and start patenting obvious things =) ZAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-66307684758656786332012-05-27T21:21:53.468+03:002012-05-27T21:21:53.468+03:00By "y" you mean the distance to the tabl...By "y" you mean the distance to the table? That is given by the scaling of the shadow as I said.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-3674558638519909172012-05-27T15:41:26.161+03:002012-05-27T15:41:26.161+03:00You are joking I hope. Ceiling projection could g...You are joking I hope. Ceiling projection could give you x and z but not y.Eric R Fossumhttps://www.blogger.com/profile/09740612324630105312noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-34533163416469672772012-05-27T02:43:40.596+03:002012-05-27T02:43:40.596+03:00Hasn't the answer has already been suggested i...Hasn't the answer has already been suggested in a previous post? They use a couple of IR LEDs and a single camera looking at the shadow of the hand projected onto the ceiling. Vertical motion is given by the scaling of the shadow. Horizontal motion is given by panning and stretching. Combine the two and you have 3D. Next time someone gets a chance to talk to him, just ask him if the thing works outdoors ;) can't believe someone dropped out of school for this. it could become a nice final-year project =) ZAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-40292349647547155992012-05-26T20:21:56.338+03:002012-05-26T20:21:56.338+03:00No, it can not replace the touch screen. Because t...No, it can not replace the touch screen. Because the fielf of view ia conic, so it has to be placed either very far from the screen or at the corner of the screen. This is an example of NIT's sensor inside a touch screen: http://www.youtube.com/watch?v=-Ie0OIGU2Kc<br />It should be hard to use this device.<br /><br />-yang niAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-59991513038117848842012-05-26T00:45:00.623+03:002012-05-26T00:45:00.623+03:00Maybe they do blob detection on 2-4 VGA 60Hz CMOS ...Maybe they do blob detection on 2-4 VGA 60Hz CMOS imagers with narrow NIR (at 750/800/850/900nm) band pass filters & matched illuminators. A FPGA/DSP does 2D blob detection and triangulates 3D based on first order moment blob centroids. This probably works okay when you have a high Z gradient, or good depth variation to segment the centroids (i.e. fingers, pencil, etc.). Should have a hard time with surfaces parallel to the sensor/display.<br /><br />Maybe they can have a latency around the frame period (1/60Hz), though I wonder how latency is defined with a rolling shutter. I guess it's a nice product for HCI.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19092890.post-45296116095918091292012-05-25T23:42:43.697+03:002012-05-25T23:42:43.697+03:00OK, I thought you were talking about some sort of ...OK, I thought you were talking about some sort of virtual light curtain. I noticed in the video that hand placement seemed to be important - the system did not respond when he was gesturing when talking, making me think there was some sort of operating distance from the camera that was important.<br /><br />I think it is great that someone has this working so nicely. I think it is funny that the collective minds of this blog still don't know how this works (even if some guesses have been proposed).Eric R Fossumhttps://www.blogger.com/profile/09740612324630105312noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-38073390544987856682012-05-25T22:52:01.542+03:002012-05-25T22:52:01.542+03:00Engadget describes it more like a 3D touchscreen:
...Engadget describes it more like a 3D touchscreen:<br /><br />"<i>there's a problem with creating and manipulating 3D models using a mouse and keyboard --it's a needlessly complicated operation involving clicks and drop down menus. Holz wanted a way to make "molding virtual clay as easy as molding clay in the real world.</i>"Vladimir Koifmanhttps://www.blogger.com/profile/01800020176563544699noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-4450882680533661562012-05-25T22:41:30.468+03:002012-05-25T22:41:30.468+03:00The limited volume of interaction makes me think t...The limited volume of interaction makes me think that this technology is going to compete with touchscreens, rather than with 3D cameras...<br />MatteoMatteo Perenzonihttps://www.blogger.com/profile/06749026636944967137noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-76442365841379815002012-05-25T22:10:36.829+03:002012-05-25T22:10:36.829+03:00Eric, sure. In the video it appears that an extra ...Eric, sure. In the video it appears that an extra care was taken to block the daylight from window. The curtain is black and very dense. Makes me wonder how well Leap's system works in normal living room daylight conditions.Vladimir Koifmanhttps://www.blogger.com/profile/01800020176563544699noreply@blogger.comtag:blogger.com,1999:blog-19092890.post-65159937315140543822012-05-25T21:50:33.522+03:002012-05-25T21:50:33.522+03:00Vlad, I didnt follow your comment on "window ...Vlad, I didnt follow your comment on "window curtain". Can you elaborate?Eric R Fossumhttps://www.blogger.com/profile/09740612324630105312noreply@blogger.com