Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is it ever going to be possible for a screen to be a camera, so you feel like you are making eye contact while video-chatting?


Apple filed patents many years ago for an array of photo sensors interspersed in between pixels on a display, which would enable this.


Was just going to mention this. Here's an article describing this patent:

https://appleinsider.com/articles/17/01/10/apple-patent-pave...


Planar was showing off exactly this at SIGGRAPH 2007 (http://www.planar.com/blog/2007/10/1/what-if-your-display-wa...), but without additional optics you would be quite limited in what you could image.


An idea I've had in the past is that surely there's a way to detect eye direction as looking at the screen and tweak the image on-the-fly so the eyes are looking directly at the camera instead.

The idea is so simple I'm assuming it's not as easy as it sounds, so I've never really tried it (plus I have close to 0 experience with machine learning algorithms)...


This was done several years ago, I think by Microsoft.


It was work done at Microsoft Research (https://www.microsoft.com/en-us/research/wp-content/uploads/...), but I don't think it was ever integrated into any products. Given our sensitivity to faces and eyes, I expect the result would be quite uncanny. Better to just side-step the problem by rendering sunglasses over the user's eyes.



Fire phone kind of did it with 4 front facing cameras but it totally flopped.


I was just thinking about the FirePhone yesterday. Shame it didn't work out, I thought it was fairly neat.


Apple made 48 billion in profit on 229 billion in revenue in 2017. Granted, while Apple is the top smartphone seller and not all of their revenue/profit comes from the iphone, an Amazon bet that only loses 200 million this late in the game shows how much they underestimated the smartphone competition.


As phone companies are in an arms race to remove phone bezels, which would be motivation to make selfie cameras "behind" the screen or something of the sort, this might happen sooner than we think.


A disturbing thought - it would be difficult to put my usual sticker over the front camera if it's under the screen.


this is a behavior maybe only 0.001% of consumers do. buy a crappier phone


you put a sticker on the front camera of your phone?


Yes. I never use it anyway.


does the tin foil hat cause too much interference? (I'm kidding)


With current processing power it is possible to use either multiple cameras, or the X's face id sensors to manipulate the image to project the 2D live feed onto the 3D model of your face and slightly shift the 3D scene to make the image seem like it's making eye contact. I'm honestly surprised none of Google, Microsoft or Apple have this in their VC products yet.


Optically this is a problem, it would have to be some kind of "compound eye" system like an insect rather than a traditional set of apertures and lenses.

You'd also have problems with light bleeding from the display output into the camera.


That's a good idea. I am thinking of its possible use cases.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: