Eyefluence: the Missing Link in MR Headsets - shelisrael.com

Shel Israel inContext

Eyefluence: the Missing Link in MR Headsets

3x4_2[NOTE: This is an extract from Chapter 6 in Beyond Mobile: Life After Headsets, my book-in-progress with Robert Scoble. The chapter spotlight only one company: Eyefluence, which you probably never heard about. Since it is only involved in business-to-business deals, you may not often hear about them. But chance are that if you use AR or MR glasses at some point in the future, the quality of your experience will rely on the technology their technology.]
Jim Marggraff and David Stiehr, co-founded Eyefluence on 2012 but they had already been collaborating at that time with eye tracking software technology they had acquired. They started playing with ways to make it more valuable in all senses of the word.
Eye tracking, in itself, is no big deal. It predates the PC by over 100 years. Scientists, equipped with pens and paper, developed a method to study how the brain works when people read. The approach came to computers in the ‘80s when two psychologists named Marcel Just and Patricia Carpenter theorized that brains process what they see as fast as the eye sees it.
You can’t get much faster if humans are involved.
Scientists found a string of valuable ways to use eye tracking in psychology, psycholinguistics and other health-related fields. It is used to enable quadriplegics manipulate objects on screens by nodding and blinking. Stephen Hawking’s speech synthesis system uses it to enable his thoughts to be translated into simulated speech. More recently, Fove, a startup headset maker, incorporated it into a VR headset, exciting action gamers who enjoy zapping aliens faster than was previously possible.
Yet none of these work at a pace that is anything close to the speed in which the brain understands what the eye reads, which is precisely what Eyefluence does.
They have taken the old eye tracking software and built upon it extensively, filing 30 patents to protect what they have created. The result is a new category of operating headset software that they call Eye Interaction [EI].
Instead of just watching a user’s eye and taking cues from staring, blinking or nodding as eye tracking does, Eyefluence’s EI software watches where the headset user’s eyes go and responds to the EyefluenceLogo_Colornatural ocular motions. The company hopes those patents will allow it to be the single source of this type of software giving it a very strong position in a nascent but inevitably huge market.
Marggraff told us that Eyefluence is engaged at various stages with most major headset makers.
EI software is best appreciated when used, rather than talked about in books. We received our demoes separately. Scoble saw it at SXSW and was blown away. Of the two of us, he has a faster, more intuitive, understanding for new technology.
Israel looks more at business strategies with the skepticism acquired over years as a reporter who saw many dazzling tech launches fizzle when the same products failed under less controlled market conditions. He visited Eyefluence in May at the company’s Milpitas, California headquarters and was determined to not be impressed.
By that time, Israel had tried most new headsets and doubted that what he had seen so far would survive, never mind prevail, in everyday situations as smartphones do. He was particularly concerned about personal productivity.
When he talked earlier with Marggraff, the entrepreneur had argued that headsets would be the only digital technology that people would need within the next decade and he had predicted Israel might write his next book with his eyes in a headset rather than with fingers on a keyboard.
It wasn’t just word processing challenges that made him skeptical. Israel also wondered about personal productivity including spreadsheets and presentation slides.
Like most writers, Israel spends more time on a desktop computer than on a mobile phone. He has never perceived writing a long piece without an external keyboard and large screen. The idea of using MR glasses to write a book sounded like an un-pragmatic fantasy to him.
Yet, after a fifteen-minute demo that included Marggraff’s two-minute lesson on how to use Eyefluence, Israel was looking forward to writing anything he wanted with a smart glass device in the near-term future.

Accelerated Mole-Whacking

Marggraff gave Israel about a two-minute demo, then Israel found himself effortlessly moving and opening objects with his eyes. He was relaxed, but found himself navigating faster than he had ever gone with a point-and-click device. He booked a flight and saw how his doctor could call up x-rays during a visit just by looking at an icon.
Israel experienced a reversal in his usual process: Instead of going to technology to make something happen, Eyefluence, brought the technology to him.
Prior to the demo, Marggraff had talked about how his PhD-dominated team had spent years studying the human eye. Israel had paid little attention. Nearly all entrepreneurs boast of team talents, educational degrees and unique cultures.
Now, as Israel tested the new tech, he quickly realized as he watched virtual screens: The technology was watching him, was seeing where he looked and where his eye stopped. He intentionally waWhacndered off from where Marggraff was telling him to go, and the technology followed his eyes and not Marggraff’s guidance. The demo was real and the software was understanding what he wanted because it was watching, and, he was told — remembering.
Software that watches you and gets smart about you is freaky stuff, we wrote previously. And while this could have been extremely freaky, Israel was having too much fun to allow that to to distract him from Whac-a-Mole, a game introduced in 1976 that Israel had not previously played, when it came up.
If you, like Israel, are among the few people on Earth unfamiliar with it, the object of the game is to clobber cute little rodents as they pop their smiley heads out of the ground. The more you whack; the more points you get.
First, Marggraff instructed him to whack moles by eye tracking which required head nodding. Every time a mole showed itself, Israel nodded and bopped. As he got the hang of it, his nodding-and-bopping rate accelerated. When it was over, he thought he done pretty well for a rookie.
Next, he went mole whacking with Eyefluence. Instead of nodding, he just moved his eyes. The device kept score and Eyefluence empowered Israel to whack 40 percent more moles in the same period of time.
Eventually, Israel found himself looking at 40 screens surrounding him by 360 degrees horizontally and 180 degrees vertically—the full span of any enhanced reality environment. It was far different than a computer desktop home screen where different content is arranged in tabs. With the headset, Israel could easily zoom to any of 40 sites just by looking: he could also scroll or manipulate as he saw fit.
This is what a computer environment will look like in the near-future and it did not seem to be even slightly freaky; it seemed natural and productive. He knew his personal data was being collected, but that seemed to be a fair rice for the experience he was having.

Typing by Eye

Marggraff showed Israel how Eyefluence could expedite the daunting task of organizing content for writing a book-writing project. Very often, authors take notes on multiple devices and applications. The end up in their own quagmires of text, video and audio snippets. Israel uses everything from Post-It notes to video and audio clips. In extreme cases he has jotted URLs on the back of his hand.
The hard part is always assembling these disparate informational tidbits into a single, cohesive chapter and then into a full book where thousands of pieces fit snugly together like a jigsaw puzzle.
Like most authors, Israel uses Microsoft Word for the assembly and production. For him it has always been an awkward and inefficient process, and he has lost more than one valuable vignette in this haphazard process.
As he sat looking through the headset at the 40 screens, Marggraff showed him how he could cut and paste content from all into one consolidating screen, thus streamlining his process in a way that eyecould save weeks, perhaps months.
After the demo, Marggraff told Israel about a killer app for authors that would be coming soon: a QWERTY keyboard for headsets that you could type by eye. Eyefluence already had it, but it was still too slow for a demo, but he predicted that when ready, people would type as fast as the eye could move.
In the tech community, paradigm moments are mentioned far more often than they actually occur in life. But for Israel, this was one. He could think of nothing that would not be better on a headset than on a mobile or desktop device—and he was eager to make the swap. For him, that keyboard is the killer app. For others, there would be equally dazzling and useful apps.

17 Responses

  • Nov 2, 2016

    It’s a pity you don’t have a donate button! I’d most certainly donate to
    this brilliant blog! I suppose for now i’ll settle for bookmarking and adding your RSS
    feed to my Google account. I look forward to brand new updates and will share this website with my Facebook group.
    Chat soon!

    affetatrice Nov 2, 2016
  • Hi to all, the contents present at this web site are actually remarkable for people experience, well, keep up the nice work fellows.

  • Have you ever thought about adding a little bit more than just your articles?
    I mean, what you say is important and all. But just imagine if you added some great images or video clips to give your posts more,
    “pop”! Your content is excellent but with images and clips,
    this site could definitely be one of the most beneficial
    in its niche. Terrific blog!

  • Excellent post! We will be linking to this great content on our website.
    Keep up the good writing.

  • Dec 14, 2016

    I don’t even know how I stopped up right here, however I assumed
    this publish was great. I don’t recognise who you might be but certainly you’re going to
    a well-known blogger in case you are not already. Cheers!

    Marilynn Dec 14, 2016
  • Dec 15, 2016

    May I just say what a relief to discover an individual
    who really understands what they’re talking about over the internet.
    You certainly know how to bring an issue to light and make it important.
    More people must check this out and understand this side of the story.
    I was surprised that you aren’t more popular because you surely have the gift.

    Jacklyn Dec 15, 2016
  • First off I would like to say awesome blog!
    I had a quick question that I’d like to ask if you don’t mind.
    I was curious to know how you center yourself and clear your head before writing.
    I have had trouble clearing my thoughts in getting my ideas
    out. I truly do take pleasure in writing however it just seems like the first 10 to 15 minutes are usually
    lost just trying to figure out how to begin. Any recommendations or tips?


  • Dec 28, 2016

    Hi to all, the contents existing at this site are in fact awesome
    for people knowledge, well, keep up the good work fellows.

    essiccatore prezzo Dec 28, 2016
  • I’m amazed, I must say. Rarely do I come across a blog that’s both equally
    educative and amusing, and let me tell you, you’ve hit the
    nail on the head. The problem is something which not enough people are
    speaking intelligently about. Now i’m very happy that
    I stumbled across this in my hunt for something regarding this.

    • May 30, 2017

      Yes, unroutfnately I think there is a stigma. Which is the only thing stopping me from jumping into indie publishing this second. Which is silly.I want the respect of my peers. Which I should have whether I traditionally pub or indie pub. We are all authors. There doesn't need to be indie pubbed label or traditionally pubbed label.I'm hoping that an author like you will change others' feelings about the indie vs traditional. So thank you!

      Roby May 30, 2017
  • If you wish for to increase your know-how only keep visiting this website and
    be updated with the latest news update posted here.

  • Jan 2, 2017

    It’s remarkable in favor of me to have a website, which is good in support of my experience.
    thanks admin

    Felipa Jan 2, 2017
  • Just want to say your article is as surprising. The clarity in your post is
    simply great and i could assume you’re an expert on this subject.
    Fine with your permission let me to grab your RSS feed
    to keep up to date with forthcoming post. Thanks a million and please carry on the rewarding work.

    • May 30, 2017

      در حال حاضر دارم فلش پلیر رو دانلود می کنم ؘŒ™Â…ÛÂÃا¯Ã™ÂˆÃ§رم کارا خوب پیش بره ضمنا اگه کارم را راه انداخت پیشاپیش همین الان ازت تشکر می کنم.

      Sunshine May 30, 2017
  • Jan 9, 2017

    Very descriptive blog, I enjoyed that bit.

    Will there be a part 2?

    oale sub presiune Jan 9, 2017
    • May 30, 2017

      My kids loved Falafel on Thursday nights.And a second favorite was “Pasta Brlc1ooi&#822c;Simply partially cook small pasta shells, 5 minutes before pasta is ready, toss into the pot some fresh broccoli flowerets. Drain and toss with EVOO and a bit of butter.

      Retta May 30, 2017
  • May 30, 2017

    So MacDoctor…a state registared physician practising here in NZ holds the belief that dead flesh can reanimate in complete contradiction to all human medical knowledge thus far attained.And yet he has the gall to call homoeopathy qumkaery…..cmmmmm.

    Roby May 30, 2017

Leave a Reply

Your email address will not be published.