Using Head Gestures in PC Games
Software Download: torbensko.com/software/head_tracking
Using a piece of head tracking software, several head based techniques are developed for interacting with first person PC games. These techniques include zooming, spinning, ironsighting and the window effect (commonly known as the Johnny Lee effect).
For more information see: http://torbensko.com/projects/phd
Created by Torben Sko, The Australian National University. Achieved using software from Seeing Machines and The Valve Corporation.
Duration : 0:3:0
Tags: "lee, Camera, engine, face, faceapi, gaming, half, head, HL2, ironsight, johnny, life, machines, schou, seeing, sko, source, torben, tracking, valve, VR, web
July 6th, 2009 at 7:33 am
Good work you’ve …
Good work you’ve done here, but how will my neck feel after a 3+ hour gaming session?
July 6th, 2009 at 7:33 am
would be good if we …
would be good if we could use do the gestures on America arms that you do without voice comands to avoid detection. You know the tactics in the game like lifting your hand to give order to your team mates stop.
July 6th, 2009 at 7:33 am
Amazing.
Amazing.
July 6th, 2009 at 7:33 am
Pretty great. I can …
Pretty great. I can see a bright future for you =)
Essentially what trackIR/freetrack does except without using leds. I hope this gets integrated into as many games as possible.
July 6th, 2009 at 7:33 am
If you’re looking …
If you’re looking to replace controls you should look at Camspace. Just google it.
July 6th, 2009 at 7:33 am
That was great, I’m …
That was great, I’m just wondering how long it will take till microsoft come knocking at your door offering you a job..
great work, hope you get a first with this project..
July 6th, 2009 at 7:33 am
Don’t get me wrong, …
Don’t get me wrong, it’s superb what you’ve done, but from a gamer’s perspective I can’t see the value compared to conventional input methods — particularly due to the somewhat unnatural neck movements required!
July 6th, 2009 at 7:33 am
I’m afraid I’ll …
I’m afraid I’ll pull a neck muscle in the heat of the action
July 6th, 2009 at 7:33 am
@ TomQue –
I’m …
@ TomQue –
I’m in agreement with what you are saying, but, if a ‘activate’ key/button was present then accident movement would be eliminated, i have the feeling that although in theory these could work very well in games, it could also ruin experiences if not implemented creativley, for instance in a Call of Duty game there would be far too much going on for it too work, but in a House of the Dead game it would absolutely ROCK!!!!!
July 6th, 2009 at 7:33 am
If subtle movements …
If subtle movements are enough to trigger action in-game, wouldn’t you have to be completely still, and might accidentally trigger what you don’t want to?
July 6th, 2009 at 7:33 am
amazing work!
amazing work!
July 6th, 2009 at 7:33 am
I’m looking at …
I’m looking at augmenting control, rather than replacing it. I don’t want to get rid of the mouse and keyboard, but rather look at what else you could be doing simultaneously. I’m increasing the bandwidth between the user and the computer basically.
July 6th, 2009 at 7:33 am
The movements are …
The movements are exaggerated for the sake of demonstration. You can actually get away with very subtle head movements.
July 6th, 2009 at 7:33 am
I can picture my …
I can picture my neck becoming very sore.
July 6th, 2009 at 7:33 am
HOLY CRAP! This is …
HOLY CRAP! This is cool!
I used to work with Source, nice work! The Source SDK aint easy, so congrats on this sweet level of implementation!
Those guys from Project Nathal should totally hire you!
July 6th, 2009 at 7:33 am
Is this just for …
Is this just for like this 1 program OR is it so you can keymap the controls with your head movments?
July 6th, 2009 at 7:33 am
AT 1:00 HIS FACE IS …
AT 1:00 HIS FACE IS LOOPING RUN
July 6th, 2009 at 7:33 am
Very impressive …
Very impressive stuff – FaceAPI looks extremely accurate, must give it a go sometime. Nice work
July 6th, 2009 at 7:33 am
You’d get a sore …
You’d get a sore neck very fast flicking your head left and right to turn a character. But the speed of facial recognition and rotation is very interesting and does present some fantastic options.
Interaction in games with npc’s by shaking or nodding your head, recognising what your looking at on the screen and so fourth would add extra levels of interaction. I’d like to know if it could work with the video glasses like e-star so you could look round by turning your head and still see the image
July 6th, 2009 at 7:33 am
I thought some of …
I thought some of the techniques demonstrated could work perfectly well in a game, and most of them didn’t involve jerking movements. The iron sighting and corner peek moves look like they would work intuitively and without any particular strain. Not so sure about the zoom mechanic. Regardless, if a game took this technology and implemented it in a way that required jerky head movements, that would cimply be a badly designed game and not a fault with the tech.
July 6th, 2009 at 7:33 am
Conceptually sound …
Conceptually sound but in pratical terms I can’t see it myself.
Jerking my neck foward and to the side doesn’t sound too appealing compared to a single key press on a keyboard that I’m already using for the vast majority of commands.
July 6th, 2009 at 7:33 am
This gets the prize …
This gets the prize for the least imaginative thing I’ve read here. And these are /youtube/ comments.
July 6th, 2009 at 7:33 am
If that’s the case, …
If that’s the case, you’ll love my next video. I’ll be putting it out in the very near future.
July 6th, 2009 at 7:33 am
I would love to see …
I would love to see this technology being used for voice chat in game, like that other players can see your facial expressions and your lips moving
July 6th, 2009 at 7:33 am
Being able to look …
Being able to look left and right in racing games/flight sims alone make this worth while. No need for an anaologue stick, or click of a key and mouse, just natural head movement to check your flanks/wingmen/other race cars.