kmando human computer interface

System Software

Source (required if based on other people's work):

3
Score 88%
Description:

A software for camera-projector interaction was developed by Juan Roldan, Ushakiran Soutapalli, Julien Faucher, and Jan Wedekind at the Microsystem & Machine Vision Laboratory (MMVL) at Sheffield Hallam University, UK.

The software makes use of a low cost off-the shelf webcam that is calibrated against a standard projector screen (note that at the moment the new video for linux standard version 2 (V4L2) is not supported yet). The webcam is used to determine the position of physical pointer (e.g. a pen) which is then used to virtually move the X11 pointer. Point-and-click functionality has also been implemented.

The wizard allows you to take a reference picture showing the pointer. You then have to select the region in the image for generating a reference histogram. If you are using a projector, make sure that the desktop has a bright background. Otherwise the pointer will be illuminated differently and it will not be recognized any more.

Donnie Bhayangkara has built a package of mando-1.6 for openSuSE 10.3 which can be downloaded here:
http://software.opensuse.org/search?baseproject=openSUSE%3A10.3&p=1&q=mando

For a video see
http://video.google.com/videoplay?docid=4201589281466176805

Mando now has a new project page at Sourceforge:
http://mando.sourceforge.net/

New releases at: http://sourceforge.net/project/showfiles.php?group_id=220882

Git access: git clone git://mando.git.sourceforge.net/gitroot/mando mando

Discussion Forum: http://sourceforge.net/forum/?group_id=220882

163 comments
 Comments

Please login or register to add a comment

Tharrrk

5 months ago

Hi! This forum/project seems dead for years but I'd have 2 questions in case someone still comes here:
[1] What was the progress with v4l2 support? Any PoC, anything someone could take over?
[2] Is there any working replacement for the same use case? i.e. an interactive whiteboard?
Cheers!

Report

marmota1991

9 years ago


why this message is to inform developers of the project command, that the board is being used in school Politecnico Captain Ignacio Carrera Pinto of San Carlos - Ñuble province - 8th-region chile

The implementation was made by the student:
- Luis Perez Soto
- Victor Torres Zapata
assisted by Professor Issac muñoz

more information on E-mail: marmota203@hotmail.com

Report

marmota1991

9 years ago

This message is to inform developers of the proposed control, the card is being used in school Capitán Ignacio Carrera Pinto Politécnico de San Carlos - Ñuble province - 8-region, Chile

The application was made by the student:
- Luis Perez Soto
- Victor Torres Zapata
assisted by Professor Isaac Muñoz

More information about E-mail: marmota203@hotmail.com

Report

C

wedesoft

9 years ago

Thanks for letting us know ;)

Report

marmota1991

9 years ago


hola soy un alumno de un colegio de chile desde ya te felicito por lo que haces pero mi duda es a caso esta disponible el mando para ubuntu por que descarge uno de trevino pero al intentar instalarlo me aparese error: la dependencia no se puede satisfacer: atlas3-base[lapack3]liblapack.so.3 por favor es urgente para mi titulo de elctronico y computacion

Report

marmota1991

9 years ago

hi am a student of a college from chile and I congratulate you for what you do but my question is if the mando is available for download ubuntu that one of Trevino but I try to install aparese error: dependency can not be met: atlas3-base [lapack3] liblapack.so.3 please it is urgent for my title and computacion elctronico

Report

C

wedesoft

9 years ago

Maybe you have a more recent version of Ubuntu (not the one the package was compiled for). In that case you need to compile kmando from source:
http://vision.eng.shu.ac.uk/mmvlwiki/index.php/KMando#Downloads

Report

carterson2

9 years ago

Hi,

I want to create a quiz and put it on the wall.

The passerby takes a quiz using his hand to select 1 of 4 choices.

The choices can be Big Blobs along the bottom.

Q: Can this app somehow do that?

E.g. with enough clever layout, can this be achieved?

E.g. No special pen, just a hand over the BLOB...


-jim

Report

C

wedesoft

9 years ago

No. The application uses colour segmentation, i.e. it looks for an object of distinct colour.
To recognise a hand occluding a button, one could implement background subtraction and thresholding. The problem is that when the background changes, a new reference image needs to be acquired.
I currently don't have time for this though.

Report

carterson2

9 years ago

I saw a game at Disneyquest where kids stomp on ball (images) and the image reacted. (I cant find a pic on the internet).

Anyway, if I personally had time I would do that. Sounds like a challenge. Let me know if anyone starts that effort. CHAO. Jim

Report

carterson2

9 years ago

where should we discuss this?

Report

C

wedesoft

9 years ago

Sorry discuss what?

Report

carterson2

9 years ago

I want to design a non-pen version as mentioned above. I am trying to ascertain if using kde-apps/you/kmando-inventors help, whether I will be successful. Are any other kmando-inventors active or interested in this effort? I can create a US$1k scholarship or something, but thats about it for now.

Report

C

wedesoft

9 years ago

Ah ok. I currently don't know anybody who has time to do it. Also it sounds like you require investigative work to develop the idea as well.
Maybe you can manage to get Johnny Chung Lee's Wiimote Whiteboard [1] working instead. It requires a Wiimote and infrared LEDs.

[1] http://johnnylee.net/projects/wii/

Report

carterson2

9 years ago

i love johnnylee's videos. I wonder where he will end up working...

Let me clarify what I am saying.
I will do the work.
I just want guidance.
Just an email a day or such, no code.

Are you in?

Report

C

wedesoft

9 years ago

Quote:Let me clarify what I am saying.
I will do the work.
I just want guidance.
Just an email a day or such, no code.
Are you in?


If you do the project with Ruby and HornetsEye (http://www.wedesoft.demon.co.uk/hornetseye-api/), I can try to give you some guidance and even write some code if it's not to much work. But note that I can't spend much time on it, since I currently have a lot of work to do ;)

In this case I think it may better to continue the discussion in the general discussion forum of Hornetseye (http://rubyforge.org/forum/?group_id=2714). As a first step you can try to setup Ruby and Hornetseye on your PC. Let me know if you get stuck.

Report

hikohito

9 years ago

hello. My name is Edgar Joaquin'm originally from El Salvador makes little knowledge of your project and therefore I like the community and the organization they belong to is a nonprofit organization for technological development and promulgation of us are interested in implementing SL this beautiful application that you are developing and whether it is possible to begin to translate into Spanish aid because I have not found any of that good on the web that is my concern whether you might communicate with me to see this clear if you are interested you can do to lastvnm AT gmail.com

Report

C

wedesoft

9 years ago

This is a community project by Juan Roldan, Ushakiran Soutapalli, Julien Faucher, and me.
I am currently working on other things and I don't have time to add translation support to this project. Anybody else?
However you can find documentation about localisation at http://l10n.kde.org/.
Providing language support basically requires to do the following steps:
* Add i18n calls to the sourcecode. Make sure that the user-interface compiler generates i18n calls as well.
* There is a tool to create translation template files (pot) from the C++ source code. I forgot how to do it.
* Use kbabel to do the translation.
* Add the translation to the built process.

Report

vbman11

10 years ago

I'm trying to use mando, but when I click configure on the mando window I get a "blank" window with just the controls for the video input but I can't see what my video input is seeing just blank. I tried "reconnect" I chose the correct channel i've looked for my problem everywhere but no one else seems to have the same problem that I have. I have also used Tvtime to see my camera, it works. Please help me.

Report

C

wedesoft

10 years ago

What camera are you using (V4L (webcam,framegrabber), firewire)? Did you try to adjust brightness, contrast, ...
Note that kmando currently does not support V4L2.

Report

vbman11

10 years ago

I'm using my tv card with a camera(works perfectly with tvtime). How do I know if I have V4L2 vs. V4L?

Report

C

wedesoft

10 years ago

One needs to find out what kernel module is driving the card. What is the name of the card? Maybe you can list the card with "lspci".

Report

vbman11

10 years ago

I'm trying to use mando, but when I click configure on the mando window I get a "blank" window with just the controls for the video input but I can't see what my video input is seeing just blank. I tried "reconnect" I chose the correct channel i've looked for my problem everywhere but no one else seems to have the same problem that I have. I have also used Tvtime to see my camera, it works. Please help me.

Report

miguipda

10 years ago

Hi,

can somedy tell me if it works/interact with a laser pointer ?

Sincerely thanks,

Miguipda ;-)

Report

C

wedesoft

10 years ago

That's awesome :-D

Report

product-maker schleby Mar 07 2011

product-maker jrepin Nov 29 2010

product-maker 45 349

File (click to download) Version Description Packagetype Architecture Downloads Date Filesize DL OCS-Install
product-maker
wedesoft
Pling
Details
license
version
1.7
updated Jun 29 2009
added Oct 11 2006
downloads today
0
page views today 1
Report Misuse Report SPAM
System Tags app software