Configure the software and add colour markers


This tutorial is for those who wanna make their own sixthsense device and have downloaded the code from Google codes and are facing issues to add markers, So guys just follow this easy tutorial :




1. Make sure you have Visual Studio and Direct X installed. (Click on it to download )
Extract and copy the files from wuw_v0.1.zip to any location on your computer. 





2.Open WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it. 










3. If you debug it successfully, a black screen appears with a little square box on the right just hover your mouse around it and you will find Option tabs such as Camera, Tokens and Apps.








      4.To add the color markers check this video :

                                     

 I hope this Tutorial was was easy for you to follow. Any problems I'll be happy to help. And don't forget to check out my other tutorials :)

61 comments:

  1. Hi,
    am akash from cochin, india. am working on beagle board for my BTech. project.
    can we cross compile this code and make it run in an arm platform. can we run it in linux ( angstome)
    hoping to get a reply
    :)

    ReplyDelete
    Replies
    1. Hello akash,
      This code supports windows version....but dont know if it would work if you cross compile it....

      Delete
  2. hello im sabeel,

    i always get this error even after duin all the guided steps :(


    System.BadImageFormatException was unhandled
    Message= is not a valid Win32 application. (Exception from HRESULT: 0x800700C1)
    Source=WUW01
    StackTrace:
    at WUW01.Program.Main()
    at System.AppDomain._nExecuteAssembly(Assembly assembly, String[] args)
    at Microsoft.VisualStudio.HostingProcess.HostProc.RunUsersAssembly()
    at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
    at System.Threading.ThreadHelper.ThreadStart()
    InnerException:

    ReplyDelete
  3. I guess you are using windows 64 bit....Just follow these step by marconji:

    * open the solution in visual studios
    * in the solution configuration manager define a new platform (x86) and set is as platform for debuging
    * try to do a full build (this will fail because of missing dlls). this will create a folder x86 in [code\WUW01\bin]
    * copy all dll files from [code\WUW01\bin\debug] to [code\WUW01\bin\x86] these files:
    DirectShowLib-2005.dll FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib.dll VEarthControl.dll WeatherReaderMVC.dll WebCamLib.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    * now back in visual studio remove all the references to the following dlls
    FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib?.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    * then click on add reference and browse to the x86 folder and add select the following dlls and add them:
    FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib?.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    * rebuild the solution and you will only receive warnings.
    * now create the follwing folder: [code\WUW01\bin\x86\Debug\Gestures] [code\WUW01\bin\x86\Debug\Inkings] [code\WUW01\bin\x86\Debug\pics] [code\WUW01\bin\x86\Debug\temp]
    * copy the xml files from code\WUW01\bin\Debug\Gestures to code\WUW01\bin\x86\Debug\Gestures
    * copy the DirectShowLib?-2005.dll and WebCamLib?.dll from code\WUW01\bin\Debug\ to code\WUW01\bin\x86\Debug\
    * push the debug button and the app will start
    * you will get an null reference error in WUW_Paint but you can click continue F5
    * the app will start with the camrea on and with the config screen, you need to press the new marker button the screen will flicker and will frezze after 4 secs or so. put you markers in front of the camera within those four secs and when the camera freezes with the mouse mark your markers (click hold mouse down and draw a circle) mark all four and then click the SAVE M button so you can load them next time the markers will be tracked you will seee squares on the screen if you hover with the mouse over the square on the top right , the config screen wil hide or show if you click view in the camera tab in the config screen you will get a window showing the guestures loaded, have not got them working yet.

    ReplyDelete
  4. Hey , I'm Ala'a from Jordan ......
    Actually i connect and run the code of the sexthsense ....but i have a problem in the Markers !! I can not control the movement of the Markers ....when i try to move it over the surface it's move in another place and it's so fast !:D ... another think where i must but the mirror exactly ?

    Plz Rajesh , can U help me ???

    Note :- I'm using the Cam of my laptop and a large Projector

    ReplyDelete
  5. @Alaa147 : Make sure that when you are moving the markers you have a simple and different background (Like white)...so that the camera can track the markers easily

    2.The mirror just reflects whatever is projected on it (by the projector which is placed downwards)
    so you dont actually need to put the mirror, you can just put your projector horizontally.

    ReplyDelete
  6. Hi
    I have windows 64 bit and this exeption show when i debug in line (111) from WUW.cs

    XamlParseExeption occurred

    Cannot create instance of 'WeatherReaderUI' defined in assembly
    'WeatherReaderMVC, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null'.
    Exception has been thrown by the target of an invocation. Error at object
    'viewbox1' in markup file 'WPFControl_Weather01;component/usercontrol1.xaml'
    Line 12 Position 14.

    ReplyDelete
    Replies
    1. Hi Bashar,
      Make sure you're not offline.If you face this issue again check your internet settings.

      Delete
  7. Rajesh, very good tutorial.
    great if you can add the links to download softwares as well:

    *visual studio C# 2010- http://www.microsoft.com/visualstudio/en-us/products/2010-editions/visual-csharp-express

    *install directX SDK- http://www.microsoft.com/download/en/details.aspx?id=10084&hash=IYXPCllHASPeSu7Cq6oC0AIsuXpRXBWfM1v%2fX3Wf0Jkiv1VUmgCNNbhsjCrRHuUWxBi4E4GeO5OEqIa2T%2fQ8HA%3d%3d

    ReplyDelete
    Replies
    1. Thanks and ya I will add it.. :)

      Delete
  8. Nice tutorial.Can u tell me when the mobile version of this software will come out?

    ReplyDelete
    Replies
    1. Hi shikhar,
      Thanks and the mobile version is still in progress.

      Delete
  9. Also the weather and menu app is not working. I try to run it and get some error which i cannot understand

    ReplyDelete
    Replies
    1. Give some details or pics of the problem....

      Delete
  10. Can u tell me if there is a exact date which is set for the release of the mobile version.
    I also read somewhere that the software is being ported to android. I wanted to know if that is true.

    ReplyDelete
    Replies
    1. Ya currently the software is being ported to android but there's no exact date for the release as it may take a while to develop it.

      Delete
  11. This comment has been removed by the author.

    ReplyDelete
  12. Where do the photos get saved once we have clicked them?

    ReplyDelete
    Replies
    1. If you have downloaded the code from google then the pics get saved in the folder "pics" (Directory= ....code\WUW01\bin\Debug\pics)

      Delete
  13. Can you tell me exactly what gestures are for which apps?

    ReplyDelete
    Replies
    1. Loop (cursive e) => Draw Demo
      Magnifying Glass (thumbtack) => Map
      Triangle => Photo
      Circle => Clock
      Star (5 point) => Weather
      Rectangular frame => Photo

      Delete
  14. I found the photos folder. Once they are saved I dont know how to view them using gestures and I also do not know how to click using gesture.

    ReplyDelete
    Replies
    1. To click you have to make a square frame using your finger.

      Delete
  15. I have a 1.3MP logitech camera and it seems to be working just fine. But when I start the jeff han app it shows a delay of event when I actually do it and when it happens on screen. Sometimes even the camera works too slow. It lags too much.

    ReplyDelete
    Replies
    1. Its not due to the camera,try using simple background like white while using the app.

      Delete
    2. I use a plain white background with no other colour. But even then when I start some of the apps the camera lags too much. Do you think that it might be a computer hardware problem. I have a 2GB RAM.
      Will the newspaper app work for any newspaper or just an american one. I put the times of india in front of the camera and some error comes. I can send you the screenshot if you give me your email-id.

      Delete
    3. Its not a hardware related issue.Make sure that you've properly added the markers and the background is not similar to any of your markers that will ensure more accuracy while tracking.Moreover lighting conditions also affect the tracking..
      There is an error in the newspaper code that will be fixed in next releases of the code

      Delete
    4. hi rajesh ,
      i'm nt able to debug da .sln file. if i open it vl says windows cannot open this file. can you plz help me out to figure this.

      Delete
  16. I also wanted to know what is the fly game app??

    ReplyDelete
    Replies
    1. The fly app is a color recognition game.There's no more info about that.I guess its all about catching a fly using two or more color markers.

      Delete
  17. when i start the newspaper app i get an error.if u give me your email-id i will send u the scrrenshots.reply asap thank you.

    ReplyDelete
  18. Hi.. I am getting the following error while debugging this code.

    "An unhandled exception of type 'System.BadImageFormatException' occurred in Microsoft.VisualStudio.HostingProcess.Utilities.dll

    Additional information: is not a valid Win32 application. (Exception from HRESULT: 0x800700C1"

    I've followed the steps of Rajesh (macronji) but didn't help me to resolve it. I am using MS Visual Studio 2010, Is it something wrong with this version. Any help would be much appreciated on this. Thank You. .

    ReplyDelete
    Replies
    1. After following the steps what errors are you getting ?

      Delete
  19. Hey I just wanted to know if it was possible to use your iPhone as the mobile device. If it is possible could you explain how to do it please. Thank you for reading

    ReplyDelete
    Replies
    1. You can use the Iphone camera as a webcam on your computer. You can follow the instructions here: (http://techtips.salon.com/use-iphone-webcam-pc-4938.html)
      but if you want to use it as a processing device then I dont have any idea.

      Delete
  20. Thank you for all the work you have been doing to let us laymen be able to use thus amazing innovation

    ReplyDelete
  21. Wish we could use this technology for K-12 classrooms TODAY so each student had a virtual Windows desktop on their school desk. Do you think today's version of the software could easily manage that without confusing the students? One problem would be that the batteries on the devices around the neck would run out of battery too soon if they were used a lot, too.

    ReplyDelete
    Replies
    1. Sry for the late reply.
      The current version has many bugs and issues that will be fixed in later versions and it is not yet completely developed so it may be confusing for students.

      Delete
  22. @rajesh
    from wer can i download the software???

    ReplyDelete
    Replies
    1. You can download it from here Github : (https://github.com/sixthsense/sixthsense) or from Google codes (http://code.google.com/p/sixthsense/downloads/list)

      Delete
  23. hey how to use an another moniter as a projector by connecting it to the laptop
    email me at siddhartha51997@gmail.com or comment

    ReplyDelete
  24. hey am getting the BadImageFormatException

    what should i do in order to throw this exception
    Am using windows 64 bit

    please help me

    thank you

    ReplyDelete
    Replies
    1. Read the previous comments you will get it buddy !

      Delete
  25. Hi Rajesh.

    If you could answer my question it would be really helpful.
    When I try to start to set up the colors I alway get the same error that says "the directive #endregion was expected", this error seems to be in the dollar recognition app.
    I´ve been trying to fix this for several time but until now I have not succeded.
    Thanks.

    ReplyDelete
    Replies
    1. If you can provide me some pics of the error den it may be helpful ! Try to re- download the software.

      Delete
  26. Hello,
    I followed all the steps but still encounter the BadImageFormatException.
    Comment by project member coolrk.15, Apr 8, 2012
    I guess you are using windows 64 bit....Just follow these step:
    1.open the solution in visual studios,in the solution configuration manager define a new platform (x86) and set is as platform for debuging
    2.Try to do a full build (this will fail because of missing dlls). this will create a folder x86 in [code\WUW01\bin]
    3.copy all dll files from [code\WUW01\bin\debug] to [code\WUW01\bin\x86] these files: DirectShowLib?-2005.dll FluidKit?.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib?.dll VEarthControl.dll WeatherReaderMVC.dll WebCamLib?.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    4.now back in visual studio remove all the references to the following dlls FluidKit?.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib??.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    5.then click on add reference and browse to the x86 folder and add select the following dlls and add them: FluidKit?.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib??.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll
    6.rebuild the solution and you will only receive warnings.
    7.now create the follwing folder: [code\WUW01\bin\x86\Debug\Gestures] [code\WUW01\bin\x86\Debug\Inkings] [code\WUW01\bin\x86\Debug\pics] [code\WUW01\bin\x86\Debug\temp]
    8.copy the xml files from code\WUW01\bin\Debug\Gestures to code\WUW01\bin\x86\Debug\Gestures
    9.copy the DirectShowLib??-2005.dll and WebCamLib??.dll from code\WUW01\bin\Debug\ to code\WUW01\bin\x86\Debug\
    10.push the debug button and the app will start
    11.you will get an null reference error in WUW_Paint but you can click continue F5 & the app will start with the camrea on and with the config screen, you need to press the new marker button the

    ReplyDelete
    Replies
    1. First of all I'm really sorry for replying you so late. I have made a new tutorial for installing on windows 64 bit,do check it, link: http://sixthsensewuw.blogspot.in/2014/10/how-to-install-sixthsense-on-windows.html

      Delete
  27. This comment has been removed by the author.

    ReplyDelete
  28. hi Rajesh Kumar..thank for Tutorial....I have a few questions.
    1) The mobile phone for compute is mobile phone normal ??!
    2) how to upload software on mobile phone ?
    3) Bluetooth is established between the mobile device and how?
    thank .

    ReplyDelete
    Replies
    1. Hi,
      David

      Currently we are working on to import it into mobile devices,and as of now it doesnt support mobile devices

      Delete
  29. Please, tell me how to run the applications using colour markers. If possible, please upload the video too.

    ReplyDelete
    Replies
    1. Hi,
      Ashish
      Sorry for replying late. You need to first configure the markers, then only you can use the app and you can follow the tutorials I have made to get an idea on how things are working.

      Delete
  30. hii, i did as you said and its working but i cant load the markers again. it gives me an error "out of range".. can you please help me out..
    thanks

    ReplyDelete
    Replies
    1. Hi,I guess you have already added the markers try removing them and add again.

      Delete
  31. hi,
    rajesh I am akash from india, I'm using 64 bit laptop menu,photos,globe,newspaper,books,weather are not working please help me

    ReplyDelete
    Replies
    1. Hi,
      Akash

      The code for these apps are not actually written in the current version but you can still use map,click photos and other stuffs.

      Delete