According to Phil Spencer, the believe that the HoloLens needs be a success as a standalone product and then they will look at specific scenarios on how it could be used with the PC or the Xbox One. As far as gaming goes, since the HoloLens is a standalone device, it is believed that it will follow the way that is normally goes for electronic devices like this and games will be developed for it. We have already seen Holobuilder which is like a Minecraft-inspired area. Not much of a leap to imagine getting the game itself to run on HoloLens.
The unveil of HoloLens during the Windows 10 event has a lot of people talking about the possibilities. One thing that we know for sure is that the level of interest is much high than anyone imagined.