Movable display for viewing and interacting with computer generated environments

{
  "publication_number": "US11032537B2",
  "country": "US",
  "kind": "B2",
  "title": "Movable display for viewing and interacting with computer generated environments",
  "abstract": "There is disclosed a system for viewing augmented, virtual, mixed, and combined reality environments. The system calculates the position and orientation of a movable display within physical space and translated those into an appropriate rendering of the content on the movable display also taking into account a head location for a viewer. The motion and location data for the movable display device and a viewer's head may be generated using trackers of various types.",
  "claims": [
    "1. A system for viewing three-dimensional virtual reality content comprising: a movable display for rendering the three-dimensional virtual reality content for display; at least one tracker for tracking the movable display; a computing device configured to generate the three-dimensional virtual reality content; wherein the movable display is configured such that movement of the movable display relative to a viewer's head is detected using the at least one tracker is translated by the computing device into alteration of a viewing area of the three-dimensional virtual reality content corresponding to the movement of the movable display relative to the viewer's head, by: generating a matrix representative of a position and orientation of the movable display in physical space; generating a second matrix representative of a second position and a second orientation of the viewer's head; merging the matrix and the second matrix into a final matrix; and rendering the three-dimensional virtual reality content on the moveable display based upon the final matrix.",
    "2. The system of claim 1 further comprising a head-mounted tracker for detecting the second position and the second orientation for the viewer's head.",
    "3. The system of claim 1 wherein the second matrix is generated, in part, using a pair of offsets from the second position and the second orientation, the pair of offsets representative of a pair of eyes for the viewer's head; and wherein the three-dimensional virtual reality content includes two distinct perspectives of the three-dimensional virtual reality content, one for each of the pair of eyes based upon the pair of offsets.",
    "4. The system of claim 1 wherein the computing device is further for: generating a third matrix representative of a third position and a third orientation of a second viewer's head; merging the third matrix into the final matrix; and rendering the three-dimensional virtual reality content on the movable display based upon the final matrix.",
    "5. The system of claim 1 wherein rendering includes showing changes in the locations of objects displayed by an image on the moveable display in response to tracking the position and the second position; and wherein rendering includes generating only the three-dimensional virtual reality content that is visible from a viewer's perspective, based upon the position.",
    "6. The system of claim 1 wherein the display operates as a window for viewing the three-dimensional virtual reality content from a perspective of a viewer based upon the final matrix; and wherein the three-dimensional virtual reality content combines objects within the physical space and computer generated objects.",
    "7. The system of claim 1 wherein the movable display is a projector that projects the three-dimensional virtual reality content into a surface or in free space within the physical space based upon the final matrix.",
    "8. A method viewing three-dimensional virtual reality content comprising: rendering the three-dimensional virtual reality content for display by a movable display; tracking movement of the movable display using at least one tracker; and translating the movement of the movable display relative to a viewer's head into alteration of a viewing area of the three-dimensional virtual reality content shown on by the movable display by generating a matrix representative of a position and orientation of the movable display; generating a second matrix representative of a second position and a second orientation of the viewer's head; merging the matrix and the second matrix into a final software matrix; and rendering the three-dimensional virtual reality content on the movable display based upon the final matrix.",
    "9. The method of claim 8 further comprising detecting the second position and the second orientation for the viewer's head using a head-mounted tracker.",
    "10. The method of claim 8 wherein the second matrix is generated, in part, using a pair of offsets from the second position and the second orientation, the pair of offsets representative of a pair of eyes for the viewer's head; and wherein the three-dimensional virtual reality content includes two distinct perspectives of the three-dimensional virtual reality content, one for each of the pair of eyes based upon the pair of offsets.",
    "11. The method of claim 8 wherein rendering includes showing changes in the locations of objects displayed in an image on the moveable display in response to tracking the position and the second position; and wherein rendering includes generating only the three-dimensional virtual reality content that is visible from a viewer's perspective, based upon the position.",
    "12. The method of claim 8 wherein the display operates as a window for viewing the three dimensional virtual reality content from a perspective of a viewer based upon the final matrix; and wherein the three-dimensional virtual reality content combines objects within the physical space and computer generated objects.",
    "13. The method of claim 8 wherein the movable display is a projector that projects the three-dimensional virtual reality content into a surface or in free space within the physical space based upon the final matrix.",
    "14. The method of claim 8 further comprising: generating a third matrix representative of a third position and a third orientation of a second viewer's head; merging the third matrix into the final matrix; and rendering the computer-generated content on the movable display based upon the final matrix.",
    "15. Apparatus comprising software, which when executed by a processor will cause the processor to generate three-dimensional virtual reality content, the software for instructing the processor to: display the three-dimensional virtual reality content for display by a movable display; track movement of the movable display using at least one tracker; and translate the movement of the movable display relative to a viewer's head into alteration of a viewing area of the three-dimensional virtual reality content shown by the movable display by generating a matrix representative of a position and orientation of the movable display generating a second matrix representative of a second position and a second orientation of the viewer's head; merging the matrix and the second matrix into a final software matrix; and rendering the three-dimensional virtual reality content on the movable display based upon the final matrix.",
    "16. The apparatus of claim 15 wherein the second matrix is generated, in part, using a pair of offsets from the second position and the second orientation, the pair of offsets representative of a pair of eyes for the viewer's head; and wherein the three-dimensional virtual reality content includes two distinct perspectives of the three-dimensional virtual reality content, one for each of the pair of eyes based upon the pair of offsets.",
    "17. The apparatus of claim 15 wherein rendering includes showing changes in the locations of objects displayed in an image on the moveable display in response to tracking the position and the second position; and wherein rendering includes generating only the three-dimensional virtual reality content that is visible from a viewer's perspective, based upon the position.",
    "18. The apparatus of claim 15 wherein the display operates as a window for viewing the three dimensional virtual reality content from a perspective of a viewer based upon the final matrix; and wherein the three-dimensional virtual reality content combines objects within the physical space and computer generated objects.",
    "19. The apparatus of claim 15 wherein the movable display is a projector that projects the three-dimensional virtual reality content into a surface or in free space within the physical space based upon the final matrix.",
    "20. The apparatus of claim 15 wherein the instructions further instruct the processor to: generate a third matrix representative of a third position and a third orientation of a second viewer's head; merge the third matrix into the final matrix; and render the computer-generated content on the movable display based upon the final matrix."
  ],
  "description_excerpt": "A portion of the disclosure of this patent document contains material which is subject to copyright protection. This patent document may show and/or describe matter which is or may become trade dress of the owner. The copyright and trade dress owner has no objection to the facsimile reproduction by anyone of the patent disclosure as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright and trade dress rights whatsoever.\n\nThis disclosure relates to a moveable display for viewing augmented, virtual, mixed, and extended reality environments.\n\nVirtual reality and augmented reality headsets or head mounted displays have periodically come into vogue and faded from the public eye. Most-recently, these types of displays have enabled various types of augmented and virtual reality experiences ranging from games to virtual “visits” to real places. Telepresence is increasingly becoming feasible on a relatively large scale as well.\n\nHowever, one of the primary drawbacks to use of a head-mounted display (HMD) is that they typically completely cover the eyes of a wearer. This isolates the individual from any social interaction he or she may have while using the HMD. And, viewers or others nearby cannot necessarily see what is happening on the screen of the HMD without some external display and streaming of that content to that display. Unlike traditional television video games, this lessens the positive experience for all involved because the experiences typically become solitary ones. Multiplayer experiences are relatively limited at present for these types of experiences.",
  "cpc": [
    "H04N 13/366",
    "G02B 27/0093",
    "G06F 3/011",
    "G06F 3/012",
    "G06F 3/0346",
    "G06F 3/14",
    "G06T 19/006"
  ],
  "ipc": [
    "G06F 3/01",
    "G06T 19/00",
    "H04N 13/366"
  ],
  "assignees": [
    "Athanos Inc"
  ],
  "inventors": [
    "Peter Giokaris",
    "Michael Zyda",
    "Joseph Sardone"
  ],
  "filing_date": "2020-05-27",
  "publication_date": "2021-06-08",
  "grant_date": "2021-06-08",
  "priority_date": "2019-05-13",
  "application_number": "US-202016885029-A",
  "family_id": "68696140",
  "cited_by_count": 2,
  "citations": [
    "US20080191864A1",
    "CN105843396B",
    "US8717294B2",
    "CN105843396A",
    "CN102939139A",
    "CN102939139B",
    "EP2579128B1",
    "US9791897B2",
    "US20140118357A1",
    "KR101955224B1",
    "US9804257B2",
    "US9839840B2",
    "US20170287219A1",
    "US20170351094A1"
  ]
}