Robot utility and interface device

{
  "publication_number": "US11911704B2",
  "country": "US",
  "kind": "B2",
  "title": "Robot utility and interface device",
  "abstract": "Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.",
  "claims": [
    "1. A method for providing a gaming session by a robot, comprising: receiving, from a user, an instruction for executing a video game; identifying a position of the user within a physical environment; identifying attributes of a surface within the physical environment for projecting the video game; determining a game controller from a plurality of game controllers to be used by the user for interacting with the video game; establishing a wireless connection with the game controller; the robot moving to a first location proximal to the user for providing the game controller to the user based on the position of the user; the robot moving to a second location for projecting a graphical output of the video game based on the position of the user and attributes of the surface; and executing the video game and projecting the graphical output of the video game onto the surface, wherein the game controller enables the user to interact with the video game.",
    "2. The method of claim 1, wherein said determining the game controller from a plurality of game controllers is based on one or more of a request made by the user, a preference setting of the user, a prediction, a degree of randomness, or a specification provided by the video game.",
    "3. The method of claim 1, wherein the game controller is a detachable part that is mounted on the robot.",
    "4. The method of claim 1, wherein said providing the game controller to the user is performed by a robotic arm of the robot.",
    "5. The method of claim 1, wherein the game controller to be used by the user for interacting with the video game is a robotic arm of the robot."
  ],
  "description_excerpt": "This application is a Continuation of U.S. patent application Ser. No. 15/721,673, filed on Sep. 29, 2017 (U.S. Pat. No. 11,219,837, issued on Jan. 11, 2022), entitled “Robot Utility and Interface Device,” which is hereby incorporated by reference.\n\nThe present disclosure relates generally to personal robot utility and interface devices (RUIDs) and more particularly to methods and systems for enabling a robot to provide interactive interfaces to users and to provide accessory devices for interacting with the provided interactive interfaces.\n\nVirtual assistants such as Apple's Siri, Amazon's Alexa, and Microsoft's Cortana are becoming increasingly popular platforms for users to access information and certain types of content. Virtual assistants allow users to obtain answers to questions, play audio content, and even purchase consumer goods. The ability of current virtual assistants is limited, however, in the type of assistance that may be provided. For example, virtual assistants are generally only able to provide virtual (e.g., making an electronic purchase) or digital assistance that is communicable by audio. As a result, virtual assistants are lacking in their ability to deliver assistance in the “real world” because they are not able to perform tasks involving real world objects. Moreover, current virtual assistants are lacking in their ability to interact with users, typically being responsive to voice commands but limited in other input and output modalities.\n\nIt is in this context that embodiments arise.",
  "cpc": [
    "A63F 13/90",
    "A63F 13/213",
    "B25J 11/0005",
    "B25J 11/003",
    "B25J 11/008",
    "B25J 13/08",
    "B25J 15/04",
    "B25J 15/10",
    "B25J 5/007",
    "B25J 9/046",
    "G06F 3/017",
    "G06F 3/0425",
    "G06F 3/04817",
    "G06F 3/167",
    "H04N 9/3173",
    "H04N 9/3182",
    "H04N 9/3185",
    "H04N 9/3194"
  ],
  "ipc": [
    "A63F 13/213",
    "A63F 13/90",
    "B25J 11/00",
    "B25J 13/08",
    "B25J 15/04",
    "B25J 15/10",
    "B25J 5/00",
    "B25J 9/04",
    "G06F 3/01",
    "G06F 3/042",
    "G06F 3/04817",
    "G06F 3/16",
    "H04N 9/31"
  ],
  "assignees": [
    "Sony Interactive Entertainment Inc"
  ],
  "inventors": [
    "Javier Fernandez Rico",
    "Erik Beran",
    "Michael Taylor",
    "Ruxin Chen"
  ],
  "filing_date": "2022-01-11",
  "publication_date": "2024-02-27",
  "grant_date": "2024-02-27",
  "priority_date": "2017-09-29",
  "application_number": "US-202217573587-A",
  "family_id": "64100711",
  "cited_by_count": 0,
  "citations": [
    "US20130253703A1",
    "US20180007341A1",
    "US10155166B1",
    "US11219837B2"
  ]
}