Multi-device robot control

{
  "publication_number": "US10889002B2",
  "country": "US",
  "kind": "B2",
  "title": "Multi-device robot control",
  "abstract": "Systems, methods, and related technologies are disclosed for multi-device robot control. In one implementation, input(s) are received and provided to a personal assistant or another application or service. In response, command(s) directed to an external device are received, e.g., from the personal assistant. Based on the command(s), a robot is maneuvered in relation to a location associated with the external device. Transmission of instruction(s) from the robot to the external device is initiated.",
  "claims": [
    "1. A system comprising: a processing device; and a memory coupled to the processing device and storing instructions that, when executed by the processing device, cause the system to perform operations comprising: receiving, at a robot, one or more inputs; providing, by the robot, the one or more inputs to a personal assistant; receiving, by the robot and from the personal assistant, one or more commands directed to an external device; determining, by the robot, a connectivity status of the external device; based on (a) the one or more commands and (b) the connectivity status of the external device, maneuvering the robot in relation to a location associated with the external device; and initiating a transmission of one or more instructions from the robot to the external device.",
    "2. The system of claim 1, wherein maneuvering the robot in relation to a location associated with the external device comprises establishing a connection with the external device.",
    "3. The system of claim 1, wherein the memory further stores instructions for causing the system to perform operations comprising generating confirmation content.",
    "4. The system of claim 3, wherein the confirmation content reflects that the one or more instructions were executed by the external device.",
    "5. The system of claim 3, wherein the memory further stores instructions for causing the system to perform operations comprising providing the confirmation content to the personal assistant.",
    "6. The system of claim 1, wherein receiving one or more inputs comprises: receiving one or more first inputs; processing the one or more first inputs to compute one or more quality metrics associated with the one or more first inputs; based on the computed one or more quality metrics, initiating one or more adjustments with respect to the robot; and receiving one or more second inputs.",
    "7. The system of claim 1, wherein initiating a transmission of one or more instructions comprises: requesting, via the robot, content originating from the external device; receiving the content from the external device; storing the content at the robot; and relaying the content from the robot to one or more devices.",
    "8. The system of claim 1, wherein the memory further stores instructions for causing the system to perform operations comprising: identifying one or more components accessible to the robot; selecting, in view of the one or more commands, at least one of the one or more components; and initiating one or more actions with respect to the at least one of the one or more components.",
    "9. The system of claim 8, wherein the one or more components comprise at least one of: one or more sensors integrated within the robot, one or more sensors integrated within a device in communication with the robot, or one or more sensors external to the robot.",
    "10. A method comprising: receiving, from a personal assistant, one or more commands directed to an external device; determining a connectivity status of the external device; based on (a) the one or more commands and (b) the connectivity status of the external device, maneuvering a robot in relation to a location associated with the external device; initiating a transmission of one or more instructions from the robot to the external device; identifying one or more components accessible to the robot, the one or more components comprising at least one of: one or more sensors integrated within the robot, one or more sensors integrated within a device in communication with the robot, or one or more sensors external to the robot; selecting at least one of the one or more components in view of (a) the one or more commands and (b) the connectivity status of the external device; and initiating one or more actions with respect to the at least one of the one or more components.",
    "11. The method of claim 10, wherein maneuvering the robot in relation to a location associated with the external device comprises establishing a connection with the external device.",
    "12. The method of claim 10, further comprising generating confirmation content.",
    "13. The method of claim 12, wherein the confirmation content reflects that the one or more instructions were executed by the external device.",
    "14. The method of claim 12, further comprising providing the confirmation content to the personal assistant.",
    "15. The method of claim 10, wherein receiving one or more inputs comprises: receiving one or more first inputs; processing the one or more first inputs to compute one or more quality metrics associated with the one or more first inputs; based on the computed one or more quality metrics, initiating one or more adjustments with respect to the robot; and receiving one or more second inputs.",
    "16. The method of claim 10, wherein initiating a transmission of one or more instructions comprises: requesting, via the robot, content originating from the external device; receiving the content from the external device; storing the content at the robot; and relaying the content from the robot to one or more devices.",
    "17. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising: receiving one or more first inputs; processing the one or more first inputs to compute one or more quality metrics associated with the one or more first inputs; based on the computed one or more quality metrics, initiating one or more adjustments with respect to a robot; receiving one or more second inputs; providing the one or more second inputs to a personal assistant; receiving, from the personal assistant, one or more commands directed to an external device; determining, by the robot, a connectivity status of the external device; based on (a) the one or more commands and (b) the connectivity status of the external device, maneuvering the robot in relation to a location associated with the external device; identifying one or more components accessible to the robot; selecting at least one of the one or more components in view of (a) the one or more commands and (b) the connectivity status of the external device; and initiating one or more actions with respect to the at least one of the one or more components.",
    "18. The non-transitory computer readable medium of claim 17, wherein initiating one or more actions with respect to the at least one of the one or more components comprises initiating one or more commands with respect to the external device via the at least one of the one or more components.",
    "19. The system of claim 1, wherein determining the connectivity status of the external device comprises determining, by the robot, that the personal assistant cannot connect with the external device.",
    "20. The method of claim 10, wherein determining the connectivity status of the external device comprises determining that the personal assistant cannot connect with the external device."
  ],
  "description_excerpt": "Aspects and implementations of the present disclosure relate to multi-device robot control, e.g., in conjunction with a surveillance robot.\n\nVarious robotic devices are capable of maneuver throughout physical spaces. Such robots can integrate sensors such as cameras and microphones.\n\nAspects and implementations of the present disclosure will be understood more fully from the detailed description given below and from the accompanying drawings of various aspects and implementations of the disclosure, which, however, should not be taken to limit the disclosure to the specific aspects or implementations, but are for explanation and understanding only. FIG. 1 is an example block diagram of a robot system. FIG. 2 is an example block diagram illustrating how a robot system connects to other devices within the home or local network and mobile devices via an external communication network. FIG. 3 is an example schematic representation of aspects of remote authentication between a robot and a mobile device. FIG. 4 shows an example of how remote communication between a robot and a mobile device is achieved. FIG. 5A is an example flow chart illustrating aspects of how device(s) can work synergistically with a robot in providing surveillance. FIG. 5B is a flow chart illustrating a method, in accordance with an example embodiment, for robot control.\n\nFIG. 6 is an example flow chart illustrating aspects of various modes of operation of an IoT robot, as described herein. FIG. 7 illustrates an example robot with a device removably mounted on the tablet dock. FIG.",
  "cpc": [
    "B25J 13/006",
    "B25J 11/008",
    "B25J 13/06",
    "B25J 9/161",
    "B25J 9/1679",
    "G05B 19/042",
    "G05B 2219/45103",
    "G05B 2219/50391",
    "G05D 1/028",
    "G06F 1/1626",
    "G06F 1/163",
    "G06F 1/1632",
    "G06N 3/008",
    "G08B 13/19647",
    "G08B 15/00",
    "H04L 63/08"
  ],
  "ipc": [
    "B25J 13/00",
    "G05B 19/042",
    "G06N 3/00",
    "H04L 29/06"
  ],
  "assignees": [
    "X TEND ROBOTICS INC"
  ],
  "inventors": [
    "KRAUSS GAVRIEL",
    "FOX HARRY"
  ],
  "filing_date": "2020-01-20",
  "publication_date": "2021-01-12",
  "grant_date": "2021-01-12",
  "priority_date": "2017-07-20",
  "application_number": "US-202016747525-A",
  "family_id": "65015310",
  "citations": [
    "JP2014142742A",
    "US2005287038A1",
    "US2009082879A1",
    "US2012310463A1",
    "US2014254896A1",
    "US2015197015A1",
    "US2015283702A1",
    "US2016066759A1",
    "US2016204953A1",
    "US2017092030A1",
    "US2017129099A1",
    "US2017282362A1",
    "US2017286916A1",
    "US2018043532A1",
    "US9250003B2",
    "WO2015108819A1"
  ]
}