Patent · US11544906B2 · B2 · US
Mobility surrogates
- (11) Publication number
- US11544906B2
- (21) Application number
- 16/892,801
- (22) Filing date
- 2020-06-04
- (30) Priority date
- 2019-06-05
- (43) Publication date
- 2023-01-03
- (45) Date of grant
- 2023-01-03
- (51) IPC
- G06F 3/01; G06N 20/00; G06T 19/00; H04L 9/14; H04N 7/18
- (52) CPC
- H04L Transmission of digital information, e.g. telegraphic communication: 9/14, 63/0442, 63/18, 9/0838, 9/32
- B25J Manipulators; chambers provided with manipulation devices: 19/023, 5/007
- G06F Electric digital data processing: 21/10, 21/606, 21/6209, 3/011, 3/016
- G06N Computing arrangements based on specific computational models: 20/00, 3/008, 3/088
- G06T Image data processing or generation, in general: 19/003, 19/006
- G06V Image or video recognition or understanding: 10/764, 10/82, 20/20, 40/113
- H04N Pictorial communication, e.g. television: 7/185
- H04W Wireless communication networks: 12/03, 12/67
- (73) Assignee
- Beyond Imagination Inc
- (72) Inventors
- Harry Kloor
- (54) Title
- Mobility surrogates
- (57) Abstract
A mobility surrogate includes a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal and a mobility base. The mobility base includes a support mechanism, with the humanoid form affixed to the support on the mobility base and a transport module that includes mechanical drive mechanism and a transport control module including a processor and memory that are configured to receive control messages from a network and process the control messages to control the transport module according to the control messages received from the network.
- Full text
- View on Google Patents
Claims (14)
- A mobility surrogate comprising: a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal; and a mobility base that comprises: a support mechanism, with the humanoid form affixed to the support on the mobility base; and a transport module comprising: mechanical drive mechanism; and a transport control module comprising: a processor and memory that are configured to receive control messages from a network; and process the control messages to control the transport module according to the control messages received from the network; and the mobility surrogate further comprising an artificial intelligence system that includes a processor device, memory and storage that stores computer instructions to cause an artificial intelligence engine to train the mobility surrogate, with the artificial intelligence engine executing computer instructions to: observe actions of a human performing a given task in the real world; analyze observed actions of the human to produce sequences of actions for the given task; and package the analyzed actions into a sequence package that is stored in computer storage; and an alias-substitution processing module comprising: a processor configured to: receive an image signal; detect a second mobility surrogate in the image signal; and replace the image data of the second surrogate in the first physical location, with image data of a user in the first physical location to form a transformed image.
- The mobility surrogate of claim 1 wherein the artificial intelligence engine operates with a database.
- The mobility surrogate of claim 1 wherein the artificial intelligence engine evolves to perform the tasks using the mobility surrogate.
- The mobility surrogate of claim 1 wherein the actions are analyzed and used to train the artificial intelligence engine in the real world, rather than via a training program.
- The mobility surrogate of claim 1 wherein the artificial intelligence engine is a mechanism that assists the human's control of the task.
- The mobility surrogate of claim 1 further comprises instructions to: train the artificial intelligence engine by observing the users actions.
- The mobility surrogate of claim 1 wherein training comprises instructions to: define a self-organizing map space as a finite two dimensional region of nodes, where the nodes are arranged in a grid; and associate each node in the grid with a weight vector that is a position in the input space.
- The mobility surrogate of claim 7 wherein training further comprises instructions to: apply a training example to the self-organizing map; randomize the node weight factors in the map; select a training vector randomly from training data input; and compute a given training vector's distance from each node in the map; and compare the node whose weight is closest to that of the training example as the best matching unit.
- The mobility surrogate of claim 1 wherein the artificial intelligence engine is configured to: learn the task to reduce or eliminate latency or delay time or to increase efficiency or reliability of performing the task.
- The mobility surrogate of claim 9 wherein the delays are bidirectional and can result from propagating of instructions through electronic equipment and communication, networks used to transmit the instructions and the processing time to execute instructions.
- The mobility surrogate of claim 1 wherein the artificial intelligence engine is built using a self-organizing map or self-organizing feature map, which are types of artificial neural networks trained by unsupervised learning techniques to produce a low-dimensional discretized representation of an input space of training samples.
- The mobility surrogate of claim 9, further comprises: a data center that is configured to accumulate and store skills sets for use with the artificial intelligence engine.
- The mobility surrogate of claim 12 wherein the artificial intelligence engine downloads the skill sets from the data center.
- The mobility surrogate of claim 9, further comprises: a platform that connects an operator to the mobility surrogate via a network; and a sensor user interface link.
Description
This application claims priority under 35 USC § 119(e) to U.S. Provisional Patent Application Ser. No. 62/857,347, filed on Jun. 5, 2019, and entitled “MOBILITY SURROGATES,” the entire contents of which are hereby incorporated by reference.
This disclosure relates to devices and systems for providing virtual surrogates for personal and group encounters through communication, observation, contact and mobility.
People can be separated by physical distances and yet can interact by conventional technologies such as telephones and teleconferencing. More recently, with the advent of networking and especially the Internet, people can hear each other's voices and see each other's images. Other developments have increased the perception of physical closeness.
For example, various types of virtual encounters are described in published patent application US 2005-0130108 A1 published Jun. 16, 2005. In the published application, a mannequin or a humanoid-type robot can be deployed as a surrogate for a human. In one type of encounter, a mannequin is paired with a set of goggles in a remote location. In another type, the surrogate is configured such that a human with sensors can produce actuation signals that are sent to actuators to a robot in a remote location, to remotely control movement of the robot via actuator signals sent to the actuators. Conversely, in another type of encounter, a humanoid robot can be configured with sensors for sending sensor signals to a body suit having actuators that receive the sensor signals, such that a user wearing the body suit feels what the humanoid robot senses.
Citations (4)
- US7362892B2
- US9449394B2
- US20170080565A1
- US20160059412A1
Record as JSON
{
"publication_number": "US11544906B2",
"country": "US",
"kind": "B2",
"title": "Mobility surrogates",
"abstract": "A mobility surrogate includes a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal and a mobility base. The mobility base includes a support mechanism, with the humanoid form affixed to the support on the mobility base and a transport module that includes mechanical drive mechanism and a transport control module including a processor and memory that are configured to receive control messages from a network and process the control messages to control the transport module according to the control messages received from the network.",
"claims": [
"1. A mobility surrogate comprising: a humanoid form supporting at least one camera that captures image data from a first physical location in which the first mobility surrogate is disposed to produce an image signal; and a mobility base that comprises: a support mechanism, with the humanoid form affixed to the support on the mobility base; and a transport module comprising: mechanical drive mechanism; and a transport control module comprising: a processor and memory that are configured to receive control messages from a network; and process the control messages to control the transport module according to the control messages received from the network; and the mobility surrogate further comprising an artificial intelligence system that includes a processor device, memory and storage that stores computer instructions to cause an artificial intelligence engine to train the mobility surrogate, with the artificial intelligence engine executing computer instructions to: observe actions of a human performing a given task in the real world; analyze observed actions of the human to produce sequences of actions for the given task; and package the analyzed actions into a sequence package that is stored in computer storage; and an alias-substitution processing module comprising: a processor configured to: receive an image signal; detect a second mobility surrogate in the image signal; and replace the image data of the second surrogate in the first physical location, with image data of a user in the first physical location to form a transformed image.",
"2. The mobility surrogate of claim 1 wherein the artificial intelligence engine operates with a database.",
"3. The mobility surrogate of claim 1 wherein the artificial intelligence engine evolves to perform the tasks using the mobility surrogate.",
"4. The mobility surrogate of claim 1 wherein the actions are analyzed and used to train the artificial intelligence engine in the real world, rather than via a training program.",
"5. The mobility surrogate of claim 1 wherein the artificial intelligence engine is a mechanism that assists the human's control of the task.",
"6. The mobility surrogate of claim 1 further comprises instructions to: train the artificial intelligence engine by observing the users actions.",
"7. The mobility surrogate of claim 1 wherein training comprises instructions to: define a self-organizing map space as a finite two dimensional region of nodes, where the nodes are arranged in a grid; and associate each node in the grid with a weight vector that is a position in the input space.",
"8. The mobility surrogate of claim 7 wherein training further comprises instructions to: apply a training example to the self-organizing map; randomize the node weight factors in the map; select a training vector randomly from training data input; and compute a given training vector's distance from each node in the map; and compare the node whose weight is closest to that of the training example as the best matching unit.",
"9. The mobility surrogate of claim 1 wherein the artificial intelligence engine is configured to: learn the task to reduce or eliminate latency or delay time or to increase efficiency or reliability of performing the task.",
"10. The mobility surrogate of claim 9 wherein the delays are bidirectional and can result from propagating of instructions through electronic equipment and communication, networks used to transmit the instructions and the processing time to execute instructions.",
"11. The mobility surrogate of claim 1 wherein the artificial intelligence engine is built using a self-organizing map or self-organizing feature map, which are types of artificial neural networks trained by unsupervised learning techniques to produce a low-dimensional discretized representation of an input space of training samples.",
"12. The mobility surrogate of claim 9, further comprises: a data center that is configured to accumulate and store skills sets for use with the artificial intelligence engine.",
"13. The mobility surrogate of claim 12 wherein the artificial intelligence engine downloads the skill sets from the data center.",
"14. The mobility surrogate of claim 9, further comprises: a platform that connects an operator to the mobility surrogate via a network; and a sensor user interface link."
],
"description_excerpt": "This application claims priority under 35 USC § 119(e) to U.S. Provisional Patent Application Ser. No. 62/857,347, filed on Jun. 5, 2019, and entitled “MOBILITY SURROGATES,” the entire contents of which are hereby incorporated by reference.\n\nThis disclosure relates to devices and systems for providing virtual surrogates for personal and group encounters through communication, observation, contact and mobility.\n\nPeople can be separated by physical distances and yet can interact by conventional technologies such as telephones and teleconferencing. More recently, with the advent of networking and especially the Internet, people can hear each other's voices and see each other's images. Other developments have increased the perception of physical closeness.\n\nFor example, various types of virtual encounters are described in published patent application US 2005-0130108 A1 published Jun. 16, 2005. In the published application, a mannequin or a humanoid-type robot can be deployed as a surrogate for a human. In one type of encounter, a mannequin is paired with a set of goggles in a remote location. In another type, the surrogate is configured such that a human with sensors can produce actuation signals that are sent to actuators to a robot in a remote location, to remotely control movement of the robot via actuator signals sent to the actuators. Conversely, in another type of encounter, a humanoid robot can be configured with sensors for sending sensor signals to a body suit having actuators that receive the sensor signals, such that a user wearing the body suit feels what the humanoid robot senses.",
"cpc": [
"H04L 9/14",
"B25J 19/023",
"B25J 5/007",
"G06F 21/10",
"G06F 21/606",
"G06F 21/6209",
"G06F 3/011",
"G06F 3/016",
"G06N 20/00",
"G06N 3/008",
"G06N 3/088",
"G06T 19/003",
"G06T 19/006",
"G06V 10/764",
"G06V 10/82",
"G06V 20/20",
"G06V 40/113",
"H04L 63/0442",
"H04L 63/18",
"H04L 9/0838",
"H04L 9/32",
"H04N 7/185",
"H04W 12/03",
"H04W 12/67"
],
"ipc": [
"G06F 3/01",
"G06N 20/00",
"G06T 19/00",
"H04L 9/14",
"H04N 7/18"
],
"assignees": [
"Beyond Imagination Inc"
],
"inventors": [
"Harry Kloor"
],
"filing_date": "2020-06-04",
"publication_date": "2023-01-03",
"grant_date": "2023-01-03",
"priority_date": "2019-06-05",
"application_number": "US-202016892801-A",
"family_id": "73650685",
"cited_by_count": 0,
"citations": [
"US7362892B2",
"US9449394B2",
"US20170080565A1",
"US20160059412A1"
]
}
Record 887 of 8,000 in Patents full text (MLC-0201). Request the full dataset.