MLchartDataset catalogue

Patent · US11792484B2 · B2 · US

Information providing system, information providing method and management apparatus for information providing system for providing information obtained through a robot

(11) Publication number
US11792484B2
(21) Application number
16/650,799
(22) Filing date
2018-09-14
(30) Priority date
2017-09-29
(43) Publication date
2023-10-17
(45) Date of grant
2023-10-17
(51) IPC
G06F 16/587; G06F 16/9035; G06F 16/909; G06V 20/20; H04N 21/472
(52) CPC
  • H04N Pictorial communication, e.g. television: 21/47217, 21/25841, 21/41407, 21/4622, 21/6587
  • A63H Toys, e.g. tops, dolls, hoops or building blocks: 11/00
  • B25J Manipulators; chambers provided with manipulation devices: 13/00, 19/02
  • G05D Systems for controlling or regulating non-electric variables: 1/0038
  • G06F Electric digital data processing: 16/587, 16/9035, 16/909, 3/01
  • G06V Image or video recognition or understanding: 20/20
(73) Assignee
Honda Motor Co Ltd
(72) Inventors
Shigenori Hiruta; Daisuke Muramatsu; Shiro Kitamura; Shuji Nakayama
(54) Title
Information providing system, information providing method and management apparatus for information providing system for providing information obtained through a robot
(57) Abstract

An information providing system includes: a memory unit configured to store an image data acquired by an imaging unit a robot in association with a position data and a time data acquired by an information acquisition portion; a data extraction portion configured to extract an image data corresponding to a time and a position instructed by the user from among the stored image data; and a display unit configured to display an image based on the extracted image data. The memory unit stores the image data acquired by the imaging unit of a first robot moving with a first user and the image data acquired by the imaging unit of a second robot moving with a second user. The data extraction portion extracts an image data corresponding to a time and a position instructed by the first user from among the image data acquired by the second robot stored in the memory unit when the image data corresponding to the time and the position instructed by the first user is not present among the image data acquired by the first robot stored in the memory unit.

Full text
View on Google Patents

Claims (8)

  1. An information providing system comprising: a first robot having a first imaging unit acquiring first image data and configured to move with a first user; a second robot having a second imaging unit acquiring second image data and configured to move with a second user; a server including a CPU and a memory connected to the CPU; and a user apparatus having a display, wherein the CPU is configured to perform: acquiring position data and time data of the first user or the first robot, and position data and time data of the second user or the second robot; storing, in the memory, the first image data acquired by the first imaging unit in association with the position data and the time data of the first user or the first robot; storing, in the memory, the second image data acquired by the second imaging unit in association with the position data and the time data of the second user or the second robot; receiving a target time and a target position from the user apparatus for which to playback the first image data; determining whether the first image data corresponding to the target time and the target position is present among the first image data stored in the memory; in response to determining that the first image data corresponding to the target time and the target position is present among the first image data stored in the memory: extracting, from the memory, the first image data corresponding to the target time and the target position; and transmitting the first image data to the user apparatus for displaying on the display; in response to determining that the first image data corresponding to the target time and the target position is not present among the first image data stored in the memory: extracting, from the memory, the second image data corresponding to the target time and the target position; and transmitting the second image data to the user apparatus for displaying on the display.
  2. An information providing system according to claim 1, wherein the CPU is configured to perform: extracting, from the memory, the second image data corresponding to the target time and the target position when the position data and the time data of the first robot or the first user corresponding to the target time and the target position are not stored in the memory.
  3. An information providing system according to claim 1, wherein the CPU is configured to perform: extracting, from the memory, the second image data corresponding to the target time and the target position on condition of a position of the first user or the first robot being within a predetermined distance from the target position.
  4. An information providing system according to claim 1, wherein: the first robot is configured to be able to walk.
  5. An information providing method comprising: acquiring first image data with a first imaging unit on a first robot configured to move with a first user; acquiring second image data with a second imaging unit on a second robot configured to move with a second user; acquiring position data and time data of the first user or the first robot, and position data and time data of the second user or the second robot; storing, in memory, the first image data acquired by the first imaging unit in association with the position data and the time data of the first user or the first robot; storing, in the memory, the second image data acquired by the second imaging unit in association with the position data and the time data of the second user or the second robot; receiving a target time and a target position from a user apparatus for which to playback the first image data; determining whether the first image data corresponding to the target time and the target position is present among the first image data stored in the memory; in response to determining that the first image data corresponding to the target time and the target position is present among the first image data stored in the memory: extracting, from the memory, the first image data corresponding to the target time and the target position; and transmitting the first image data to the user apparatus for displaying on a display; in response to determining that the first image data corresponding to the target time and the target position is not present among the first image data stored in the memory: extracting, from the memory, the second image data corresponding to the target time and the target position; and transmitting the second image data to the user apparatus for displaying on the display.
  6. An information providing method according to claim 5, wherein extracting the second image data comprises: extracting, from the memory, the second image data corresponding to the target time and the target position when the position data and the time data of the first robot or the first user corresponding to the target time and the target position are not stored in the memory.
  7. An information providing method according to claim 5, wherein extracting the second image data comprises: extracting, from the memory, the second image data corresponding to the target time and the target position on condition of a position of the first user or the first robot being within a predetermined distance from the target position.
  8. An information providing method according to claim 5, wherein: the first robot is configured to be able to walk.

Description

This invention relates to an information providing system, an information providing method and a management apparatus for the information providing system for providing information obtained through a robot.

As systems of this type are known ones adapted to acquire viewed image data and conversation data of a traveler through a robot carried by the traveler and to store the acquired data in a server (see Patent Document 1, for example). As the system stores data regarding images and conversations at spots visited while traveling, the user (traveler) can play back the data later.

Patent Literature 1: Japanese Unexamined Patent Publication No. 2017-104532

With the system taught by Patent Document 1, however, the system cannot provide the user reproducible data should the robot become incapable of acquiring visual and conversational data for some reason.

An aspect of the present invention is an information providing system including: a robot having an imaging unit acquiring an image data and configured to move with a user: an information acquisition portion configured to acquire a position data together with a time data of the user or the robot: a memory unit configured to store the image data acquired by the imaging unit in association with the position data and the time data acquired by the information acquisition portion; a data extraction portion configured to extract an image data corresponding to a time and a position instructed by the user from among the image data stored in the memory unit; and a display unit configured to display an image based on the image data extracted by the data extraction portion.

Citations (6)

  • US20070199108A1
  • US20110004341A1
  • US20110252057A1
  • US20180181670A1
  • JP2017104532A
  • US11281907B2
Record as JSON
{
  "publication_number": "US11792484B2",
  "country": "US",
  "kind": "B2",
  "title": "Information providing system, information providing method and management apparatus for information providing system for providing information obtained through a robot",
  "abstract": "An information providing system includes: a memory unit configured to store an image data acquired by an imaging unit a robot in association with a position data and a time data acquired by an information acquisition portion; a data extraction portion configured to extract an image data corresponding to a time and a position instructed by the user from among the stored image data; and a display unit configured to display an image based on the extracted image data. The memory unit stores the image data acquired by the imaging unit of a first robot moving with a first user and the image data acquired by the imaging unit of a second robot moving with a second user. The data extraction portion extracts an image data corresponding to a time and a position instructed by the first user from among the image data acquired by the second robot stored in the memory unit when the image data corresponding to the time and the position instructed by the first user is not present among the image data acquired by the first robot stored in the memory unit.",
  "claims": [
    "1. An information providing system comprising: a first robot having a first imaging unit acquiring first image data and configured to move with a first user; a second robot having a second imaging unit acquiring second image data and configured to move with a second user; a server including a CPU and a memory connected to the CPU; and a user apparatus having a display, wherein the CPU is configured to perform: acquiring position data and time data of the first user or the first robot, and position data and time data of the second user or the second robot; storing, in the memory, the first image data acquired by the first imaging unit in association with the position data and the time data of the first user or the first robot; storing, in the memory, the second image data acquired by the second imaging unit in association with the position data and the time data of the second user or the second robot; receiving a target time and a target position from the user apparatus for which to playback the first image data; determining whether the first image data corresponding to the target time and the target position is present among the first image data stored in the memory; in response to determining that the first image data corresponding to the target time and the target position is present among the first image data stored in the memory: extracting, from the memory, the first image data corresponding to the target time and the target position; and transmitting the first image data to the user apparatus for displaying on the display; in response to determining that the first image data corresponding to the target time and the target position is not present among the first image data stored in the memory: extracting, from the memory, the second image data corresponding to the target time and the target position; and transmitting the second image data to the user apparatus for displaying on the display.",
    "2. An information providing system according to claim 1, wherein the CPU is configured to perform: extracting, from the memory, the second image data corresponding to the target time and the target position when the position data and the time data of the first robot or the first user corresponding to the target time and the target position are not stored in the memory.",
    "3. An information providing system according to claim 1, wherein the CPU is configured to perform: extracting, from the memory, the second image data corresponding to the target time and the target position on condition of a position of the first user or the first robot being within a predetermined distance from the target position.",
    "4. An information providing system according to claim 1, wherein: the first robot is configured to be able to walk.",
    "5. An information providing method comprising: acquiring first image data with a first imaging unit on a first robot configured to move with a first user; acquiring second image data with a second imaging unit on a second robot configured to move with a second user; acquiring position data and time data of the first user or the first robot, and position data and time data of the second user or the second robot; storing, in memory, the first image data acquired by the first imaging unit in association with the position data and the time data of the first user or the first robot; storing, in the memory, the second image data acquired by the second imaging unit in association with the position data and the time data of the second user or the second robot; receiving a target time and a target position from a user apparatus for which to playback the first image data; determining whether the first image data corresponding to the target time and the target position is present among the first image data stored in the memory; in response to determining that the first image data corresponding to the target time and the target position is present among the first image data stored in the memory: extracting, from the memory, the first image data corresponding to the target time and the target position; and transmitting the first image data to the user apparatus for displaying on a display; in response to determining that the first image data corresponding to the target time and the target position is not present among the first image data stored in the memory: extracting, from the memory, the second image data corresponding to the target time and the target position; and transmitting the second image data to the user apparatus for displaying on the display.",
    "6. An information providing method according to claim 5, wherein extracting the second image data comprises: extracting, from the memory, the second image data corresponding to the target time and the target position when the position data and the time data of the first robot or the first user corresponding to the target time and the target position are not stored in the memory.",
    "7. An information providing method according to claim 5, wherein extracting the second image data comprises: extracting, from the memory, the second image data corresponding to the target time and the target position on condition of a position of the first user or the first robot being within a predetermined distance from the target position.",
    "8. An information providing method according to claim 5, wherein: the first robot is configured to be able to walk."
  ],
  "description_excerpt": "This invention relates to an information providing system, an information providing method and a management apparatus for the information providing system for providing information obtained through a robot.\n\nAs systems of this type are known ones adapted to acquire viewed image data and conversation data of a traveler through a robot carried by the traveler and to store the acquired data in a server (see Patent Document 1, for example). As the system stores data regarding images and conversations at spots visited while traveling, the user (traveler) can play back the data later.\n\nPatent Literature 1: Japanese Unexamined Patent Publication No. 2017-104532\n\nWith the system taught by Patent Document 1, however, the system cannot provide the user reproducible data should the robot become incapable of acquiring visual and conversational data for some reason.\n\nAn aspect of the present invention is an information providing system including: a robot having an imaging unit acquiring an image data and configured to move with a user: an information acquisition portion configured to acquire a position data together with a time data of the user or the robot: a memory unit configured to store the image data acquired by the imaging unit in association with the position data and the time data acquired by the information acquisition portion; a data extraction portion configured to extract an image data corresponding to a time and a position instructed by the user from among the image data stored in the memory unit; and a display unit configured to display an image based on the image data extracted by the data extraction portion.",
  "cpc": [
    "H04N 21/47217",
    "A63H 11/00",
    "B25J 13/00",
    "B25J 19/02",
    "G05D 1/0038",
    "G06F 16/587",
    "G06F 16/9035",
    "G06F 16/909",
    "G06F 3/01",
    "G06V 20/20",
    "H04N 21/25841",
    "H04N 21/41407",
    "H04N 21/4622",
    "H04N 21/6587"
  ],
  "ipc": [
    "G06F 16/587",
    "G06F 16/9035",
    "G06F 16/909",
    "G06V 20/20",
    "H04N 21/472"
  ],
  "assignees": [
    "Honda Motor Co Ltd"
  ],
  "inventors": [
    "Shigenori Hiruta",
    "Daisuke Muramatsu",
    "Shiro Kitamura",
    "Shuji Nakayama"
  ],
  "filing_date": "2018-09-14",
  "publication_date": "2023-10-17",
  "grant_date": "2023-10-17",
  "priority_date": "2017-09-29",
  "application_number": "US-201816650799-A",
  "family_id": "65902358",
  "cited_by_count": 0,
  "citations": [
    "US20070199108A1",
    "US20110004341A1",
    "US20110252057A1",
    "US20180181670A1",
    "JP2017104532A",
    "US11281907B2"
  ]
}

Record 637 of 8,000 in Patents full text (MLC-0201). Request the full dataset.