Patent · US9545880B2 · B2 · US
Information processing device, information processing method, and non-transitory computer-readable recording medium for showing an indication of an obstacle
- (11) Publication number
- US9545880B2
- (21) Application number
- 14/582,316
- (22) Filing date
- 2014-12-24
- (30) Priority date
- 2014-01-17
- (43) Publication date
- 2017-01-17
- (45) Date of grant
- 2017-01-17
- (51) IPC
- B60R 1/00; G02B 27/01; G06F 3/01; G06K 9/00; G01C 21/36; G06F 3/00; G08G 1/16
- (52) CPC
- G02B Optical elements, systems or apparatus: 27/0101, 2027/0138, 2027/014, 27/01
- B60R Vehicles, vehicle fittings, or vehicle parts, not otherwise provided for: 1/00, 2300/305, 2300/308, 2300/8093
- G01C Measuring distances, levels or bearings; surveying; navigation; gyroscopic instruments; photogrammetry or videogrammetry: 21/3697
- G06F Electric digital data processing: 3/00, 3/013
- G06K Graphical data reading; presentation of data; record carriers; handling record carriers: 9/00791, 9/00805
- G06V Image or video recognition or understanding: 20/56, 20/58
- G08G Traffic control systems: 1/166
- (73) Assignee
- Ricoh Co Ltd
- (72) Inventors
- Yasuhiro Kajiwara
- (54) Title
- Information processing device, information processing method, and non-transitory computer-readable recording medium for showing an indication of an obstacle
- (57) Abstract
An information processing device includes a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part, and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle.
- Full text
- View on Google Patents
Claims (10)
- An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination part configured to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen.
- The information processing device as claimed in claim 1, further comprising: a third calculation part configured to calculate a position of a second icon on the transparent screen in a case where a position of the obstacle is present in an area of the transparent screen, the second icon emphasizing the obstacle, the second icon being viewed at a position of the obstacle.
- The information processing device as claimed in claim 2, wherein the third calculation part is configured to calculate a straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate a position of a point of intersection between a position of the straight line and the transparent screen as a position of the second icon on the transparent screen.
- The information processing device as claimed in claim 1, wherein the second calculation part is configured to calculate a straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate a position of a point of intersection between the straight line and the transparent screen as a position of an end point of the indication line on the transparent screen.
- The information processing device as claimed in claim 1, wherein the first icon or an image of the obstacle is viewed as being changed depending on a running speed of the vehicle.
- An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle; and a fourth calculation part configured to calculate a perimeter line of the two-dimensional coordinate plane, the perimeter line being viewed, wherein the fourth calculation part is configured to change a perimeter line of the two-dimensional coordinate plane in a direction perpendicular to the transparent screen depending on a running speed of the vehicle.
- An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, wherein the first calculation part is configured to calculate a straight line passing through a position of the obstacle in the two-dimensional coordinate plane and a position of an eye ball of the driver and calculate a position of a point of intersection between a position of the straight line and the transparent screen as a position of the first icon on the transparent screen.
- An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, wherein the second calculation part is configured to calculate a first straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate, as a position of an end point of the indication line on the transparent screen, a position where a straight line passing through a position of a point of intersection between the first straight line and a plane identical to the transparent screen and a position of a point of intersection between a second straight line passing through a position of the obstacle on the two-dimensional coordinate plane and a position of an eye ball of the driver and the transparent screen intersects with a perimeter of the transparent screen.
- An information processing method, comprising: a first calculation step to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation step to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination step to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen.
- A non-transitory computer-readable recording medium storing therein a program configured to cause a computer to execute: a first calculation step to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation step to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination step to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen.
Description
1. Field of the Invention
An aspect of the present invention relates to at least one of an information processing device, an information processing method, and a non-transitory computer-readable recording medium.
2. Description of the Related Art
Conventionally, a head-up display device has been known as a device for assisting obstacle avoidance behavior of a driver during an operation of a vehicle.
A head-up display device is a device for presenting a transparent screen at a front position of a driver and displaying a variety of images thereon. According to such a device, an image for emphasizing an obstacle that is an attention calling object is arranged at a position on a transparent screen that corresponds to a position of an eye ball of a driver so that it is possible to superimpose and display such an image on the attention calling object. Hence, it is possible for a driver to perceive the attention calling object with a little of movement of a line of sight (see, for example, Japanese Patent Application Publication No. 2013-196359).
However, in a case of a conventional head-up display device that includes Japanese Patent Application Publication No. 2013-196359, an area where it is possible to superimpose and display an image for emphasizing an attention calling object on the attention calling object depends on a size of a transparent screen. Hence, in a case where a size of a transparent screen is small, it is merely possible to execute displaying of an emphasizing image for only an attention calling object present in a limited area.
Citations (11)
- JP3999025B2
- JP2010049232A
- US8810880B2
- US20120320207A1
- US9061632B2
- US20110199198A1
- JP2012244260A
- JP2013196359A
- US20140267263A1
- US9047703B2
- US20160003636A1
Record as JSON
{
"publication_number": "US9545880B2",
"country": "US",
"kind": "B2",
"title": "Information processing device, information processing method, and non-transitory computer-readable recording medium for showing an indication of an obstacle",
"abstract": "An information processing device includes a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part, and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle.",
"claims": [
"1. An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination part configured to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen.",
"2. The information processing device as claimed in claim 1, further comprising: a third calculation part configured to calculate a position of a second icon on the transparent screen in a case where a position of the obstacle is present in an area of the transparent screen, the second icon emphasizing the obstacle, the second icon being viewed at a position of the obstacle.",
"3. The information processing device as claimed in claim 2, wherein the third calculation part is configured to calculate a straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate a position of a point of intersection between a position of the straight line and the transparent screen as a position of the second icon on the transparent screen.",
"4. The information processing device as claimed in claim 1, wherein the second calculation part is configured to calculate a straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate a position of a point of intersection between the straight line and the transparent screen as a position of an end point of the indication line on the transparent screen.",
"5. The information processing device as claimed in claim 1, wherein the first icon or an image of the obstacle is viewed as being changed depending on a running speed of the vehicle.",
"6. An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle; and a fourth calculation part configured to calculate a perimeter line of the two-dimensional coordinate plane, the perimeter line being viewed, wherein the fourth calculation part is configured to change a perimeter line of the two-dimensional coordinate plane in a direction perpendicular to the transparent screen depending on a running speed of the vehicle.",
"7. An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, wherein the first calculation part is configured to calculate a straight line passing through a position of the obstacle in the two-dimensional coordinate plane and a position of an eye ball of the driver and calculate a position of a point of intersection between a position of the straight line and the transparent screen as a position of the first icon on the transparent screen.",
"8. An information processing device, comprising: a first calculation part configured to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation part configured to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, wherein the second calculation part is configured to calculate a first straight line passing through a position of the obstacle and a position of an eye ball of the driver and calculate, as a position of an end point of the indication line on the transparent screen, a position where a straight line passing through a position of a point of intersection between the first straight line and a plane identical to the transparent screen and a position of a point of intersection between a second straight line passing through a position of the obstacle on the two-dimensional coordinate plane and a position of an eye ball of the driver and the transparent screen intersects with a perimeter of the transparent screen.",
"9. An information processing method, comprising: a first calculation step to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; a second calculation step to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination step to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen.",
"10. A non-transitory computer-readable recording medium storing therein a program configured to cause a computer to execute: a first calculation step to calculate a position of a first icon on a transparent screen, the transparent screen being viewed by a driver of a vehicle, the first icon indicating that an obstacle in a path of a vehicle is detected from an image captured by an imaging part provided in the vehicle, the first icon being viewed at a position of the obstacle on a two-dimensional coordinate plane arranged at a lower limit position of the transparent screen, the two-dimensional coordinate plane corresponding to an imaging area of the imaging part; and a second calculation step to calculate a position of an end point of an indication line on the transparent screen, the indication line being viewed as extending from a position of the first icon on the transparent screen toward the obstacle, and a determination step to determine whether or not a position of the obstacle is present in an area of the transparent screen, an image of the obstacle being viewed at a position of the first icon on the transparent screen in a case where a position of the obstacle is not present in the transparent screen."
],
"description_excerpt": "1. Field of the Invention\n\nAn aspect of the present invention relates to at least one of an information processing device, an information processing method, and a non-transitory computer-readable recording medium.\n\n2. Description of the Related Art\n\nConventionally, a head-up display device has been known as a device for assisting obstacle avoidance behavior of a driver during an operation of a vehicle.\n\nA head-up display device is a device for presenting a transparent screen at a front position of a driver and displaying a variety of images thereon. According to such a device, an image for emphasizing an obstacle that is an attention calling object is arranged at a position on a transparent screen that corresponds to a position of an eye ball of a driver so that it is possible to superimpose and display such an image on the attention calling object. Hence, it is possible for a driver to perceive the attention calling object with a little of movement of a line of sight (see, for example, Japanese Patent Application Publication No. 2013-196359).\n\nHowever, in a case of a conventional head-up display device that includes Japanese Patent Application Publication No. 2013-196359, an area where it is possible to superimpose and display an image for emphasizing an attention calling object on the attention calling object depends on a size of a transparent screen. Hence, in a case where a size of a transparent screen is small, it is merely possible to execute displaying of an emphasizing image for only an attention calling object present in a limited area.",
"cpc": [
"G02B 27/0101",
"B60R 1/00",
"B60R 2300/305",
"B60R 2300/308",
"B60R 2300/8093",
"G01C 21/3697",
"G02B 2027/0138",
"G02B 2027/014",
"G02B 27/01",
"G06F 3/00",
"G06F 3/013",
"G06K 9/00791",
"G06K 9/00805",
"G06V 20/56",
"G06V 20/58",
"G08G 1/166"
],
"ipc": [
"B60R 1/00",
"G02B 27/01",
"G06F 3/01",
"G06K 9/00",
"G01C 21/36",
"G06F 3/00",
"G08G 1/16"
],
"assignees": [
"Ricoh Co Ltd"
],
"inventors": [
"Yasuhiro Kajiwara"
],
"filing_date": "2014-12-24",
"publication_date": "2017-01-17",
"grant_date": "2017-01-17",
"priority_date": "2014-01-17",
"application_number": "US-201414582316-A",
"family_id": "53544086",
"cited_by_count": 3,
"citations": [
"JP3999025B2",
"JP2010049232A",
"US8810880B2",
"US20120320207A1",
"US9061632B2",
"US20110199198A1",
"JP2012244260A",
"JP2013196359A",
"US20140267263A1",
"US9047703B2",
"US20160003636A1"
]
}
Record 4,362 of 8,000 in Patents full text (MLC-0201). Request the full dataset.