Guide display device and crane provided with same

{
  "publication_number": "US11987478B2",
  "country": "US",
  "kind": "B2",
  "title": "Guide display device and crane provided with same",
  "abstract": "Provided is a guide display device with which incorrect recognition of a place having small features as a ground surface having no features can be suppressed in generating and updating a three-dimensional map. A data processing unit (70): detects an edge (Eg) of a feature (E) on the basis of a result of subjecting image data captured by a camera (61) to image processing, and recognizes the feature (E) on the basis of the edge (Eg); and accumulates, from a predetermined number of frames from before the time at which the image data was captured, point group data (P) of a nearby range (Ma) of the edge (Eg) of the feature (E) that was recognized as a ground surface (F), and generates, on the basis of the accumulated point group data (P), a three-dimensional map (M) of the feature (E) the edge (Eg) of which has been recognized.",
  "claims": [
    "1. A guide display device of a crane, comprising: a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo, create a three-dimensional map based on the representative point, and update the three-dimensional map when a representative point calculated anew and an existing representative point are different from each other, wherein the data processing section detects an edge of the ground object based on a result of image processing of image data of the lifting cargo, the ground surface and the ground object captured with a camera from above the lifting cargo, recognizes the ground object based on the edge, accumulates, for predetermined frames prior to a time point of capturing the image data, the point group data that is in a nearby range of the edge of the ground object and is recognized to be the ground surface, and generates the three-dimensional map of the ground object whose edge is recognized based on the point group data that is accumulated.",
    "2. The guide display device according to claim 1, wherein the data processing section cuts the three-dimensional map that is generated, into a plurality of layers in a height direction for each grid cell, and updates the three-dimensional map to set, as a height of the ground object, an average altitude value of the point group data included in a highest layer of the plurality of layers.",
    "3. The guide display device according to claim 1, wherein the nearby range of the edge includes a total of nine grid cells composed of the grid cell where the edge passes through, and eight grid cells located around the grid cell where the edge passes through.",
    "4. The guide display device according to claim 1, wherein the data processing section accumulates the three-dimensional map of the ground object whose edge is recognized.",
    "5. The guide display device according to claim 1, wherein the data processing section calculates the edge through an image process based on a Canny method.",
    "6. The guide display device according to claim 1, further comprising a data display section configured to display the image captured with the camera, wherein guide information generated based on the three-dimensional map is displayed on the data display section in a superimposed manner on the image captured with the camera.",
    "7. A crane comprising the guide display device according to claim 1."
  ],
  "description_excerpt": "The present invention relates to a guide display device and a crane including the same.\n\nIn the related art, a guide display device that can present information related to positions and altitudes of a lifting cargo and a ground object around the lifting cargo to the operator is publicly known. Such a guide display device is disclosed in PTL 1.\n\nThe guide display device disclosed in PTL 1 includes a data processing section that calculates a representative point for each grid cell by using point group data acquired by a laser scanner and creates a three-dimensional map based on the representative point. The data processing section generates a guide information such as a guide frame diagram surrounding the lifting cargo and the ground object, and displays the guide information in a superimposed manner on the image captured by the camera on a data display section. With such a guide display device, the information related to positions and altitudes of the lifting cargo and the ground object around the lifting cargo can be presented to the operator.\n\nHowever, in the guide display device disclosed in PTL 1, at the time of generating and updating the three-dimensional map for small ground objects with a size that falls within the measuring line interval of the laser emitted from the laser scanner, the height of the position of the ground object in the three-dimensional map may be recognized to be the same as the height of the region around the ground object, that is, the ground object may be erroneously recognized to be the ground surface.",
  "cpc": [
    "B66C 13/46",
    "B66C 15/065",
    "G01C 21/3826",
    "G01S 17/89",
    "G06T 2207/10028",
    "G06T 7/13",
    "G06V 10/443",
    "H04N 7/183"
  ],
  "ipc": [
    "B66C 13/46",
    "G01S 17/89",
    "G06T 7/13",
    "G06V 10/44"
  ],
  "assignees": [
    "Tadano Ltd",
    "Kansai University"
  ],
  "inventors": [
    "Iwao ISHIKAWA",
    "Takayuki Kosaka",
    "Keita MASHIMA",
    "Satoshi Kubota",
    "Shigenori Tanaka",
    "Masaya NAKAHARA",
    "Koki NAKAHATA"
  ],
  "filing_date": "2021-03-23",
  "publication_date": "2024-05-21",
  "grant_date": "2024-05-21",
  "priority_date": "2020-03-26",
  "application_number": "US-202117911029-A",
  "family_id": "77890417",
  "cited_by_count": 0,
  "citations": [
    "US4752012A",
    "US5067013A",
    "US20050281644A1",
    "US20130147640A1",
    "US20130013251A1",
    "US20160167932A1",
    "US20180170720A1",
    "US20180143011A1",
    "DE102017112661A1",
    "US20210147192A1",
    "JP2019024151A",
    "US11084692B2"
  ]
}