Detection of overhanging objects

{
  "publication_number": "US9915951B2",
  "country": "US",
  "kind": "B2",
  "title": "Detection of overhanging objects",
  "abstract": "An autonomous vehicle can encounter an external environment in which an object overhangs a current road of the autonomous vehicle. For example, the branch of a tree may overhang the road. Such an overhanging object can be detected and suitable driving maneuvers for the autonomous vehicle can be determined. Sensor data can be acquired from at least a forward portion of the external environment. One or more floating obstacle candidates can be identified based on the acquired sensor data. The identified one or more floating obstacle candidates can be filtered to remove any floating obstacle candidates that do not meet one or more predefined parameters. A driving maneuver for the autonomous vehicle can be determined at least partially based on a height clearance between the autonomous vehicle and floating obstacle candidates that remain after being filtered out. The autonomous vehicle can be caused to implement the determined driving maneuver.",
  "claims": [
    "1. A method of detecting overhanging objects in an external environment of an autonomous vehicle, the method comprising: identifying one or more floating obstacle candidates based on sensor data acquired from at least a forward portion of the external environment; filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters; determining a driving maneuver for the autonomous vehicle at least partially based on a height clearance between the autonomous vehicle and floating obstacle candidates that remain after being filtered out; and causing the autonomous vehicle to implement the determined driving maneuver.",
    "2. The method of claim 1, wherein the sensor data is a plurality of object data points, and wherein identifying one or more floating obstacle candidates based on sensor data acquired from at least a forward portion of the external environment includes: sensing at least the forward portion of the external environment to acquire the plurality of object data points; filtering out the acquired object data points to remove object data points located outside of one or more road boundaries of a current road of the autonomous vehicle; and grouping the acquired object data points that remain after being filtered out into one or more obstacle candidates, wherein the one or more floating obstacle candidates are identified from the one or more obstacle candidates.",
    "3. The method of claim 2, wherein sensing at least a forward portion of the external environment to acquire the plurality of object data points is performed using one or more LIDAR sensors.",
    "4. The method of claim 2, wherein filtering out the acquired object data points to remove object data points located outside of one or more road boundaries of the current road of the autonomous vehicle includes: locating the acquired object data points on a map, wherein the map includes the current road of the autonomous vehicle and the one or more road boundaries of the current road of the autonomous vehicle; and filtering out any object data points located laterally outside of the one or more road boundaries or located laterally outside of a predetermined distance from the one or more road boundaries.",
    "5. The method of claim 2, wherein grouping the object data points that remain after being filtered out into one or more obstacle candidates includes point clustering the object data points that remain after being filtered out into one or more obstacle candidates.",
    "6. The method of claim 1, wherein filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters includes: sensing at least a forward portion of the external environment to acquire speed data of objects located therein; associating the acquired speed data with the one or more floating obstacle candidates; comparing the speed data associated with the one or more floating obstacle candidates to a predetermined speed threshold; and filtering out any of the floating obstacle candidates with associated speed data that is above the predetermined speed threshold.",
    "7. The method of claim 6, wherein sensing at least a forward portion of the external environment to acquire speed data is performed using one or more RADAR sensors.",
    "8. The method of claim 6, further including: determining whether any floating obstacle candidate with associated speed data that is below the predetermined speed threshold is a floating object or an occluded object; and wherein, if the floating obstacle candidate is determined to be an occluded object, filtering out the occluded object so that it is not used in determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance of the filtered out one or more floating obstacle candidates; and wherein, if the floating obstacle candidate is determined to be a floating object, determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance includes determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance of the floating object.",
    "9. The method of claim 1, wherein determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance between the autonomous vehicle and floating obstacle candidates that remain after being filtered out includes: determining whether the autonomous vehicle will collide with one or more of the floating obstacle candidates that remain after being filtered out based at least on a current driving path of the autonomous vehicle and the height clearance between the autonomous vehicle and the floating obstacle candidates that remain after being filtered out, wherein, if it is determined that the autonomous vehicle will collide with one or more of the floating obstacle candidates that remain after being filtered out, the determined driving maneuver includes a lateral movement of the autonomous vehicle, wherein, if it is determined that the autonomous vehicle will not collide with one or more of the floating obstacle candidates that remain after being filtered out, the determined driving maneuver includes maintaining the current driving path of the autonomous vehicle.",
    "10. The method of claim 9, wherein the lateral movement of the autonomous vehicle is one of a lane shift or a lane change.",
    "11. The method of claim 9, wherein the sensor data is a plurality of object data points, further including: projecting the object data points associated with floating obstacle candidates that remain after being filtered out onto a plane substantially perpendicular to a driving direction of the autonomous vehicle; and forming a first enclosure to around the projected object data points, wherein the height clearance of the filtered out one or more floating obstacle candidates is based at least partially on a height clearance between the autonomous vehicle and the first enclosure.",
    "12. The method of claim 11, further including: wherein, if it is determined that the autonomous vehicle will collide with one or more of the floating obstacle candidates that remain after being filtered out, filtering out the projected object data points that are located at a higher elevation than a height of the autonomous vehicle; project the object data points that remain after being filtered out to a ground plane; and forming a second enclosure around the projected object data points on the ground plane, wherein the lateral movement of the autonomous vehicle is based on the second enclosure.",
    "13. A system for detecting overhanging objects in an external environment of an autonomous vehicle, the system comprising: a sensor system configured to acquire sensor data of at least a forward portion of the external environment of the autonomous vehicle; and a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations comprising: identifying one or more floating obstacle candidates based on the acquired sensor data of at least a forward portion of the external environment; filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters; determining a driving maneuver for the autonomous vehicle at least partially based on a height clearance between the autonomous vehicle and of the floating obstacle candidates that remain after being filtered out; and causing the autonomous vehicle to implement the determined driving maneuver.",
    "14. The system of claim 13, wherein the sensor data is a plurality of object data points, and wherein identifying one or more floating obstacle candidates based on sensor data acquired from at least a forward portion of the external environment includes: sensing, using the sensor system, at least the forward portion of the external environment to acquire the plurality of object data points; filtering out the acquired object data points to remove object data points located outside of one or more road boundaries of a current road of the autonomous vehicle; and grouping the object data points that remain after being filtered out into one or more obstacle candidates, wherein the one or more floating obstacle candidates are identified from the one or more obstacle candidates.",
    "15. The system of claim 14, wherein filtering out the acquired object data points to remove object data points located outside of one or more road boundaries of a current road of the autonomous vehicle includes: locating the object data points on a map, wherein the map includes the current road of the autonomous vehicle and the one or more road boundaries of the current road of the autonomous vehicle; and filtering out object data points located laterally outside of the one or more road boundaries or located laterally outside of a predetermined distance from the one or more road boundaries.",
    "16. The system of claim 14, wherein the sensor system includes one or more LIDAR sensors, wherein the sensor data is a plurality of object data points, and wherein the one or more LIDAR sensors are configured to sense at least a forward portion of the external environment to acquire object data points.",
    "17. The system of claim 14, wherein the sensor system includes one or more RADAR sensors, wherein the one or more RADAR sensors are configured to sense at least a forward portion of the external environment to acquire speed data for one or more objects located therein.",
    "18. The system of claim 17, wherein filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters includes: associating the acquired speed data with the one or more floating obstacle candidates; comparing the speed data associated with the one or more floating obstacle candidates to a predetermined speed threshold; and filtering out any of the floating obstacle candidates with associated speed data that is above the predetermined speed threshold.",
    "19. The system of claim 18, further including: determining whether any floating obstacle candidate with associated speed data that is below the predetermined speed threshold is a floating object or an occluded object; and wherein, if the floating obstacle candidate is determined to be an occluded object, filtering out the occluded object so that it is not used in determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance of the filtered out one or more floating obstacle candidates; and wherein, if the floating obstacle candidate is determined to be a floating object, determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance between the autonomous vehicle and any floating obstacle candidates that remain after being filtered out includes determining the driving maneuver for the autonomous vehicle at least partially based on the height clearance of the floating object.",
    "20. A computer program product for detecting overhanging objects in an external environment of an autonomous vehicle, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therein, the program code executable by a processor to perform a method comprising: identifying one or more floating obstacle candidates based on sensor data acquired from at least a forward portion of the external environment; filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters; determining a driving maneuver for the autonomous vehicle at least partially based on a height clearance between the autonomous vehicle and floating obstacle candidates that remain after being filtered out; and causing the autonomous vehicle to implement the determined driving maneuver."
  ],
  "description_excerpt": "The subject matter described herein relates in general to vehicles having an autonomous operational mode and, more particularly, to the operation of such vehicles in environments in which objects overhang a road.\n\nSome vehicles include an operational mode in which a computing system is used to navigate and/or maneuver the vehicle along a travel route with minimal or no input from a human driver. Such vehicles are equipped with sensors that are configured to detect information about the surrounding environment, including the presence of objects in the environment. The computing systems are configured to process the detected information to determine how to navigate and/or maneuver the vehicle through the surrounding environment. The presence of some objects may affect the determination of how to navigate and/or maneuver the vehicle through the surrounding environment.\n\nIn one respect, the present disclosure is directed to a method of detecting overhanging objects in an external environment of an autonomous vehicle. The method can include identifying one or more floating obstacle candidates based on sensor data acquired from at least a forward portion of the external environment. The method can include filtering out the identified one or more floating obstacle candidates based on one or more predefined parameters to remove false positives. The method can also include determining a driving maneuver for the autonomous vehicle at least partially based on a height clearance between the autonomous vehicle and the floating obstacle candidate(s) that remain after being filtered out.",
  "cpc": [
    "G05D 1/0257",
    "B60W 2554/20",
    "B60W 60/0016",
    "G01S 13/931",
    "G01S 17/931",
    "G01S 17/936",
    "G01S 2013/9318",
    "G01S 2013/9342",
    "G05D 1/0088"
  ],
  "ipc": [
    "G01S 13/931",
    "G01S 17/931",
    "G05D 1/00",
    "G05D 1/02"
  ],
  "assignees": [
    "Toyota Motor Engineering and Manufacturing North America Inc"
  ],
  "inventors": [
    "Xue Mei",
    "Katsuhiro Sakai",
    "Nobuhide Kamata"
  ],
  "filing_date": "2015-12-27",
  "publication_date": "2018-03-13",
  "grant_date": "2018-03-13",
  "priority_date": "2015-12-27",
  "application_number": "US-201514979462-A",
  "family_id": "59087810",
  "cited_by_count": 11,
  "citations": [
    "JPH11149557A",
    "US20140330456A1",
    "JP2009301400A",
    "US20120316725A1",
    "JP2012238151A",
    "US20120310466A1",
    "US8589014B2",
    "US20140139676A1",
    "US20150272413A1",
    "US9164511B1",
    "US20150045994A1",
    "US9216745B2",
    "US20150334269A1",
    "US20160221500A1",
    "US9432929B1"
  ]
}