MLchartDataset catalogue

Patent · US10317240B1 · B1 · US

Travel data collection and publication

(11) Publication number
US10317240B1
(21) Application number
15/473,996
(22) Filing date
2017-03-30
(30) Priority date
2017-03-30
(43) Publication date
2019-06-11
(45) Date of grant
2019-06-11
(51) IPC
G01C 21/36; G06N 20/00; G06N 99/00
(52) CPC
  • G01C Measuring distances, levels or bearings; surveying; navigation; gyroscopic instruments; photogrammetry or videogrammetry: 21/3694, 21/3679, 21/3811, 21/3841, 21/3848
  • G06N Computing arrangements based on specific computational models: 20/00, 20/10, 3/045, 3/0464, 3/08, 3/09, 99/005
(73) Assignee
Zoox Inc
(72) Inventors
Adriano Di Pietro; Gabriel Thurston Sibley; James William Vaisey Philbin
(54) Title
Travel data collection and publication
(57) Abstract

Travel data may be gathered and published on a global map for use by various entities. The travel data may be captured by one or more vehicle computing devices, such as those associated with the operation and/or control of a vehicle. The vehicle computing devices may receive input from one or more sensors, and may identify and/or classify an event and/or areas of interest based on the input. The vehicle computing devices may then send travel data to the global map server for publication. Additionally or alternatively, the travel data may be captured by one or more user devices. The user devices may be configured to receive travel data, such as via a user interface, and to send the travel data to the global map server for publication. The global map server may consolidate and publish the travel data on a global map.

Full text
View on Google Patents

Claims (20)

  1. A computer implemented method comprising: receiving data from one or more sensors, the data associated with at least one of an event or an area of interest; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the at least one of the event or the area of interest, wherein the plurality of classifications comprises: a first classification associated with an accident; a second classification associated with a construction site; and a third classification associated with a fire; determining, based at least in part on the classification, that the data is relevant data; incorporating, at a global map server, the relevant data and the classification into a global map; receiving a request for derived data; determining, based at least in part on the global map, the derived data; and causing, based at least in part on the derived data, an autonomous vehicle to be deployed to a location associated with the at least one of the event or the area of interest in order to gather additional data associated with the at least one of the event or the area of interest.
  2. The method of claim 1, wherein the method further comprises determining a location of the at least one of the event or the area of interest associated with the data, wherein determining the location comprises: receiving a vehicle location from a location sensor of a vehicle; receiving a distance and a bearing from the vehicle to the event or the area of interest from a ranging sensor of the one or more sensors; and calculating the location of the at least one of the event or the area of interest based on the vehicle location, the distance, and the bearing from the vehicle to the at least one of the event or the area of interest, and further wherein the classification is based, at least in part, on one or more of: object recognition on an image of the data, or speech recognition on an audio signal of the data.
  3. The method of claim 1, wherein the receiving the data from the one or more sensors comprises: receiving the data from one or more of: a camera; a LIDAR sensor; a RADAR sensor; an ultrasonic transducer; a GPS receiver; an accelerometer; a magnetometer; or a gyroscope.
  4. The method of claim 1, wherein: determining the classification comprises: inputting at least a portion of the data into one or more machine learning algorithms; executing the one or more machine learning algorithms; and receiving, as output from the one or more machine learning algorithms, the classification.
  5. The method of claim 1, further comprising: determining, based at least in part on recognizing an object in an image of the data, a confidence level of the classification of the data.
  6. A method comprising: receiving, at a global map server, travel data from a vehicle, wherein the travel data is associated with an event located in an area of a global map; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the event; incorporating, by the global map server, travel data and the classification into the global map; determining derived information from the global map, the derived information being associated with the area; publishing the derived information; and causing, based at least in part on the derived information, an autonomous vehicle to be deployed to the area.
  7. The method of claim 6, wherein: the travel data further comprises at least one of: a text description of the event, an image of the event, or an audio signal related to the event; the determining the derived information comprises selecting at least a portion of the text description, the image, or the audio signal; and the plurality of classifications comprises at least one of: a first classification associated with an accident, a second classification associated with a construction site, or a third classification associated with a fire.
  8. The method of claim 6, further comprising: identifying a subscriber to a global map service; and determining a subscription level of the subscriber, wherein publishing the derived information is based at least in part on the subscription level.
  9. The method of claim 6, further comprising assigning a confidence level to the travel data, wherein the incorporating the event, the location, and the classification into the global map is based at least in part on the confidence level being at or above a threshold confidence level.
  10. The method of claim 6, wherein the vehicle comprises a first vehicle, and the method further comprises: assigning a confidence level to the classification; receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; and increasing the confidence level based at least in part on the second travel data.
  11. The method of claim 6, wherein the travel data further comprises text describing the event, and the method further comprises: performing text recognition on the text; removing sensitive data from the text; associating the text with the global map; and publishing the text.
  12. The method of claim 6, wherein the travel data further comprises an image of the event and the method further comprises removing sensitive data from the image prior to publication of the global map, wherein the sensitive data comprises at least one of: a license plate number, a license plate issuing authority, a face of a person in the image, or a human form.
  13. The method of claim 6, wherein the vehicle comprises a first vehicle, and the method further comprises: receiving, at the global map server and from a second vehicle, an image corresponding to the event; and incorporating the image into the global map, wherein determining the derived information comprises selecting the image.
  14. The method of claim 6, wherein the travel data comprises first travel data received from a first vehicle, and the method further comprises: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; and associating the second travel data with the event, wherein determining the derived information comprises selecting at least a portion of the second travel data.
  15. A system comprising: one or more processors; and one or more non-transitory computer readable media storing computer-executable instructions that, when executed by the one or more processors, cause the system to perform operations comprising: receiving, at a global map server, travel data from a vehicle, wherein the travel data comprises a location of an event; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the event; determining a confidence level of the travel data; incorporating the travel data and the classification into a global map based at least in part on the location of the event and the confidence level; determining derived information from the global map; publishing the derived information; and causing, based at least in part on the derived information, the vehicle to be deployed to an area proximate the location of the event to gather additional data associated with the event.
  16. The system of claim 15, wherein the system further comprises a first vehicle, and the operations further comprise: receiving, at the global map server, an audio signal corresponding to a description of the event from a second vehicle; and incorporating the audio signal into the global map by associating the audio signal with the travel data, wherein determining the derived information comprises selecting at least a portion of the audio signal.
  17. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; and associating the second travel data with the event, wherein determining the derived information comprises selecting at least a portion of the second travel data.
  18. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; determining whether a first time associated with the first travel data is more recent than a second time associated with the second travel data, wherein determining the derived information comprises selecting the second travel data and not selecting the first travel data based on the second time being more recent than the first time.
  19. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; determining that the first travel data comprises a first type of data and the second travel data comprises a second type of data, wherein determining the derived information comprises selecting at least a portion of one or more of the first travel data or the second travel data.
  20. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; and altering the confidence level associated with the event, wherein altering the confidence level comprises one or more of: lowering a confidence level if the first travel data and the second travel data disagree, or raising the confidence level if the first travel data and the second travel data agree.

Description

Vehicular and other transportation methods can be impaired due to various events, such as accidents and traffic. Vehicle operators are often caught unaware of, and thus are affected by, these events. Sometimes, the vehicles controlled by the vehicle operators may further compound the effects of an event. For example, a driver or system operating a vehicle may not be aware of an accident on a roadway. The driver or system may operate the vehicle on the roadway, and may be slowed down or stopped, thereby adding to the congestion caused by the accident.

The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same reference numbers in different figures indicate similar or identical items.

FIG. 1 is an example travel data collection and publication system.

FIG. 2 is an example environment in which a vehicle may collect travel data in a travel data collection and publication system.

FIG. 3 is a block diagram that illustrates select components of an example global map server device used for travel data collection and publication.

FIG. 4 is an example global map generated in a travel data collection and publication system.

FIG. 5 is a flow diagram of an illustrative process for gathering and publishing travel data.

FIG. 6 is a flow diagram of another illustrative process for gathering and publishing travel data.

FIG. 7 is a flow diagram of yet another illustrative process for gathering and publishing travel data.

Citations (8)

  • US20080071465A1
  • US20080042825A1
  • US20110137895A1
  • US20170169625A1
  • US20160379486A1
  • US20160357188A1
  • US9566986B1
  • US9940834B1
Record as JSON
{
  "publication_number": "US10317240B1",
  "country": "US",
  "kind": "B1",
  "title": "Travel data collection and publication",
  "abstract": "Travel data may be gathered and published on a global map for use by various entities. The travel data may be captured by one or more vehicle computing devices, such as those associated with the operation and/or control of a vehicle. The vehicle computing devices may receive input from one or more sensors, and may identify and/or classify an event and/or areas of interest based on the input. The vehicle computing devices may then send travel data to the global map server for publication. Additionally or alternatively, the travel data may be captured by one or more user devices. The user devices may be configured to receive travel data, such as via a user interface, and to send the travel data to the global map server for publication. The global map server may consolidate and publish the travel data on a global map.",
  "claims": [
    "1. A computer implemented method comprising: receiving data from one or more sensors, the data associated with at least one of an event or an area of interest; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the at least one of the event or the area of interest, wherein the plurality of classifications comprises: a first classification associated with an accident; a second classification associated with a construction site; and a third classification associated with a fire; determining, based at least in part on the classification, that the data is relevant data; incorporating, at a global map server, the relevant data and the classification into a global map; receiving a request for derived data; determining, based at least in part on the global map, the derived data; and causing, based at least in part on the derived data, an autonomous vehicle to be deployed to a location associated with the at least one of the event or the area of interest in order to gather additional data associated with the at least one of the event or the area of interest.",
    "2. The method of claim 1, wherein the method further comprises determining a location of the at least one of the event or the area of interest associated with the data, wherein determining the location comprises: receiving a vehicle location from a location sensor of a vehicle; receiving a distance and a bearing from the vehicle to the event or the area of interest from a ranging sensor of the one or more sensors; and calculating the location of the at least one of the event or the area of interest based on the vehicle location, the distance, and the bearing from the vehicle to the at least one of the event or the area of interest, and further wherein the classification is based, at least in part, on one or more of: object recognition on an image of the data, or speech recognition on an audio signal of the data.",
    "3. The method of claim 1, wherein the receiving the data from the one or more sensors comprises: receiving the data from one or more of: a camera; a LIDAR sensor; a RADAR sensor; an ultrasonic transducer; a GPS receiver; an accelerometer; a magnetometer; or a gyroscope.",
    "4. The method of claim 1, wherein: determining the classification comprises: inputting at least a portion of the data into one or more machine learning algorithms; executing the one or more machine learning algorithms; and receiving, as output from the one or more machine learning algorithms, the classification.",
    "5. The method of claim 1, further comprising: determining, based at least in part on recognizing an object in an image of the data, a confidence level of the classification of the data.",
    "6. A method comprising: receiving, at a global map server, travel data from a vehicle, wherein the travel data is associated with an event located in an area of a global map; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the event; incorporating, by the global map server, travel data and the classification into the global map; determining derived information from the global map, the derived information being associated with the area; publishing the derived information; and causing, based at least in part on the derived information, an autonomous vehicle to be deployed to the area.",
    "7. The method of claim 6, wherein: the travel data further comprises at least one of: a text description of the event, an image of the event, or an audio signal related to the event; the determining the derived information comprises selecting at least a portion of the text description, the image, or the audio signal; and the plurality of classifications comprises at least one of: a first classification associated with an accident, a second classification associated with a construction site, or a third classification associated with a fire.",
    "8. The method of claim 6, further comprising: identifying a subscriber to a global map service; and determining a subscription level of the subscriber, wherein publishing the derived information is based at least in part on the subscription level.",
    "9. The method of claim 6, further comprising assigning a confidence level to the travel data, wherein the incorporating the event, the location, and the classification into the global map is based at least in part on the confidence level being at or above a threshold confidence level.",
    "10. The method of claim 6, wherein the vehicle comprises a first vehicle, and the method further comprises: assigning a confidence level to the classification; receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; and increasing the confidence level based at least in part on the second travel data.",
    "11. The method of claim 6, wherein the travel data further comprises text describing the event, and the method further comprises: performing text recognition on the text; removing sensitive data from the text; associating the text with the global map; and publishing the text.",
    "12. The method of claim 6, wherein the travel data further comprises an image of the event and the method further comprises removing sensitive data from the image prior to publication of the global map, wherein the sensitive data comprises at least one of: a license plate number, a license plate issuing authority, a face of a person in the image, or a human form.",
    "13. The method of claim 6, wherein the vehicle comprises a first vehicle, and the method further comprises: receiving, at the global map server and from a second vehicle, an image corresponding to the event; and incorporating the image into the global map, wherein determining the derived information comprises selecting the image.",
    "14. The method of claim 6, wherein the travel data comprises first travel data received from a first vehicle, and the method further comprises: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; and associating the second travel data with the event, wherein determining the derived information comprises selecting at least a portion of the second travel data.",
    "15. A system comprising: one or more processors; and one or more non-transitory computer readable media storing computer-executable instructions that, when executed by the one or more processors, cause the system to perform operations comprising: receiving, at a global map server, travel data from a vehicle, wherein the travel data comprises a location of an event; determining, from a plurality of classifications and based at least in part on a semantic scene parsing, a classification for the event; determining a confidence level of the travel data; incorporating the travel data and the classification into a global map based at least in part on the location of the event and the confidence level; determining derived information from the global map; publishing the derived information; and causing, based at least in part on the derived information, the vehicle to be deployed to an area proximate the location of the event to gather additional data associated with the event.",
    "16. The system of claim 15, wherein the system further comprises a first vehicle, and the operations further comprise: receiving, at the global map server, an audio signal corresponding to a description of the event from a second vehicle; and incorporating the audio signal into the global map by associating the audio signal with the travel data, wherein determining the derived information comprises selecting at least a portion of the audio signal.",
    "17. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; and associating the second travel data with the event, wherein determining the derived information comprises selecting at least a portion of the second travel data.",
    "18. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; determining whether a first time associated with the first travel data is more recent than a second time associated with the second travel data, wherein determining the derived information comprises selecting the second travel data and not selecting the first travel data based on the second time being more recent than the first time.",
    "19. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; determining that the first travel data comprises a first type of data and the second travel data comprises a second type of data, wherein determining the derived information comprises selecting at least a portion of one or more of the first travel data or the second travel data.",
    "20. The system of claim 15, wherein the travel data comprises first travel data received from a first vehicle, and the operations further comprise: receiving, at the global map server, second travel data from a second vehicle, wherein the second travel data corresponds to the event; associating the second travel data with the event; and altering the confidence level associated with the event, wherein altering the confidence level comprises one or more of: lowering a confidence level if the first travel data and the second travel data disagree, or raising the confidence level if the first travel data and the second travel data agree."
  ],
  "description_excerpt": "Vehicular and other transportation methods can be impaired due to various events, such as accidents and traffic. Vehicle operators are often caught unaware of, and thus are affected by, these events. Sometimes, the vehicles controlled by the vehicle operators may further compound the effects of an event. For example, a driver or system operating a vehicle may not be aware of an accident on a roadway. The driver or system may operate the vehicle on the roadway, and may be slowed down or stopped, thereby adding to the congestion caused by the accident.\n\nThe detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same reference numbers in different figures indicate similar or identical items.\n\nFIG. 1 is an example travel data collection and publication system.\n\nFIG. 2 is an example environment in which a vehicle may collect travel data in a travel data collection and publication system.\n\nFIG. 3 is a block diagram that illustrates select components of an example global map server device used for travel data collection and publication.\n\nFIG. 4 is an example global map generated in a travel data collection and publication system.\n\nFIG. 5 is a flow diagram of an illustrative process for gathering and publishing travel data.\n\nFIG. 6 is a flow diagram of another illustrative process for gathering and publishing travel data.\n\nFIG. 7 is a flow diagram of yet another illustrative process for gathering and publishing travel data.",
  "cpc": [
    "G01C 21/3694",
    "G01C 21/3679",
    "G01C 21/3811",
    "G01C 21/3841",
    "G01C 21/3848",
    "G06N 20/00",
    "G06N 20/10",
    "G06N 3/045",
    "G06N 3/0464",
    "G06N 3/08",
    "G06N 3/09",
    "G06N 99/005"
  ],
  "ipc": [
    "G01C 21/36",
    "G06N 20/00",
    "G06N 99/00"
  ],
  "assignees": [
    "Zoox Inc"
  ],
  "inventors": [
    "Adriano Di Pietro",
    "Gabriel Thurston Sibley",
    "James William Vaisey Philbin"
  ],
  "filing_date": "2017-03-30",
  "publication_date": "2019-06-11",
  "grant_date": "2019-06-11",
  "priority_date": "2017-03-30",
  "application_number": "US-201715473996-A",
  "family_id": "66767404",
  "cited_by_count": 51,
  "citations": [
    "US20080071465A1",
    "US20080042825A1",
    "US20110137895A1",
    "US20170169625A1",
    "US20160379486A1",
    "US20160357188A1",
    "US9566986B1",
    "US9940834B1"
  ]
}

Record 2,774 of 8,000 in Patents full text (MLC-0201). Request the full dataset.