Systems and methods for railway asset management

{
  "publication_number": "US11731676B2",
  "country": "US",
  "kind": "B2",
  "title": "Systems and methods for railway asset management",
  "abstract": "Systems and methods for railway asset management. The methods comprise: using a virtual reality device to recognize and collect real world information about railway assets located in a railyard; and using the real world information to (i) associate a railway asset to a data collection unit, (ii) provide an individual with an augmented reality experience associated with the railyard and/or (iii) facilitate automated railyard management tasks.",
  "claims": [
    "1. A method for Augmented Reality (AR) based railyard management, comprising: obtaining real world information collected by a computing device about railway assets located in a railyard; processing the real world information to recognize a marking on at least one of the railway assets; generating holographic image data based on content of the recognized marking; providing an individual with an augmented reality experience by overlaying the holographic image data on a visible real world environment; and using the content of the recognized marking to facilitate automated railyard management tasks.",
    "2. The method according to claim 1, wherein the railway asset comprises a train consist, a railcar, a locomotive, a rail maintenance equipment, a container, or an International Standards Organization (ISO) tank.",
    "3. The method according to claim 1, wherein the automated railyard management tasks comprises at least one of validating a train consist, validating information disposed on the railway assets, detecting locations of the railway assets in the railyard, updating a map of the railyard, monitoring states of the railway assets while in the railyards, detecting damage to the railway assets in the railyards, detecting hazards of the railway assets, predicting future issues with the railway assets based on machine learned information, performing maintenance checks for components of the railway assets, scheduling maintenance for the railway assets, facilitating maintenance of railway assets using a robotic manipulator which is remotely controlled via a virtual reality environment, performing security checks for the railyard, performing security checks for the railway assets, performing compliance checks for the railway assets, and providing notifications to individuals.",
    "4. The method according to claim 1, wherein the augmented reality experience is provided to the individual by allowing a real world environment of the railyard to be visible to an individual who is wearing the computing device.",
    "5. The method according to claim 1, wherein the real world information comprises at least one of locations of the railway assets, information disposed on the railway assets, physical conditions of the railway assets, operating states of components of the railway assets, and physical conditions of the components of the railway assets.",
    "6. The method according to claim 1, further comprising performing a machine learning algorithm using the real world information to predict a future event or condition relating to at least one railway asset of the railway assets.",
    "7. The method according to claim 6, further comprising causing an action to be taken in relation to the railway asset based on the predicted future event or condition.",
    "8. The method according to claim 1, further comprising using the real world information to facilitate an inspection of the railway assets by an individual remote from the railyard.",
    "9. The method according to claim 1, further comprising using real world information to facilitate a remote control of a robotic manipulator located in the railyard.",
    "10. A system, comprising: a processor; a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for Augmented Reality (AR) based railyard management, wherein the programming instructions comprise instructions to: obtain world information about railway assets located in a railyard; process the real world information to recognize a marking on at least one of the railway assets; generate holographic image data based on content of the recognized marking; provide an individual with an augmented reality experience by overlaying the holographic image data on a visible real world environment; and use the content of the recognized marking to facilitate automated railyard management tasks.",
    "11. The system according to claim 10, wherein the railway asset comprises a train consist, a railcar, a locomotive, a rail maintenance equipment, a container, or an International Standards Organization (ISO) tank.",
    "12. The system according to claim 10, wherein the automated railyard management tasks comprises at least one of validating a train consist, validating information disposed on the railway assets, detecting locations of the railway assets in the railyard, updating a map of the railyard, monitoring states of the railway assets while in the railyards, detecting damage to the railway assets in the railyards, detecting hazards of the railway assets, predicting future issues with the railway assets based on machine learned information, performing maintenance checks for components of the railway assets, scheduling maintenance for the railway assets, facilitating maintenance of railway assets using a robotic manipulator which is remotely controlled via a virtual reality environment, performing security checks for the railyard, performing security checks for the railway assets, performing compliance checks for the railway assets, and providing notifications to individuals.",
    "13. The system according to claim 10, wherein the augmented reality experience is provided to the individual by allowing a real world environment of the railyard to be visible to an individual who is wearing the computing device.",
    "14. The method according to claim 10, wherein the real world information comprises at least one of locations of the railway assets, information disposed on the railway assets, physical conditions of the railway assets, operating states of components of the railway assets, and physical conditions of the components of the railway assets.",
    "15. The system according to claim 10, wherein the programming instructions further comprise instructions to perform a machine learning algorithm using the real world information to predict a future event or condition relating to at least one railway asset of the railway assets.",
    "16. The system according to claim 15, wherein the programming instructions further comprise instructions to cause an action to be taken in relation to the railway asset based on the predicted future event or condition.",
    "17. The system according to claim 10, wherein the programming instructions further comprise instructions to use the real world information to facilitate an inspection of the railway assets by an individual remote from the railyard.",
    "18. The system according to claim 10, wherein the programming instructions further comprise instructions to use real world information to facilitate a remote control of a robotic manipulator located in the railyard."
  ],
  "description_excerpt": "The present document generally relates to railway asset management systems. More particularly, the present solution relates to implementing systems and methods for (i) associating a railway asset to a data collection unit and/or (ii) Augmented Reality (AR) based railyard management.\n\nIn railcar transport systems, railcars are used to carry loose bulk commodities, liquid commodities and/or other types of goods by rail. Such goods may be loaded and unloaded at railyards. The locations of the railcars may change during different phases of a railyard management process. The phases include an inbound phase, a load/unload phase, and an outbound phase. A railyard map and scheduling system are used to coordinate movements of the railcars through the multiple tracks/paths of the railyard. The railyard map shows the locations of the railcars in the railyard, and any changes in the same as the railcars move through the railyard. The railyard map is updated manually using information obtained by individuals who are present in the railyard and who inspect the railcars. This manual process is time consuming, error prone and dangerous to personnel carrying out the various inspection processes.\n\nAdditionally, various data collection units are typically coupled to railcars. The data collection units are communicatively coupled to each other via the Internet, and therefore are collectively referred to as an Internet of Things (IoT).",
  "cpc": [
    "B61L 27/57",
    "B25J 9/1674",
    "B25J 9/1689",
    "B61L 17/00",
    "B61L 2205/04",
    "B61L 25/025",
    "B61L 25/04",
    "B61L 27/40",
    "B61L 27/70",
    "G02B 2027/0174",
    "G02B 27/017",
    "G02B 27/0172",
    "G06N 20/00",
    "G06T 15/205",
    "G06T 19/006",
    "G06T 19/20",
    "G06T 2207/20084",
    "G06T 2215/16",
    "G06T 7/0004",
    "G06V 10/75",
    "G06V 20/20",
    "G06V 20/54",
    "G07C 5/008",
    "G07C 5/0808"
  ],
  "ipc": [
    "B25J 9/16",
    "B61L 27/40",
    "B61L 27/57",
    "B61L 27/70",
    "G02B 27/01",
    "G06N 20/00",
    "G06T 15/20",
    "G06T 19/00",
    "G06T 19/20",
    "G06V 20/20",
    "G07C 5/00",
    "G07C 5/08"
  ],
  "assignees": [
    "Amsted Rail Co Inc"
  ],
  "inventors": [
    "Evan WEINER",
    "Brad A. Myers"
  ],
  "filing_date": "2022-06-10",
  "publication_date": "2023-08-22",
  "grant_date": "2023-08-22",
  "priority_date": "2020-07-07",
  "application_number": "US-202217837677-A",
  "family_id": "79172198",
  "cited_by_count": 1,
  "citations": [
    "EP1655695A2",
    "US7705743B2",
    "US10352779B2",
    "US9739763B2",
    "US20220025826A1",
    "US9805529B2",
    "US9996551B2",
    "US9841494B2",
    "US9842496B1",
    "US9710720B2",
    "US20170066459A1",
    "US9694834B2",
    "US9711046B2",
    "US20180127006A1",
    "US20180339719A1",
    "US11115732B2",
    "US20190054937A1",
    "US20190057548A1",
    "US20190156569A1",
    "US20220041194A1",
    "US20190236365A1",
    "US20200198675A1",
    "WO2020038706A1",
    "WO2020191398A1",
    "US20220009535A1",
    "US20220036323A1",
    "US20220044183A1"
  ]
}