Article processing apparatus, system and method therefor

{
  "publication_number": "US2025054174A1",
  "country": "US",
  "kind": "A1",
  "title": "Article processing apparatus, system and method therefor",
  "abstract": "An imaging processing device can receive an image of a region of interest comprising a first article in response to the article being placed on a belt wherein the belt is configured to convey the article along a path between an origin and a destination; b. determine a plurality of coordinates in three-dimensional space associated with the region of interest; c. determine from the plurality of coordinates: i. whether a tub has been placed on the belt; ii. that the first article is conveyable along the path in response to a determination that a tub has been placed on the belt; and/or d. determine from the plurality of coordinates.",
  "claims": [
    "1. An imaging processing device comprising: processing means, wherein the processing means is configured to: a. receive an image of a region of interest comprising a first article in response to the article being placed on a belt wherein the belt is configured to convey the article along a path between an origin and a destination; b. determine a plurality of coordinates in three-dimensional space associated with the region of interest; c. determine from the plurality of coordinates: i. whether a tub has been placed on the belt; ii. that the first article is conveyable along the path in response to a determination that a tub has been placed on the belt; and/or d. determine from the plurality of coordinates: i. whether the first article has an irregular shape; and/or ii. whether a second article has been placed on the belt; iii. that the first article is not conveyable along the path in response to a determination that the first article has an irregular shape or that a second article has been placed on the belt. 2. The image processing device of claim 1 wherein the image comprises depth data associated with the image. 3. The image processing device of claim 2 wherein the image further comprises infrared data associated with the image. 4. The image processing device of claim 3 wherein the processing means is further configured to determine, from the depth data associated with the image, the infrared data associated with the image and the plurality of coordinates, whether the first article has a substantially round shape. 5. The image processing device of claim 4 wherein the processing means is further configured to determine that the first article is not conveyable along the path in response to a determination that the first article has a substantially round shape. 6. The image processing device of claim 3 wherein the processing means is further configured to determine, from the depth data associated with the image and the infrared data associated with the image, whether the first article has an irregular shape. 7. The image processing device of claim 3 wherein the image further comprises data representing colours of the image. 8. The image processing device of claim 7 wherein the processing means is further configured to determine, from the data representing colours of the image, the depth data associated with the image and the infrared data associated with the image, whether a second article has been placed on the belt. 9. The image processing device of claim 5 wherein the processing means is further configured to determine that the article is conveyable along the path in response to a determination that the first article does not have a substantially round shape, an irregular shape and that a second article has not been placed on the belt. 10. The image processing device of claim 3 wherein the processing means is further configured to receive an image of an empty belt and determine, from the depth data associated with the image and the infrared data associated with the image, that the belt is empty. 11. The image processing device of claim 7 wherein the processing means is further configured to generate an image of the first article by combining the depth data associated with the image, the infrared data associated with the image, the data representing colours of the image and the plurality of coordinates. 12. The image processing device of claim 1 wherein the processing means is further configured to segment a first portion of the image representing the first article from a second portion of the image. 13. The image processing device of claim 1 wherein the processing means is configured to determine whether a tub has been placed on the belt by determining from the plurality of coordinates whether a height of the first article comprises an edge corresponding to a shape of a known tub. 14. The image processing device of claim 1 wherein the processing means is configured to determine whether a second article has been placed on the belt by determining from the plurality of coordinates whether a section of the image represents a height profile that is different from that of the first article. 15. The image processing device of claim 8 wherein the processing means is configured to determine whether a second article has been placed on the belt by determining whether a shape of the first article in the image comprises extensions which are likely to represent a second article. 16. The image processing device of claim 1 wherein the processing means is configured to determine whether the first article has an irregular shape by determining from the plurality of coordinates whether a height profile of the first article corresponds to that of an irregular shape. 17. The image processing device of claim 4 wherein the processing means is configured to determine whether the first article has a substantially round shape by determining whether a plurality of normals associated with the plurality of coordinates correspond to a same point. 18. The image processing device of claim 4 wherein the processing means is further configured to determine if the first article has a stable base. 19. The image processing device of claim 18 wherein the processing means is further configured to withdraw a conclusion that the first article has a substantially round shape in response to determining that the first article has a stable base. 20. The image processing device of claim 9 wherein the processing means is further configured to determine a length, width and height of the first article upon determining that the first article is conveyable along the path. 21. The image processing device of claim 20 wherein the processing means is configured to determine the height of the first article using the depth data associated with the image by determining a difference between a depth of the first article and a depth of the belt. 22. The image processing device of claim 20 wherein the processing means is configured to determine the width and length of the first article by fitting a rectangle such that it bounds a portion of the image representing the first article and determining a length and width of the rectangle. 23. The image processing device of claim 1 wherein the processing means is further configured to determine, from the plurality of coordinates, whether the whole of the first article is not within a region of interest on the belt, the processing means being configured to process articles only within this region of interest. 24. The image processing device of claim 1 wherein the processing means is further configured to determine, from the plurality of coordinates, whether a dimension of the first article is below a minimum threshold. 25. The image processing device of claim 1 wherein the processing means is further configured to determine, from the plurality of coordinates, whether the first article comprises straps. 26. The image processing device of claim 1 wherein the processing means is further configured to determine that the first article is not conveyable along the path in response to a determination that a dimension of the first article is below a minimum threshold, or that the first article comprises straps, or that the whole of the first article is not within a region of interest. 27. The image processing device of claim 23 wherein the processing means is further configured to determine that the first article should be repositioned on the belt in response to a determination that the whole of the first article is not within the region of interest. 28. The processing device of claim 24 wherein the processing means is further configured to determine that there is not an article on the belt in response to a determination that the dimension of the first article is below the minimum threshold. 29. The processing device of claim 24 wherein the processing means is further configured to determine a plurality of dimensions of the first article if it is not determined that the first article is not conveyable along the path. 30. The processing device of claim 1 wherein the processing means is further configured to filter the plurality of coordinates. 31. The processing device of claim 30 wherein the processing means is configured to filter the plurality of coordinates by reducing the density of the data associated with the plurality of coordinates. 32. The processing device of claim 30 wherein the processing means is configured to filter the plurality of coordinates by adjusting the plurality of coordinates such that they are centred on the belt. 33. The processing device of claim 30 wherein the processing means is configured to filter the plurality of coordinates by removing any coordinates outside of a region of interest. 34. The processing device of claim 30 wherein the processing means is configured to filter the plurality of coordinates by subtracting a plurality of coordinates corresponding to an empty belt from the plurality of coordinates associated with the region of interest. 35. The processing device of claim 24 wherein the processing means is configured to determine whether a dimension of the first article is below the minimum threshold and whether a second article has been placed on the belt by forming clusters in the plurality of coordinates. 36. The processing device of claim 35 wherein the processing means is configured to determine whether a second article has been placed on the belt and whether a dimension of the first article is below the minimum threshold by grouping the clusters. 37. The processing device of claim 1 wherein the processing means is configured to determine whether the first article is of an irregular shape by clustering the plurality of coordinates and identifying coordinates which cannot be linked to a cluster. 38. The processing device of any preceding claim wherein the device is configured to generate a signal configured to trigger a belt or conveyor of an article handling system in response to a determination that the first article is conveyable along the path. 39. The processing device of any preceding claim wherein the device is configured to generate an alert signal for an agent indicating that of an article handling system in response to a determination that the first article is not conveyable along the path. 40. An article handling system comprising: a camera (2); a belt or conveyor for conveying an article; wherein the camera has a field of view directed towards the belt or conveyor; and further comprising the processing device of any one of claims 1 to 37. 41. The article handling system of claim 40 wherein the camera is configured to output data associated with an image captured by the camera. 42. The article handling system of claim 41 wherein the data comprises depth data associated with the image and/or infrared data associated with the image and/or data representing colours of the image. 43. The article handling system of claim 40 further comprising a sensor configured to detect articles which exceed a predetermined size threshold. 44. The article handling system of claim 43 wherein the sensor is an infrared intrusion sensor. 45. A method of determining whether an article is conveyable along a path, the method comprising: a. receiving an image of a region of interest comprising a first article in response to the article being placed on a belt wherein the belt is configured to convey the article along a path between an origin and a destination; b. determining a plurality of coordinates in three-dimensional space associated with the region of interest; c. determining from the plurality of coordinates: i. whether a tub has been placed on the belt; ii. that the first article is conveyable along the path in response to a determination that a tub has been placed on the belt; and/or d. determining from the plurality of coordinates: i. whether the first article has an irregular shape; and/or ii. whether a second article has been placed on the belt; that the first article is not conveyable along the path in response to a determination that the first article has an irregular shape or that a second article has been placed on the belt. 46. A computer program product which when executed undertakes the method of claim 45."
  ],
  "description_excerpt": "This invention relates to a system for processing articles. In particular, but not exclusively, this invention relates to a system, apparatus, and method for processing articles such as an item of baggage or an item such as a parcel which may be processed at airports, seaports, railways, and other mass transport locations with an item handling system. The system or apparatus may be retrofitted to an existing system or apparatus which is already installed at a particular location.\n\nAt transportation hubs, such as airports, items of luggage that are to be checked in need to processed in a number of ways at the point of drop off. For example, said items of luggage will often have attached a bag tag, the bag tag holding information about the baggage journey in the form of radio-frequency identification (RFID) tags and/or visual barcodes. Said baggage journey may be linked to a passenger name record/passenger journey, but not exclusively. Such tags need to be read at the point of drop off to retrieve this information. Furthermore, after having been dropped off, the item of luggage will often be conveyed along a path from the point of drop off to a destination where it will be sorted for loading onto a mode of transport, such as an aircraft. The item will often be conveyed by way of a conveyor belt and it is, therefore, important to assess whether the item is suitable to be conveyed in such a way. For example, items of luggage that are too round in shape may roll of the belt as they are being conveyed. Items that are irregular in shape may damage or get stuck on the belt.",
  "cpc": [
    "G06K 7/10861",
    "B64F 1/368",
    "B65G 43/00",
    "G01B 11/24",
    "G06K 17/0022",
    "G06K 7/10128",
    "G06K 7/10356",
    "G06K 7/10445",
    "G06K 7/10722",
    "G06K 7/1413",
    "G06Q 10/08",
    "G06Q 50/40",
    "G06T 2207/10028",
    "G06T 2207/10048",
    "G06T 2207/30112",
    "G06T 7/62",
    "G06T 7/64"
  ],
  "ipc": [
    "B65G 43/00",
    "G06T 7/62",
    "G06T 7/64"
  ],
  "assignees": [
    "SITA B V"
  ],
  "inventors": [
    "VAN RIJNBERK JEROEN",
    "HONORE PAS REINIER",
    "DE GROOT SEBASTIAN",
    "VAN KLAARBERGEN SWEN",
    "ALBERTUS VAN DER TUUK WILLEM",
    "LIEFHEBBER FREEK"
  ],
  "filing_date": "2024-10-25",
  "publication_date": "2025-02-13",
  "priority_date": "2022-04-29",
  "application_number": "US-202418927078-A",
  "family_id": "86329134"
}