Patent · US10187593B2 · B2 · US

Verification system for a pharmacy packaging system

(11) Publication number

US10187593B2

(21) Application number

15/277,493

(22) Filing date

2016-09-27

(30) Priority date

2016-09-27

(43) Publication date

2019-01-22

(45) Date of grant

2019-01-22

(51) IPC

A61J 1/03; B65B 1/04; B65B 41/12; G06V 10/143; G06V 20/00; H04N 23/11

(52) CPC

G06V Image or video recognition or understanding: 20/00, 10/143
A61J Containers specially adapted for medical or pharmaceutical purposes; devices or methods specially adapted for bringing pharmaceutical products into particular physical or administering forms; devices for administering food or medicines orally; baby comforters; devices for receiving spittle: 1/03, 2205/00
B65B Machines, apparatus or devices for, or methods of, packaging articles or materials; unpacking: 1/04, 41/12
G06K Graphical data reading; presentation of data; record carriers; handling record carriers: 9/00624, 9/2018
H04N Pictorial communication, e.g. television: 23/11, 23/56, 23/80, 5/2256, 5/23229, 5/332

(73) Assignee

RxSafe LLC

(72) Inventors

William K. Holmes

(54) Title

Verification system for a pharmacy packaging system

(57) Abstract

A pharmacy packaging system configured to dispense pharmaceuticals into a pharmaceutical pouch formed by a feed roll and including a verification system. The verification system includes a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, a second light source configured to output a visible spectrum light, and a processor. The processor is operable to activate the first light source to illuminate the pharmaceutical pouch and capture a first image of the pharmaceutical pouch while illuminated by the first light source. The processor is also operable to activate the second light source to illuminate the pharmaceutical pouch and capture a second image of the pharmaceutical pouch while illuminated by the second light source. The processor is further operable to generate a third image based on the first image and the second image.

Full text

View on Google Patents

Claims (19)

A pharmacy packaging system comprising: a feed roll for forming a pharmaceutical pouch; a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll; and a verification system including a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output infrared spectrum light, a second light source configured to output visible spectrum light, and a processor communicatively coupled to the camera system, the first light source, and the second light source, the processor operable to: activate the first light source to illuminate the pharmaceutical pouch, capture a first image, using the camera system, of the pharmaceutical pouch while illuminated by the first light source, activate the second light source to illuminate the pharmaceutical pouch, capture a second image, using the camera system, of the pharmaceutical pouch while illuminated by the second light source, and generate a third image based on the first image and the second image, generate a dashboard to simultaneously display first images, second images, third images, and label images from a plurality of pharmaceutical pouches, wherein the first images, the second images, the third images, and the label images are arrayed in a grid on the dashboard, wherein the label images are images of the labels of the plurality of pharmaceutical pouches.
The pharmacy packaging system of claim 1, wherein the processor is further operable to: analyze the third image to determine a first characteristic of pharmaceuticals in the pharmaceutical pouch, determine whether the first characteristic of pharmaceuticals in the pharmaceutical pouch matches a second characteristic of expected pharmaceuticals, when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, provide a first indication on the third image that the pharmaceutical pouch is correctly filled, and when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, provide a second indication on the third image that the pharmaceutical pouch is incorrectly filled.
The pharmacy packaging system of claim 2, wherein the first indication includes a border around the third image having a first color, and wherein the second indication includes a border around the third image having a second color that is different than the first color.
The pharmacy packaging system of claim 2, wherein the first indication includes a border having a first color around an individual pharmaceutical in the third image, and wherein the second indication includes a border having a second color that is different than the first color around one of a blank space or an individual pharmaceutical in the third image.
The pharmacy packaging system of claim 2, wherein the first characteristic of pharmaceuticals is an amount of pharmaceuticals in the pharmaceutical pouch.
The pharmacy packaging system of claim 2, wherein the first characteristic of pharmaceuticals is a type of pharmaceuticals in the pharmaceutical pouch.
The pharmacy packaging system of claim 1, further comprising a thermal printer operable to print label information on the pharmaceutical pouch.
The pharmacy packaging system of claim 7, further comprising a label camera, wherein the processor is operable to capture a fourth image, using the label camera, of the label information printed on the pharmaceutical pouch.
The pharmacy packaging system of claim 1, wherein the feed roll is a first feed roll having a translucent material to form a first half of the pharmaceutical pouch, and further comprising a second feed roll having a transparent material to form a second half of the pharmaceutical pouch.
The pharmacy packaging system of claim 9, wherein the first light source is positioned on a side of the pharmaceutical pouch facing the translucent material, and wherein the camera system is positioned on a side of the pharmaceutical pouch facing the transparent material.
The pharmacy packaging system of claim 10, wherein the second light source is positioned on the side of the pharmaceutical pouch facing the transparent material.
The pharmacy packaging system of claim 1, wherein the dashboard further includes images of expected pills.
The pharmacy packaging system of claim 1, wherein the processor is operable to transmit the third image to a computing device of a remote pharmacist.
The pharmacy packaging system of claim 1, further comprising an agitator operable to agitate the pharmaceutical pouch prior to capturing the first image.
The pharmacy packaging system of claim 1, wherein the camera system includes a single camera to capture the first image and the second image.
The pharmacy packaging system of claim 12, wherein the third image includes individual pharmaceuticals arranged in rows or columns, and wherein the third image is displayed such that the individual pharmaceuticals in the third image align with individual pharmaceuticals in the images of expected pills.
The pharmacy packaging system of claim 16, wherein the third image includes a blank space that indicates where a correct pill should have been displayed.
The pharmacy packaging system of claim 17, wherein the third image includes a border around the blank space having a color to indicate that the expected pill is missing from the pharmaceutical pouch.
A method of verifying pharmaceuticals packaged within a pharmaceutical pouch using a pharmacy packaging system, the pharmacy packaging system including a feed roll for forming the pharmaceutical pouch, a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll, a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, a second light source configured to output a visible spectrum light, and a processor communicatively coupled to the camera system, the first light source, and the second light source, the method comprising: activating, by the processor, the first light source to illuminate the pharmaceutical pouch; capturing a first image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the first light source; activating, by the processor, the second light source to illuminate the pharmaceutical pouch; capturing a second image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the second light source; generating, by the processor, a third image based on the first image and the second image; generating, by the processor, a dashboard to simultaneously display first images, second images, third images, and label images from a plurality of pharmaceutical pouches, wherein the first images, the second images, the third images, and the label images are arrayed in a grid on the dashboard, wherein the label images are images of the labels of the plurality of pharmaceutical pouches; and displaying the dashboard.

Description

The present invention relates to pharmacy packaging systems and, more particularly, to verification systems for pharmacy packaging systems.

One embodiment provides a pharmacy packaging system including a feed roll for forming a pharmaceutical pouch, a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll, and a verification system. The verification system includes a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, and a second light source configured to output a visible spectrum light. The verification system also includes a processor communicatively coupled to the camera system, the first light source, and the second light source. The processor is operable to activate the first light source to illuminate the pharmaceutical pouch and capture a first image, using the camera system, of the pharmaceutical pouch while illuminated by the first light source. The processor is also operable to activate the second light source to illuminate the pharmaceutical pouch and capture a second image, using the camera system, of the pharmaceutical pouch while illuminated by the second light source. The processor is further operable to generate a third image based on the first image and the second image

Another embodiment provides a method of verifying pharmaceuticals packaged within a pharmaceutical pouch using a pharmacy packaging system.

Citations (21)

US6535637B1
WO1999017218A1
US20080056556A1
US9334096B2
US8467897B2
US20110184751A1
US8271128B1
US20100071320A1
US20120200596A1
EP2591761A1
US20130058550A1
US20130342676A1
US20130188038A1
US20130142406A1
WO2013181416A1
US20130318931A1
US20140094960A1
WO2014119994A1
US20140236349A1
WO2016047569A1
US20170305589A1

Record as JSON

{
  "publication_number": "US10187593B2",
  "country": "US",
  "kind": "B2",
  "title": "Verification system for a pharmacy packaging system",
  "abstract": "A pharmacy packaging system configured to dispense pharmaceuticals into a pharmaceutical pouch formed by a feed roll and including a verification system. The verification system includes a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, a second light source configured to output a visible spectrum light, and a processor. The processor is operable to activate the first light source to illuminate the pharmaceutical pouch and capture a first image of the pharmaceutical pouch while illuminated by the first light source. The processor is also operable to activate the second light source to illuminate the pharmaceutical pouch and capture a second image of the pharmaceutical pouch while illuminated by the second light source. The processor is further operable to generate a third image based on the first image and the second image.",
  "claims": [
    "1. A pharmacy packaging system comprising: a feed roll for forming a pharmaceutical pouch; a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll; and a verification system including a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output infrared spectrum light, a second light source configured to output visible spectrum light, and a processor communicatively coupled to the camera system, the first light source, and the second light source, the processor operable to: activate the first light source to illuminate the pharmaceutical pouch, capture a first image, using the camera system, of the pharmaceutical pouch while illuminated by the first light source, activate the second light source to illuminate the pharmaceutical pouch, capture a second image, using the camera system, of the pharmaceutical pouch while illuminated by the second light source, and generate a third image based on the first image and the second image, generate a dashboard to simultaneously display first images, second images, third images, and label images from a plurality of pharmaceutical pouches, wherein the first images, the second images, the third images, and the label images are arrayed in a grid on the dashboard, wherein the label images are images of the labels of the plurality of pharmaceutical pouches.",
    "2. The pharmacy packaging system of claim 1, wherein the processor is further operable to: analyze the third image to determine a first characteristic of pharmaceuticals in the pharmaceutical pouch, determine whether the first characteristic of pharmaceuticals in the pharmaceutical pouch matches a second characteristic of expected pharmaceuticals, when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, provide a first indication on the third image that the pharmaceutical pouch is correctly filled, and when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, provide a second indication on the third image that the pharmaceutical pouch is incorrectly filled.",
    "3. The pharmacy packaging system of claim 2, wherein the first indication includes a border around the third image having a first color, and wherein the second indication includes a border around the third image having a second color that is different than the first color.",
    "4. The pharmacy packaging system of claim 2, wherein the first indication includes a border having a first color around an individual pharmaceutical in the third image, and wherein the second indication includes a border having a second color that is different than the first color around one of a blank space or an individual pharmaceutical in the third image.",
    "5. The pharmacy packaging system of claim 2, wherein the first characteristic of pharmaceuticals is an amount of pharmaceuticals in the pharmaceutical pouch.",
    "6. The pharmacy packaging system of claim 2, wherein the first characteristic of pharmaceuticals is a type of pharmaceuticals in the pharmaceutical pouch.",
    "7. The pharmacy packaging system of claim 1, further comprising a thermal printer operable to print label information on the pharmaceutical pouch.",
    "8. The pharmacy packaging system of claim 7, further comprising a label camera, wherein the processor is operable to capture a fourth image, using the label camera, of the label information printed on the pharmaceutical pouch.",
    "9. The pharmacy packaging system of claim 1, wherein the feed roll is a first feed roll having a translucent material to form a first half of the pharmaceutical pouch, and further comprising a second feed roll having a transparent material to form a second half of the pharmaceutical pouch.",
    "10. The pharmacy packaging system of claim 9, wherein the first light source is positioned on a side of the pharmaceutical pouch facing the translucent material, and wherein the camera system is positioned on a side of the pharmaceutical pouch facing the transparent material.",
    "11. The pharmacy packaging system of claim 10, wherein the second light source is positioned on the side of the pharmaceutical pouch facing the transparent material.",
    "12. The pharmacy packaging system of claim 1, wherein the dashboard further includes images of expected pills.",
    "13. The pharmacy packaging system of claim 1, wherein the processor is operable to transmit the third image to a computing device of a remote pharmacist.",
    "14. The pharmacy packaging system of claim 1, further comprising an agitator operable to agitate the pharmaceutical pouch prior to capturing the first image.",
    "15. The pharmacy packaging system of claim 1, wherein the camera system includes a single camera to capture the first image and the second image.",
    "16. The pharmacy packaging system of claim 12, wherein the third image includes individual pharmaceuticals arranged in rows or columns, and wherein the third image is displayed such that the individual pharmaceuticals in the third image align with individual pharmaceuticals in the images of expected pills.",
    "17. The pharmacy packaging system of claim 16, wherein the third image includes a blank space that indicates where a correct pill should have been displayed.",
    "18. The pharmacy packaging system of claim 17, wherein the third image includes a border around the blank space having a color to indicate that the expected pill is missing from the pharmaceutical pouch.",
    "19. A method of verifying pharmaceuticals packaged within a pharmaceutical pouch using a pharmacy packaging system, the pharmacy packaging system including a feed roll for forming the pharmaceutical pouch, a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll, a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, a second light source configured to output a visible spectrum light, and a processor communicatively coupled to the camera system, the first light source, and the second light source, the method comprising: activating, by the processor, the first light source to illuminate the pharmaceutical pouch; capturing a first image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the first light source; activating, by the processor, the second light source to illuminate the pharmaceutical pouch; capturing a second image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the second light source; generating, by the processor, a third image based on the first image and the second image; generating, by the processor, a dashboard to simultaneously display first images, second images, third images, and label images from a plurality of pharmaceutical pouches, wherein the first images, the second images, the third images, and the label images are arrayed in a grid on the dashboard, wherein the label images are images of the labels of the plurality of pharmaceutical pouches; and displaying the dashboard."
  ],
  "description_excerpt": "The present invention relates to pharmacy packaging systems and, more particularly, to verification systems for pharmacy packaging systems.\n\nOne embodiment provides a pharmacy packaging system including a feed roll for forming a pharmaceutical pouch, a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll, and a verification system. The verification system includes a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, and a second light source configured to output a visible spectrum light. The verification system also includes a processor communicatively coupled to the camera system, the first light source, and the second light source. The processor is operable to activate the first light source to illuminate the pharmaceutical pouch and capture a first image, using the camera system, of the pharmaceutical pouch while illuminated by the first light source. The processor is also operable to activate the second light source to illuminate the pharmaceutical pouch and capture a second image, using the camera system, of the pharmaceutical pouch while illuminated by the second light source. The processor is further operable to generate a third image based on the first image and the second image\n\nAnother embodiment provides a method of verifying pharmaceuticals packaged within a pharmaceutical pouch using a pharmacy packaging system.",
  "cpc": [
    "G06V 20/00",
    "A61J 1/03",
    "A61J 2205/00",
    "B65B 1/04",
    "B65B 41/12",
    "G06K 9/00624",
    "G06K 9/2018",
    "G06V 10/143",
    "H04N 23/11",
    "H04N 23/56",
    "H04N 23/80",
    "H04N 5/2256",
    "H04N 5/23229",
    "H04N 5/332"
  ],
  "ipc": [
    "A61J 1/03",
    "B65B 1/04",
    "B65B 41/12",
    "G06V 10/143",
    "G06V 20/00",
    "H04N 23/11"
  ],
  "assignees": [
    "RxSafe LLC"
  ],
  "inventors": [
    "William K. Holmes"
  ],
  "filing_date": "2016-09-27",
  "publication_date": "2019-01-22",
  "grant_date": "2019-01-22",
  "priority_date": "2016-09-27",
  "application_number": "US-201615277493-A",
  "family_id": "59974121",
  "cited_by_count": 33,
  "citations": [
    "US6535637B1",
    "WO1999017218A1",
    "US20080056556A1",
    "US9334096B2",
    "US8467897B2",
    "US20110184751A1",
    "US8271128B1",
    "US20100071320A1",
    "US20120200596A1",
    "EP2591761A1",
    "US20130058550A1",
    "US20130342676A1",
    "US20130188038A1",
    "US20130142406A1",
    "WO2013181416A1",
    "US20130318931A1",
    "US20140094960A1",
    "WO2014119994A1",
    "US20140236349A1",
    "WO2016047569A1",
    "US20170305589A1"
  ]
}

Record 3,064 of 8,000 in Patents full text (MLC-0201). Request the full dataset.