Methods, systems, and apparatus for dynamic pick and place selection sequence based on sample rack imaging data

{
  "publication_number": "US11209447B2",
  "country": "US",
  "kind": "B2",
  "title": "Methods, systems, and apparatus for dynamic pick and place selection sequence based on sample rack imaging data",
  "abstract": "Methods of operating a gripper are provided. The methods include providing a robot including the gripper, the gripper moveable by the robot and including gripper fingers, providing a sample rack including receptacles accessible by the gripper, at least some of the receptacles adapted to contain specimen containers, providing data, obtained by imaging, regarding the sample rack and the specimen containers therein, and determining, based on the data, an accessible target receptacle for one of a pick operation or a place operation. Apparatus and systems configured to carry out the methods are provided, as are other aspects.",
  "claims": [
    "1. A method of operating a gripper, comprising: providing a robot including the gripper, the gripper moveable in a coordinate system by the robot and including gripper fingers; providing a sample rack including receptacles accessible by the gripper, at least some of the receptacles adapted to contain specimen containers; providing data, obtained by imaging, regarding the sample rack and the specimen containers; and determining, based on the data, an accessible target receptacle for one of a pick operation or a place operation, wherein the accessible target receptacle is a receptacle that meets a threshold minimum clearance around the receptacle and along a line of action of opening and closing the gripper fingers relative to the receptacle.",
    "2. The method of claim 1, wherein for the place operation the accessible target receptacle is empty.",
    "3. The method of claim 2, comprising placing a target specimen container in the accessible target receptacle.",
    "4. The method of claim 1, wherein for the pick operation the accessible target receptacle contains a target specimen container.",
    "5. The method of claim 4, wherein the accessible target receptacle is a receptacle which meets the threshold minimum clearance around the receptacle and along a line of action of opening and closing the gripper fingers relative to the target specimen container.",
    "6. The method of claim 5, comprising the gripper having rotational capability and more than one line of action of opening and closing the gripper fingers.",
    "7. The method of claim 6, including determining whether more than one line of action of opening and closing the gripper fingers meets the threshold minimum clearance.",
    "8. The method of claim 1, further comprising: determining if one or more of the receptacles is blocked from access such that the gripper fingers cannot be inserted without contacting one or more specimen containers surrounding the receptacles that are blocked.",
    "9. The method of claim 1, wherein the data comprises population data, which indicates the receptacles that include specimen containers.",
    "10. The method of claim 9, wherein the accessible target receptacle is determined based at least in part on population data.",
    "11. The method of claim 1, wherein the data comprises configuration data including information on a geometry or orientation of one or more specimen containers resident in the sample rack.",
    "12. The method of claim 11, wherein the configuration data comprises one or more from a group of: maximum specimen container diameter, specimen container offset distance, or tube type.",
    "13. The method of claim 12, wherein the accessible target receptacle is determined based at least in part on configuration data.",
    "14. The method of claim 1, wherein the accessible target receptacle is determined based on population data and configuration data, wherein the configuration data includes information on a geometry or orientation of one or more specimen containers resident in the sample rack.",
    "15. The method of claim 1, comprising making further dynamic selections of additional accessible target receptacles for subsequent pick or place operations based on the data.",
    "16. The method of claim 1, wherein the accessible target receptacle is determined by rank ordering at least some of the receptacles, based on both configuration data and population data, wherein the configuration data includes information on a geometry or orientation of one or more specimen containers resident in the sample rack.",
    "17. The method of claim 1, wherein the accessible target receptacle is selected to include a first empty receptacle and a second empty receptacle on opposite sides of the accessible target receptacle.",
    "18. The method of claim 1, further comprising blocked receptacles such that the gripper fingers cannot be inserted into the blocked receptacles without contacting one or more specimen containers surrounding the blocked receptacles, wherein at least one of the specimen containers surrounding at least one of the blocked receptacles is removed to unblock the blocked receptacles.",
    "19. A gripper positioning system, comprising: a robot including a gripper, the gripper moveable in a coordinate system by the robot and including gripper fingers; a sample rack including receptacles accessible by the gripper fingers, at least some of the receptacles containing specimen containers; and a controller coupled to the robot and operatively configured to: access data obtained from one or more images regarding the sample rack and the specimen containers, the data including population data and configuration data, wherein the configuration data includes information on a geometry or orientation of one or more specimen containers resident in the sample rack, and determine, based on the population data and configuration data, an accessible target receptacle for one of a pick operation or a place operation, wherein the accessible target receptacle is a receptacle which meets a threshold minimum clearance around the receptacle and along a line of action relative to the receptacle.",
    "20. A gripper positioning apparatus, comprising: a robot including a gripper, the gripper moveable in a coordinate system by the robot and including gripper fingers; and a controller coupled to the robot and operatively configured to: access data obtained from one or more images, regarding a sample rack and specimen containers contained therein, and determine, based on the data, an accessible target receptacle for one of a pick operation and a place operation, wherein the accessible target receptacle is a receptacle which meets a threshold minimum clearance around the receptacle and along a line of action relative to the receptacle."
  ],
  "description_excerpt": "The present disclosure relates generally to methods and apparatus adapted to pick and place a specimen container from and to a sample rack in systems for processing biological liquids.\n\nIn medical testing and processing, the use of robotics may minimize exposure to, or contact with, biological liquid samples (otherwise referred to herein as “specimens”) and/or may significantly increase productivity. For example, in some automated testing and processing systems (e.g., clinical analyzers), specimen containers (such as test tubes) may be transported from and to sample racks (sometimes referred to as “cassettes”) and from and to a testing or processing location of a testing or processing apparatus.\n\nSuch transportation may be accomplished by the use of an automated mechanism, such as a robot having a coupled gripper. The gripper may have opposed gripper fingers that are configured to grasp respective specimen containers during transport. The specimens may be of varying size (e.g., height and/or diameter) or type. The gripper may be moved in two or more coordinate directions by the robot. In this way, specimen containers (containing a specimen to be tested or processed) may be gripped by the gripper, and then moved from one location to another.\n\nFor example, in a pick operation, the robot gripper may be moved to above a theoretical center location of a receptacle of a sample rack and, with gripper fingers fully open, lowered to a specified height and then closed to grip the specimen container. This is followed by raising the gripper to pull the specimen container from the receptacle.",
  "cpc": [
    "G01N 35/0099",
    "B25J 15/02",
    "B25J 15/08",
    "B25J 19/023",
    "B25J 9/026",
    "B25J 9/041",
    "B25J 9/16",
    "B25J 9/1612",
    "B25J 9/1664",
    "B25J 9/1697",
    "G01N 2035/041",
    "G01N 2035/0465",
    "G01N 2035/0493",
    "G01N 35/00732",
    "G05B 19/401",
    "G05B 2219/37572"
  ],
  "ipc": [
    "B25J 15/02",
    "B25J 15/08",
    "B25J 19/02",
    "B25J 9/02",
    "B25J 9/04",
    "B25J 9/16",
    "G01N 35/00",
    "G01N 35/04",
    "G05B 19/401"
  ],
  "assignees": [
    "Siemens Healthcare Diagnostics Inc"
  ],
  "inventors": [
    "Benjamin S. Pollack",
    "Steven Pollack"
  ],
  "filing_date": "2017-06-27",
  "publication_date": "2021-12-28",
  "grant_date": "2021-12-28",
  "priority_date": "2016-07-14",
  "application_number": "US-201716316963-A",
  "family_id": "60952609",
  "cited_by_count": 2,
  "citations": [
    "US20070059209A1",
    "US8569019B2",
    "US6293750B1",
    "US6974294B2",
    "CN1672029A",
    "JP2004082239A",
    "US7364907B2",
    "US20060047363A1",
    "US20080213080A1",
    "US20100126286A1",
    "US20090003981A1",
    "US20100049358A1",
    "US8423174B2",
    "CN103068535A",
    "US20180085747A1",
    "CN105203780A",
    "US20150142171A1",
    "CN103988064A",
    "US20130065797A1",
    "US20140305227A1",
    "JP2014534447A",
    "US20130129166A1",
    "WO2013070756A2",
    "WO2013165594A1",
    "US20140036276A1",
    "US20150298321A1",
    "US20160025757A1",
    "US20160124006A1",
    "US20150290795A1",
    "US20150273468A1",
    "WO2015191702A1",
    "US20160018427A1",
    "WO2016133926A1",
    "WO2016133919A1",
    "WO2016133924A1",
    "US20170052205A1",
    "US20170343993A1",
    "US20200025782A1"
  ]
}