Fiducial-based correlative microscopy

{
  "publication_number": "US9368321B1",
  "country": "US",
  "kind": "B1",
  "title": "Fiducial-based correlative microscopy",
  "abstract": "A method is provided for preparing a sample for correlative optical and electron imaging and correcting aberrations in the imaging process due to sample deformation. Dye-coated fiducial markers are distributed throughout the sample volume. The fiducial markers are preferably in the form of polystyrene nanospheres that are functionalized on their surface and subsequently treated with a fluorescent dye. The dye does not penetrate the sphere but only binds to the surface. By limiting the dye to the surface of the nanospheres, the shape of the spheres can be determined in iPALM and in charged particle images aiding in tracking of physical changes that may occur to the sample volume.",
  "claims": [
    "1. A method for three-dimensional correlation of locations of regions of interest in a sample volume utilizing images acquired optically and with a charged particle beam system, comprising: providing a sample volume supported on a substrate, the sample volume containing regions of interest and including fiducials distributed throughout the sample volume identifiable in both optical and charged particle images of the sample volume; introducing the sample volume into an optical system; imaging the sample volume using the optical system; identifying the three-dimensional location of the fiducials distributed throughout the sample volume using one or more optical images; introducing the sample volume into a charged particle beam system; imaging the sample volume using a charged particle beam; identifying the three-dimensional location of the fiducials distributed throughout the sample volume using one or more charged particle images; and correlating locations of regions of interest in the sample volume using the location of the fiducials in the optical and charged particle beam images.",
    "2. The method of claim 1, wherein the fiducials distributed throughout the sample volume includes fluorescent markers.",
    "3. The method of claim 2, wherein the fluorescent markers are distributed throughout the sample volume in a concentration that is sufficiently low to enable imaging of each fluorescent marker individually without substantial interference from nearby fluorescent markers.",
    "4. The method of claim 1, further comprising a planar layer of fiducials in an X-Y plane at the interface of the sample volume and the substrate, said fiducials being distinguishable from those distributed throughout the sample volume.",
    "5. The method of claim 1, wherein imaging the sample volume using an optical system comprises three-dimensional super-resolution imaging.",
    "6. The method of claim 5, wherein super-resolution imaging comprises photo-activated localization microscopy.",
    "7. The method of claim 1, wherein three-dimensional location of objects are obtained using the charged particle beam system by sequential imaging and material removal cycles.",
    "8. The method of claim 7, wherein imaging comprises obtaining scanning electron microscope images and material removal comprises milling with a focused ion beam.",
    "9. The method of claim 1, wherein the fiducials comprise fluorescent nanoparticles.",
    "10. The method of claim 9, wherein the nanoparticles are dye-functionalized spheres.",
    "11. The method of claim 10, wherein the dye-functionalized spheres contain dye that is present on the surface of the sphere and does not penetrate the interior of the sphere.",
    "12. The method of claim 11 wherein the dye is a photoactivatable dye or protein.",
    "13. The method of claim 9, wherein the nanoparticles are quantum dots.",
    "14. A method for correction of spatial changes in a sample volume comprising: providing a sample volume with fiducials dispersed throughout the sample volume; imaging the sample volume using an optical system; determining the three-dimensional location of the fiducials distributed throughout the sample volume using the optical image or images collected; introducing the sample into a charged particle beam system; imaging the sample using a charged particle beam; determining the three-dimensional location of the fiducials distributed throughout the sample volume using the charged particle beam image or images collected; comparing the location of the fiducials in the optical image or images with the location of the fiducials in the charged particle beam image or images; calculating the difference in location of fiducials between the optical image or images and charged particle image or images, and; applying a correction to the optical image or images or the charged particle image or images to account for spatial changes to the sample volume.",
    "15. The method of claim 14, further comprising overlaying the optical image or images with the charged particle image or images after a correction has been applied.",
    "16. The method of claim 14, wherein optical imaging comprises three-dimensional super-resolution imaging.",
    "17. The method of claim 16, in which charged particle imaging comprises a series of images by sequential imaging and material removal cycles, the series of sequential images being able to be processed into a three-dimensional representation of the sample volume.",
    "18. The method of claim 14, wherein the difference in location of fiducials is determined by comparing the relative distance between fiducials in the optical and charged particle image or images.",
    "19. The method of claim 14, wherein any change in shape of the fiducials between optical imaging and charged particle imaging is calculated and used to apply a correction to the optical image or images or charged particle image or images."
  ],
  "description_excerpt": "The present invention relates to correlative microscopy and in particular to correlative light and electron microscopy imaging.\n\nMicroscopic images of cellular structure in biological samples can reveal important information regarding biological processes and cellular architecture. A correlative approach, which uses both optical microscopy and electron microscopy, produces the most comprehensive results. For example, light microscopy information can be used to identify areas of biological importance and their dynamics within a sample. Then electron microscopy can be used to resolve structural details within those areas after fixation and/or staining.\n\nImages collected with a conventional optical microscope are limited in resolution to about half of the wavelength of the light used. For practical optical microscopy this limit is around 200 nm. Because of this limitation, conventional optical microscopes are said to be diffraction limited. Many techniques exist for improving resolution beyond the diffraction limit. Such techniques are called super-resolution techniques. One particular technique is stochastic optical reconstruction microscopy (STORM). Another technique is photo-activated localization microscopy (PALM). These techniques are used to form an image of a sample using fluorescent markers which can be switched between an “on” state, in which the marker fluoresces, and an “off” state, in which the marker does not fluoresce. STORM typically uses fluorescent organic dyes whereas PALM typically uses fluorescent proteins.",
  "cpc": [
    "H01J 37/222",
    "G01N 2021/6439",
    "G01N 21/6428",
    "G01N 21/6456",
    "G01N 21/6458",
    "G01N 21/6486",
    "G01N 23/223",
    "G02B 21/0032",
    "G02B 21/0076",
    "G02B 21/008",
    "G02B 21/16",
    "G02B 21/365",
    "H01J 2237/221",
    "H01J 2237/24578",
    "H01J 2237/26",
    "H01J 2237/2611",
    "H01J 37/26"
  ],
  "ipc": [
    "G01N 21/64",
    "H01J 37/22",
    "H01J 37/26"
  ],
  "assignees": [
    "FEI Co"
  ],
  "inventors": [
    "Steven Randolph",
    "James Miyasaki",
    "Marcus Straw"
  ],
  "filing_date": "2014-12-22",
  "publication_date": "2016-06-14",
  "grant_date": "2016-06-14",
  "priority_date": "2014-12-22",
  "application_number": "US-201414579056-A",
  "family_id": "54849802",
  "cited_by_count": 7,
  "citations": [
    "US8422777B2",
    "US20140072095A1"
  ]
}