Systems and methods for estimating depth using stereo array cameras

{
  "publication_number": "US10455218B2",
  "country": "US",
  "kind": "B2",
  "title": "Systems and methods for estimating depth using stereo array cameras",
  "abstract": "Systems and methods for stereo imaging with camera arrays in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating depth information for an object using two or more array cameras that each include a plurality of imagers includes obtaining a first set of image data captured from a first set of viewpoints, identifying an object in the first set of image data, determining a first depth measurement, determining whether the first depth measurement is above a threshold, and when the depth is above the threshold: obtaining a second set of image data of the same scene from a second set of viewpoints located known distances from one viewpoint in the first set of viewpoints, identifying the object in the second set of image data, and determining a second depth measurement using the first set of image data and the second set of image data.",
  "claims": [
    "1. An array camera, comprising: a first array camera comprising a plurality of cameras that capture images of a scene from different viewpoints; a second array camera comprising a plurality of cameras that capture images of a scene from different viewpoints, where the second array camera captures at least one image of a scene from a different viewpoint to the viewpoints of the cameras in the first array camera; a processor; and memory in communication with the processor; wherein software directs the processor to: obtain a first set of image data from the first array camera comprising image data of a scene captured from a first set of different viewpoints; obtain a second set of image data from the second array camera comprising image data of the same scene from a viewpoint different from the first set of viewpoints; identifying an object of interest in the first and second sets of image data; and determining a depth measurement for the object of interest using at least a portion of the first set of image data; and determining whether the depth measurement for the object of interest using at least a portion of the first set of image data corresponds to an observed disparity below a threshold; and when the depth measurement corresponds to an observed disparity below the threshold, refining the depth measurement using at least a portion of the second set of image data.",
    "2. The array camera of claim 1, wherein the first array camera and the second array camera are set farther apart than the cameras in the first array camera.",
    "3. The array camera of claim 2, wherein the first array camera and the second array camera are located a fixed baseline distance apart.",
    "4. The array camera of claim 1, wherein the first and second array cameras have the same number of cameras, and include cameras having the same resolution.",
    "5. The array camera of claim 4, wherein the cameras in the first and second array cameras have the same arrangement of color filters.",
    "6. The array camera of claim 1, wherein the baseline distance between the first array camera and the second array camera is variable.",
    "7. The array camera of claim 1, wherein: the first array camera and the second array camera further comprise internal sensors including gyroscopes and accelerometers; and software further directs the processor to estimate the baseline distance between the first array camera and the second array camera from extrinsics determined from matching features in the image data captured by the first array camera and the second array camera in combination with information from the gyroscopes and accelerometers.",
    "8. The array camera of claim 1, wherein the first array camera forms an M×N array of cameras.",
    "9. The array camera of claim 1, wherein software further directs the processor to: select a reference viewpoint relative to the viewpoints of the first array camera and the second array camera; determine depth estimates for pixel locations in an image from the reference viewpoint using the first set of image data obtained from the first array camera, wherein generating a depth estimate for a given pixel location in the image from the reference viewpoint comprises: identifying pixels in the first set of image data obtained from the first array camera that correspond to the given pixel location in the image from the reference viewpoint based upon expected disparity at a plurality of depths; comparing the similarity of the corresponding pixels identified at each of the plurality of depths; and selecting the depth from the plurality of depths at which the identified corresponding pixels have the highest degree of similarity as a depth estimate for the given pixel location in the image from the reference viewpoint; determine whether a depth estimate for pixel locations in the image from the reference viewpoint determined using the first set of image data obtained from the first array camera corresponds to an observed disparity below a predetermined threshold; and when the depth estimate corresponds to an observed disparity below the predetermined threshold, refining the depth estimate using the second set of image data obtained from the second array camera.",
    "10. The array camera of claim 9, wherein software further directs the processor to refine a depth estimate using the second set of image data obtained from the second array camera by: identifying pixels in the first set of image data obtained from the first array camera and the second set of image data obtain from the second array camera that correspond to the given pixel location in the image from the reference viewpoint based upon expected disparity at a plurality of depths; comparing the similarity of the corresponding pixels identified at each of the plurality of depths; and selecting the depth from the plurality of depths at which the identified corresponding pixels have the highest degree of similarity as a depth estimate for the given pixel location in the image from the reference viewpoint.",
    "11. The array camera of claim 10, wherein software further directs the processor to refine a depth estimate using the second set of image data obtained from the second array camera by selecting the plurality of depths based upon the depth estimate initially determined using the first set of image data obtained from the first array camera.",
    "12. The array camera of claim 1, wherein software further directs the processor to generate a depth map using the depth estimates for pixel locations in an image from the reference viewpoint, where the depth map indicates distances of surfaces of scene objects from the reference viewpoint.",
    "13. The array camera of claim 12, wherein software further directs the processor to generate a depth map by identifying pixels in an image captured by the second array camera corresponding to pixels for which depth estimates were determined using the first set of image data obtained from the first array camera and applying depth estimates determined using the first set of image data obtained from the first array camera to the corresponding pixels.",
    "14. The array camera of claim 1, wherein software further configures the processor to synthesize an image with a resolution that is higher than the resolution of images captured from the first array camera using the first set of image data obtained from the first array camera and the second set of image data obtained from the second array camera using the depth map.",
    "15. The array camera of claim 1, wherein the cameras in the first array camera and the second array camera are cameras that image portions of the spectral band selected from the group consisting of red, blue, green, infrared, and extended color.",
    "16. The array camera of claim 1, wherein the cameras in the first array camera form a π filter group.",
    "17. The array camera of claim 16, wherein: the cameras in the second array camera form a π filter group."
  ],
  "description_excerpt": "The present invention relates to stereo imaging with camera arrays and how this extends the core capabilities of a single monolithic light field camera array.\n\nAn image captured by a digital camera provides some sense of the location of objects in a scene and the location of one object relative to another. Without information in a third dimension (depth), it can be difficult to make strict conclusions about locations and linear measurements.\n\nA legacy stereo camera is a type of camera with two or more lenses with a separate image sensor for each lens. This allows the camera to simulate human binocular vision and the ability to capture three-dimensional (stereo) images. A legacy stereo camera has some ability to determine depth of objects in its field of view when the baseline, or distance, between the two cameras is known.\n\nAn array camera includes a plurality of individual imagers (i.e., cameras) that can capture images of a scene where the image obtained by each imager is from a slightly different viewpoint. The diversity of information between viewpoints can be used to calculate depth information. The depth calculations in an array camera are more sophisticated than in a stereo camera because additional combinations of images, from different cameras in the array, can be compared and correlated to make the estimates more robust in the presence of noise and aliasing. An array camera system typically still has reduced precision in determining depth beyond a certain distance from the camera because the information used to calculate depth becomes less diverse in magnitude the farther an object is from the camera.",
  "cpc": [
    "H04N 13/243",
    "G01P 3/38",
    "G06T 2207/10012",
    "G06T 2207/10021",
    "G06T 7/285",
    "G06T 7/55",
    "G06T 7/557",
    "G06T 7/579",
    "G06T 7/593"
  ],
  "ipc": [
    "G01P 3/38",
    "G06T 7/285",
    "G06T 7/55",
    "G06T 7/557",
    "G06T 7/579",
    "G06T 7/593",
    "H04N 13/243"
  ],
  "assignees": [
    "Fotonation Ireland Ltd"
  ],
  "inventors": [
    "Kartik Venkataraman",
    "Paul Gallagher",
    "Ankit Jain",
    "Semyon Nisenzon"
  ],
  "filing_date": "2017-10-23",
  "publication_date": "2019-10-22",
  "grant_date": "2019-10-22",
  "priority_date": "2013-03-15",
  "application_number": "US-201715791242-A",
  "family_id": "51525608",
  "cited_by_count": 55,
  "citations": [
    "US4124798A",
    "US4198646A",
    "US4323925A",
    "US4467365A",
    "JPS5925483A",
    "US4652909A",
    "US4460449A",
    "JPS6140709A",
    "US4899060A",
    "JPS6437177A",
    "US5005083A",
    "US5070414A",
    "US4962425A",
    "JPH02285772A",
    "US5157499A",
    "US5144448A",
    "US5463464A",
    "US5325449A",
    "US5488674A",
    "US5327125A",
    "JPH06129851A",
    "US6130786A",
    "JPH0715457A",
    "US6095989A",
    "US6419638B1",
    "EP0677821A2",
    "US5638461A",
    "US5629524A",
    "US5933190A",
    "US5963664A",
    "US6175379B1",
    "US6005607A",
    "US5833507A",
    "US5880691A",
    "US5757425A",
    "JPH09171075A",
    "JPH09181913A",
    "US5793900A",
    "US6124974A",
    "US5973844A",
    "US20020039438A1",
    "US5832312A",
    "US5911008A",
    "US6002743A",
    "US6034690A",
    "US6141048A",
    "EP0840502A2",
    "US6137535A",
    "US5808350A",
    "US20020113867A1",
    "JPH10253351A",
    "US5801919A",
    "US6097394A",
    "US20010005225A1",
    "US6563537B1",
    "US6163414A",
    "US6765617B1",
    "JPH11142609A",
    "US6069365A",
    "US6239909B1",
    "US20020101528A1",
    "US6833863B1",
    "JPH11223708A",
    "US6172352B1",
    "US6160909A",
    "US7333651B1",
    "US6909121B2",
    "EP0957642A2",
    "US6373518B1",
    "JPH11325889A",
    "EP0957642B1",
    "US6205241B1",
    "US6137100A",
    "US6069351A",
    "US6903770B1",
    "US6340994B1",
    "US20030190072A1",
    "US20010019621A1",
    "US6879735B1",
    "US20020027608A1",
    "US6750904B1",
    "US6477260B1",
    "US6611289B1",
    "JP2000209503A",
    "US6603513B1",
    "US20020012056A1",
    "US20020063807A1",
    "US6819358B1",
    "US6292713B1",
    "US7924321B2",
    "JP2001008235A",
    "US6627896B1",
    "US6801653B1",
    "US7015954B1",
    "US20020122113A1",
    "US6647142B1",
    "US6771833B1",
    "US6628330B1",
    "US6358862B1",
    "US6552742B1",
    "US6639596B1",
    "US6628845B1",
    "US6774941B1",
    "US6671399B1",
    "US6674892B1",
    "US6819328B1",
    "US7161614B1",
    "US20010038387A1",
    "US7295697B1",
    "US20060210186A1",
    "US20030140347A1",
    "US6502097B1",
    "US6476805B1",
    "JP2001194114A",
    "US7471765B2",
    "US20020120634A1",
    "JP2001264033A",
    "US6571466B1",
    "JP2001277260A",
    "US20010028038A1",
    "US20020015536A1",
    "JP2001337263A",
    "US6985175B2",
    "US7245761B2",
    "US20040056966A1",
    "US20070052825A1",
    "US20020028014A1",
    "US7085409B2",
    "US20020061131A1",
    "US20020057845A1",
    "US20040207600A1",
    "US7262799B2",
    "EP1201407A2",
    "JP2002205310A",
    "US6657218B2",
    "US20030231179A1",
    "US6788338B1",
    "US20020075450A1",
    "US20040151401A1",
    "US20040071367A1",
    "JP2002252338A",
    "US20020113888A1",
    "JP2002195910A",
    "US20020089596A1",
    "US20020087403A1",
    "US20020094027A1",
    "US20020118113A1",
    "JP2002250607A",
    "EP1243945B1",
    "EP1243945A2",
    "US20020163054A1",
    "US6635941B2",
    "US20020177054A1",
    "US6443579B1",
    "US20020167537A1",
    "US7235785B2",
    "US20050205785A1",
    "US20020190991A1",
    "US7738013B2",
    "US20050068436A1",
    "US20030124763A1",
    "US20020195548A1",
    "US6525302B2",
    "US20030025227A1",
    "US20110211077A1",
    "US7369165B2",
    "JP2003094445A",
    "JP2003139910A",
    "US20030086079A1",
    "JP2003163938A",
    "US6927922B2",
    "US20030156189A1",
    "US20080025649A1",
    "US20030179418A1",
    "US20110090217A1",
    "US8254668B2",
    "US20120044249A1",
    "JP2003298920A",
    "US20030188659A1",
    "US7215364B2",
    "EP1355274A2",
    "US20030198377A1",
    "US6917702B2",
    "US6795253B2",
    "CN1669332A",
    "US20040234873A1",
    "US20030211405A1",
    "US20050175257A1",
    "US6897454B2",
    "US20040003409A1",
    "US20040047274A1",
    "US20040066454A1",
    "US20040008271A1",
    "US20060049930A1",
    "US20040012689A1",
    "US20040027358A1",
    "US20070166447A1",
    "US20040096119A1",
    "US20040050104A1",
    "US20040207836A1",
    "US20040061787A1",
    "US20090263017A1",
    "US20040075654A1",
    "US20060072029A1",
    "US20040100570A1",
    "US20120176479A1",
    "US20040105021A1",
    "US20040114807A1",
    "JP2004221585A",
    "US20040141659A1",
    "US7706634B2",
    "US20050012035A1",
    "US20060138322A1",
    "US20060038891A1",
    "US20040213449A1",
    "US8773536B1",
    "US8164629B1",
    "US20040165090A1",
    "US20060203113A1",
    "US20040170340A1",
    "US20040169617A1",
    "US20040174439A1",
    "US20040179008A1",
    "US20040179834A1",
    "US7206449B2",
    "US7425984B2",
    "US20040196379A1",
    "US20070127831A1",
    "US20040239885A1",
    "US6958862B1",
    "US20040218809A1",
    "US20070171290A1",
    "US20070040828A1",
    "US7657090B2",
    "US20040239782A1",
    "US20040240052A1",
    "US20050009313A1",
    "US20040251509A1",
    "US20050048690A1",
    "US20040264806A1",
    "US20050010621A1",
    "CN1839394A",
    "US20050006477A1",
    "US8098304B2",
    "US20050007461A1",
    "US20090237520A1",
    "US20050036778A1",
    "US20050047678A1",
    "US20050084179A1",
    "US20050151759A1",
    "JP2005116022A",
    "US20050083531A1",
    "US20110141309A1",
    "US20050134699A1",
    "US7840067B2",
    "US20060203100A1",
    "US20070158427A1",
    "US20070160310A1",
    "US20050128509A1",
    "WO2005057922A1",
    "US20050132098A1",
    "JP2005181460A",
    "US20050128595A1",
    "US20050134712A1",
    "US20050134698A1",
    "JP2007520107A",
    "US20050147277A1",
    "US7496293B2",
    "US20060221250A1",
    "US20050168924A1",
    "US20050185711A1",
    "US8077245B2",
    "JP2006047944A",
    "US20080019611A1",
    "US20050219264A1",
    "US7633511B2",
    "JP2005295381A",
    "US20050219363A1",
    "US20050224843A1",
    "US20050225654A1",
    "US7620265B1",
    "JP2005303694A",
    "US7292735B2",
    "US20080310501A1",
    "US20060034531A1",
    "US20070225600A1",
    "JP2005341569A",
    "US20050275946A1",
    "US20050265633A1",
    "JP2005354124A",
    "US20060013318A1",
    "US20050286756A1",
    "US20050286612A1",
    "US20060007331A1",
    "US20060002635A1",
    "JP2006033228A",
    "JP2006033493A",
    "US20060243889A1",
    "US20060018509A1",
    "US8027531B2",
    "JP2008507874A",
    "US20090050946A1",
    "US20060023197A1",
    "US20060023314A1",
    "US20060176566A1",
    "US20060029270A1",
    "US20060028476A1",
    "US20060029271A1",
    "US20080117289A1",
    "US20060039611A1",
    "US20060033005A1",
    "US20060034003A1",
    "US20060035415A1",
    "US20070247517A1",
    "CN101427372A",
    "US20060054782A1",
    "US20080030597A1",
    "US20100060746A9",
    "US20090302205A9",
    "US20100208100A9",
    "US7199348B2",
    "US20110108708A1",
    "US20070211164A1",
    "US20080174670A1",
    "US20070139333A1",
    "CN101010619A",
    "US20060046204A1",
    "US20060050980A1",
    "US20060055811A1",
    "US20060054780A1",
    "US20070126898A1",
    "US20060069478A1",
    "WO2006039906A3",
    "WO2006039906A2",
    "US20090052743A1",
    "US20060087747A1",
    "US20060098888A1",
    "US7741620B2",
    "US20070296721A1",
    "US20100002126A1",
    "US20060103754A1",
    "US20060289772A1",
    "US20060125936A1",
    "US20070030356A1",
    "US20120062756A1",
    "US20060210146A1",
    "US20100133418A1",
    "US7430312B2",
    "US20060152803A1",
    "US20060157640A1",
    "US20090167922A1",
    "US20100220212A1",
    "US20060159369A1",
    "US20060197937A1",
    "US7965314B1",
    "US20060187322A1",
    "US20060187338A1",
    "US7912673B2",
    "JP2006258930A",
    "US20080156991A1",
    "US20090201371A1",
    "CN101147392A",
    "US20060214085A1",
    "US20060239549A1",
    "US7956871B2",
    "US20060251410A1",
    "US20090147919A1",
    "US20060274174A1",
    "US20060278948A1",
    "US20060279648A1",
    "EP1734766A2",
    "US20070008575A1",
    "US20070035707A1",
    "US20090140131A1",
    "US20070002159A1",
    "US20070102622A1",
    "US20070009150A1",
    "US20090268983A1",
    "US20070024614A1",
    "US20090127430A1",
    "WO2007013250A1",
    "US20110221939A1",
    "US20070036427A1",
    "US20070041391A1",
    "US20070040922A1",
    "US20070257184A1",
    "US20130027580A1",
    "US20070296835A1",
    "US7564019B2",
    "US20070258006A1",
    "US20070083114A1",
    "US7408725B2",
    "US20080218610A1",
    "US7723662B2",
    "US20070085917A1",
    "US8300085B2",
    "US20070092245A1",
    "US20080211737A1",
    "US20070146511A1",
    "US7599547B2",
    "US20090207235A1",
    "US20070165931A1",
    "US20070140685A1",
    "US20070153335A1",
    "US20070146503A1",
    "US8089515B2",
    "US20070159541A1",
    "US7675080B2",
    "WO2007083579A1",
    "US20090179142A1",
    "US20070182843A1",
    "US20070201859A1",
    "US7391572B2",
    "US20070206241A1",
    "US20090092363A1",
    "US20070216765A1",
    "US8360574B2",
    "US7606484B1",
    "JP2007259136A",
    "US20070228256A1",
    "US8044994B2",
    "US20080043095A1",
    "US20080043096A1",
    "US20070236595A1",
    "US20070242141A1",
    "CN101064780A",
    "US20070263114A1",
    "US20070258706A1",
    "US20070263113A1",
    "WO2007134137A2",
    "US20070268374A1",
    "US8194296B2",
    "US20110285910A1",
    "US8169486B2",
    "US20070177004A1",
    "US20070296832A1",
    "US7990447B2",
    "US20080006859A1",
    "US20070296847A1",
    "US20070297696A1",
    "CN101102388A",
    "US20080024683A1",
    "JP2008039852A",
    "US20080030592A1",
    "US20080062164A1",
    "US8406562B2",
    "US8854462B2",
    "US20080056302A1",
    "US8687087B2",
    "US20080054518A1",
    "JP2008055908A",
    "US20110149409A1",
    "US20110149408A1",
    "US20080088793A1",
    "US20080079805A1",
    "US20080080028A1",
    "WO2008045198A2",
    "US20080084486A1",
    "US20100133230A1",
    "CN101606086A",
    "US20100091389A1",
    "US20080273751A1",
    "US20080095523A1",
    "US7986018B2",
    "US20100103175A1",
    "WO2008050904A1",
    "US20080099804A1",
    "US20080106620A1",
    "US20080112059A1",
    "US20080112635A1",
    "US20080118241A1",
    "US20100074532A1",
    "US7826153B2",
    "US20080131107A1",
    "US20080131019A1",
    "US20140013273A1",
    "US8559705B2",
    "EP2104334A1",
    "US8242426B2",
    "US7646549B2",
    "US20080152296A1",
    "US20080151097A1",
    "TW200828994A",
    "US20080152215A1",
    "US20080158259A1",
    "US20080158375A1",
    "US20080158698A1",
    "US20080165257A1",
    "US20090273663A1",
    "JP2008172735A",
    "US8655052B2",
    "US7675681B2",
    "US20080187305A1",
    "US7667824B1",
    "US20080193026A1",
    "US8130120B2",
    "WO2008108271A1",
    "WO2008108926A1",
    "US20080219654A1",
    "US20080218613A1",
    "US20080218612A1",
    "US20080218611A1",
    "US20080247638A1",
    "US20090060281A1",
    "US20080239116A1",
    "US8055466B2",
    "US20080240598A1",
    "US8493496B2",
    "US8213711B2",
    "US20080247653A1",
    "JP2008258885A",
    "US7639435B2",
    "US20090152664A1",
    "US20100111444A1",
    "US20080272416A1",
    "US20080278591A1",
    "US20080278610A1",
    "US20080284880A1",
    "US20080291295A1",
    "US20080298674A1",
    "WO2008150817A1",
    "US8290358B1",
    "US20100195716A1",
    "US20100182406A1",
    "US20120153153A1",
    "US20090027543A1",
    "US8559756B2",
    "US20100202054A1",
    "EP2026563A1",
    "US7782364B2",
    "US20090066693A1",
    "JP2009064421A",
    "US7973834B2",
    "US20090079862A1",
    "US20090086074A1",
    "US20090091645A1",
    "US8541730B2",
    "US20090091806A1",
    "US20090096050A1",
    "US20090175349A1",
    "US20090102956A1",
    "US20090103792A1",
    "TW200939739A",
    "US20090109306A1",
    "US20100223237A1",
    "US20090128833A1",
    "US20090128644A1",
    "US20090129667A1",
    "US8126279B2",
    "US20100309292A1",
    "JP2009132010A",
    "US20090141933A1",
    "WO2009073950A1",
    "US20100265346A1",
    "US8000498B2",
    "US20090167934A1",
    "US20090167923A1",
    "US20110031381A1",
    "US8180145B2",
    "US20100289941A1",
    "US20090180021A1",
    "US8189065B2",
    "US20110211824A1",
    "US8244027B2",
    "US20110064327A1",
    "US20110043661A1",
    "US20090200622A1",
    "US20090225203A1",
    "US20120176481A1",
    "US20090219435A1",
    "US20090245573A1",
    "US20110018973A1",
    "US20100013927A1",
    "US20090256947A1",
    "US20090268192A1",
    "US20090268970A1",
    "US8280194B2",
    "US20090274387A1",
    "US20110121421A1",
    "US20090279800A1",
    "US20100201809A1",
    "US20090284651A1",
    "US20150009362A1",
    "US20170006233A1",
    "US20150009354A1",
    "KR101843994B1",
    "US9041823B2",
    "EP3328048A1",
    "WO2009151903A2",
    "US9041829B2",
    "US20180007284A1",
    "JP2017163550A",
    "US20140368662A1",
    "US20140355870A1",
    "US20140354854A1",
    "US20140368685A1",
    "US9049367B2",
    "US10027901B2",
    "US9055233B2",
    "US20140354773A1",
    "US9749547B2",
    "US9060120B2",
    "US20140354844A1",
    "US20110069189A1",
    "US20110080487A1",
    "US9712759B2",
    "US20140354855A1",
    "US9060124B2",
    "US10142560B2",
    "US20140354843A1",
    "CN102037717A",
    "JP2011523538A",
    "US9576369B2",
    "US20150009353A1",
    "US9077893B2",
    "US9094661B2",
    "US9124815B2",
    "US9191580B2",
    "US9188765B2",
    "US9235898B2",
    "US20180048830A1",
    "US20140368684A1",
    "US20160227195A1",
    "US20160269650A1",
    "US20160267665A1",
    "US20140368683A1",
    "US9485496B2",
    "US8866920B2",
    "US8885059B1",
    "US20140333787A1",
    "US20140333731A1",
    "US20140333764A1",
    "US20140340539A1",
    "US8896719B1",
    "US20140347509A1",
    "US8902321B2",
    "US20140354853A1",
    "US20090290811A1",
    "US8830375B2",
    "US20110032370A1",
    "US8131097B2",
    "US20090297056A1",
    "US8244058B1",
    "JP2009300268A",
    "US20090317061A1",
    "US20090323206A1",
    "WO2009157273A1",
    "US20090322876A1",
    "US20090323195A1",
    "US20090324118A1",
    "US20100002314A1",
    "US20100002313A1",
    "US8456517B2",
    "US20100007714A1",
    "US8284240B2",
    "US20100044815A1",
    "US20110142138A1",
    "US20100045809A1",
    "US20100053415A1",
    "US20110181797A1",
    "US20100053600A1",
    "US8098297B2",
    "US20100053342A1",
    "US20100073463A1",
    "US8553093B2",
    "WO2010037512A1",
    "JP2012504805A",
    "US20100085351A1",
    "US20100086227A1",
    "US20100085425A1",
    "US20130259317A1",
    "US8416282B2",
    "US20100103259A1",
    "US20100097491A1",
    "US20130229540A1",
    "US20110255592A1",
    "US20100103308A1",
    "US20100118127A1",
    "US20110255745A1",
    "US20100142839A1",
    "US20100128145A1",
    "US8279325B2",
    "US20100129048A1",
    "US8111910B2",
    "US8289440B2",
    "US20100141802A1",
    "US20120327222A1",
    "US8013904B2",
    "US20100142828A1",
    "JP2010139288A",
    "US8149323B2",
    "US20100157073A1",
    "US20100166410A1",
    "US20100165152A1",
    "US20100171866A1",
    "US20100177411A1",
    "US20110292216A1",
    "US20110274175A1",
    "EP2381418A1",
    "US8315476B1",
    "US8189089B1",
    "US20100194901A1",
    "US20100194860A1",
    "US20100202683A1",
    "US20110285701A1",
    "US20100201834A1",
    "US20120155830A1",
    "US8294754B2",
    "US20100225740A1",
    "US20100231285A1",
    "US20100238327A1",
    "US8106949B2",
    "US20100244165A1",
    "US20100245684A1",
    "US20120026297A1",
    "US20100254627A1",
    "US20120026366A1",
    "US20100259610A1",
    "US8294099B2",
    "US20140118493A1",
    "US20100265381A1",
    "US20110234841A1",
    "US20100265385A1",
    "US20120249550A1",
    "EP2244484A1",
    "US20110044502A1",
    "US20100290483A1",
    "US20100281070A1",
    "US20120127275A1",
    "US20100302423A1",
    "US20140139643A1",
    "US20100309368A1",
    "US20120013748A1",
    "US20100321595A1",
    "US20100321640A1",
    "US20100329556A1",
    "WO2011008443A2",
    "JP2011030184A",
    "US20110001037A1",
    "JP2011017764A",
    "US8345144B1",
    "US20110019243A1",
    "US8212914B2",
    "US20110019048A1",
    "US20140009586A1",
    "US20110032341A1",
    "US20110033129A1",
    "US8577183B2",
    "US20120113413A1",
    "US20110038536A1",
    "US20110043665A1",
    "US20110043668A1",
    "US20110051255A1",
    "US20110055729A1",
    "US8411146B2",
    "WO2011026527A1",
    "US20120170134A1",
    "US20140076336A1",
    "US8754941B1",
    "US20120188341A1",
    "US20110085028A1",
    "US20120200669A1",
    "US20110228142A1",
    "JP2013509022A",
    "WO2011046607A2",
    "US20110169994A1",
    "US20110207074A1",
    "US20140098267A1",
    "US20120019530A1",
    "WO2011055655A1",
    "US20120229628A1",
    "EP2339532A1",
    "JP2011109484A",
    "US20110115886A1",
    "US20110122308A1",
    "EP2502115A2",
    "US20140368686A1",
    "WO2011063347A2",
    "US20170187933A1",
    "WO2011063347A3",
    "US8861089B2",
    "US20160269664A1",
    "US9264610B2",
    "US20130308197A1",
    "US8514491B2",
    "US20110128412A1",
    "US20110129165A1",
    "US8400555B1",
    "US20110128393A1",
    "EP2336816A2",
    "US8446492B2",
    "US20110273531A1",
    "US20120249750A1",
    "US20110150321A1",
    "US20110153248A1",
    "US20120262607A1",
    "US20110157321A1",
    "US9019426B2",
    "US8514291B2",
    "US20110157451A1",
    "US20110176020A1",
    "US8289409B2",
    "US20110206291A1",
    "US20110193944A1",
    "US20110200319A1",
    "US20110199458A1",
    "US20150332468A1",
    "US8648918B2",
    "US20130033579A1",
    "KR20110097647A",
    "US9456196B2",
    "WO2011105814A2",
    "US20120314033A1",
    "US20120314937A1",
    "US20110221658A1",
    "JP2011203238A",
    "US20110211068A1",
    "US20130120605A1",
    "US20110221599A1",
    "US20110222757A1",
    "US20110221950A1",
    "US20120198677A1",
    "WO2011116203A1",
    "US8231814B2",
    "US20110241234A1",
    "US20120147139A1",
    "US20110228144A1",
    "US20110298917A1",
    "US20110234825A1",
    "US20110243428A1",
    "US20110242356A1",
    "US20110242355A1",
    "US20120081519A1",
    "US20110242342A1",
    "US8565547B2",
    "US20110261993A1",
    "US20110267264A1",
    "US20110267348A1",
    "US20130250150A1",
    "US9256974B1",
    "US20110274366A1",
    "US20110298898A1",
    "US20120057040A1",
    "US20170048468A1",
    "KR101824672B1",
    "US20120012748A1",
    "JP2013526801A",
    "EP2569935A1",
    "US20130147979A1",
    "EP2569935B1",
    "US8576302B2",
    "US9936148B2",
    "US20180227511A1",
    "WO2011143501A1",
    "US20160269627A1",
    "US20110279721A1",
    "US8928793B2",
    "JP5848754B2",
    "CN103004180A",
    "US20110279705A1",
    "US20110285866A1",
    "US20120114224A1",
    "US20110300929A1",
    "US20120062697A1",
    "US20130120536A1",
    "US20110310980A1",
    "US20110317766A1",
    "US20130088489A1",
    "US20110316968A1",
    "CN101883291A",
    "US20130113888A1",
    "US20120163725A1",
    "GB2482022A",
    "US20120014456A1",
    "US20120023456A1",
    "US20120019700A1",
    "US20120026342A1",
    "US20120026451A1",
    "US20120038745A1",
    "CN102375199A",
    "US8977038B2",
    "US20120039525A1",
    "US8836793B1",
    "US20120044372A1",
    "US20130128069A1",
    "US20130128068A1",
    "US20130128087A1",
    "US20120051624A1",
    "US20130100254A1",
    "US20120056982A1",
    "US20120062702A1",
    "US20130176394A1",
    "US20130162641A1",
    "US20130128121A1",
    "US20120069235A1",
    "US20130222556A1",
    "US20120086803A1",
    "WO2012057619A1",
    "WO2012057620A3",
    "WO2012057622A1",
    "WO2012057621A1",
    "WO2012057623A1",
    "WO2012057620A2",
    "US20120105590A1",
    "US20140146132A1",
    "US20120105691A1",
    "US20120113318A1",
    "US20120113232A1",
    "WO2012074361A1",
    "US20130258067A1",
    "WO2012078126A1",
    "US20150036014A1",
    "US20150036015A1",
    "EP2652678B1",
    "US8878950B2",
    "US9361662B2",
    "US9047684B2",
    "US9041824B2",
    "US20170053382A1",
    "WO2012082904A1",
    "EP2652678A1",
    "US20120147205A1",
    "US20150042833A1",
    "SG191151A1",
    "US20120154551A1",
    "US8682107B2",
    "US20120163672A1",
    "US20120169433A1",
    "TWI535292B",
    "TW201228382A",
    "US8842201B2",
    "US20120188634A1",
    "US8581995B2",
    "US20120188420A1",
    "US20120188389A1",
    "US20120188235A1",
    "US20140037140A1",
    "US20120200726A1",
    "US20120200734A1",
    "US20120206582A1",
    "US20140176592A1",
    "US20120219236A1",
    "US20120293695A1",
    "US20120224083A1",
    "US20120262601A1",
    "US20120229602A1",
    "US20120237114A1",
    "US20120249853A1",
    "US20120249836A1",
    "US9030528B2",
    "US20120268574A1",
    "US20120274626A1",
    "US20140059462A1",
    "US20120287291A1",
    "US20130057710A1",
    "US8305456B1",
    "US8692893B2",
    "US20140218546A1",
    "WO2012155119A1",
    "US20160269626A1",
    "US9197821B2",
    "US20120290257A1",
    "US20120293624A1",
    "US20120293489A1",
    "US20120307099A1",
    "US20120307093A1",
    "US9635274B2",
    "US20140085502A1",
    "US8885922B2",
    "US9128228B2",
    "US20150296137A1",
    "US20130265459A1",
    "US20130003184A1",
    "US9578237B2",
    "US20140347748A1",
    "JP2014521117A",
    "WO2013003276A1",
    "US8804255B2",
    "US9516222B2",
    "US20130002828A1",
    "US20130010073A1",
    "US20130016245A1",
    "US20130016885A1",
    "US20130022111A1",
    "US20130033585A1",
    "US20140192154A1",
    "US20130038696A1",
    "US20130050526A1",
    "US8866951B2",
    "US20130047396A1",
    "US20130050504A1",
    "US9794476B2",
    "WO2013043751A1",
    "US20160316140A1",
    "US20130070060A1",
    "WO2013043761A1",
    "US20140098266A1",
    "US20180097993A1",
    "US20130215231A1",
    "US20140198188A1",
    "US20130077859A1",
    "CN107230236A",
    "US9025894B2",
    "US20130077882A1",
    "US20130077880A1",
    "US8831367B2",
    "US9864921B2",
    "US20180330182A1",
    "CN104081414B",
    "US20150015669A1",
    "US9036928B2",
    "US8542933B2",
    "US9036931B2",
    "US20130076967A1",
    "US9031342B2",
    "US9031335B2",
    "US20150199793A1",
    "US9031343B2",
    "JP2017163587A",
    "US9536166B2",
    "US20150199841A1",
    "EP2761534A1",
    "US9025895B2",
    "CN104081414A",
    "US9042667B2",
    "US9811753B2",
    "IN2014CN02708A",
    "WO2013049699A1",
    "US10019816B2",
    "JP6140709B2",
    "US20140369615A1",
    "US20170178363A1",
    "US9129183B2",
    "US20140369612A1",
    "US20140376826A1",
    "JP2014535191A",
    "US20140376825A1",
    "US20150055884A1",
    "US20180197035A1",
    "US20150003752A1",
    "US20150003753A1",
    "US20130083172A1",
    "US20130088637A1",
    "WO2013055960A1",
    "US20160165106A1",
    "US20130093842A1",
    "US20130107061A1",
    "US20130250123A1",
    "US20130113899A1",
    "US20130113939A1",
    "US20140313315A1",
    "US20130121559A1",
    "US20130127988A1",
    "US20130135448A1",
    "US9661310B2",
    "US20130135315A1",
    "US20140300706A1",
    "US20130155050A1",
    "US20130342641A1",
    "US20130169754A1",
    "WO2013119706A1",
    "US20130208138A1",
    "WO2013126578A1",
    "US20170365104A1",
    "EP2817955B1",
    "US20150235476A1",
    "US9754422B2",
    "US20130215108A1",
    "EP2817955A1",
    "US9412206B2",
    "US9413953B2",
    "US8831377B2",
    "US20130222656A1",
    "US20130223759A1",
    "US20130230237A1",
    "US20140125771A1",
    "US20130274923A1",
    "US20130274596A1",
    "US20130286236A1",
    "WO2013166215A1",
    "US20130293760A1",
    "US9706132B2",
    "CN104335246A",
    "US9210392B2",
    "US20160165147A1",
    "CN104335246B",
    "US20150085073A1",
    "US20140146201A1",
    "US20130321581A1",
    "US20150124059A1",
    "US20130335598A1",
    "EP2873028A1",
    "US20180109782A1",
    "WO2014005123A1",
    "CN104508681A",
    "US9100635B2",
    "US9807382B2",
    "JP2015534734A",
    "US20150326852A1",
    "US20140002675A1",
    "US20150104076A1",
    "US20160266284A1",
    "US8896594B2",
    "US20180081090A1",
    "US9766380B2",
    "WO2014004134A1",
    "US20140002674A1",
    "JP2015522178A",
    "US10261219B2",
    "EP2867718A1",
    "US20140037137A1",
    "US20140043507A1",
    "US20150049915A1",
    "US20150049917A1",
    "US20160267672A1",
    "US9240049B2",
    "US9123117B2",
    "US9235900B2",
    "US8780113B1",
    "CN104662589A",
    "US9123118B2",
    "US20140321712A1",
    "US9129377B2",
    "US9858673B2",
    "US20150049916A1",
    "WO2014031795A1",
    "EP2888720A1",
    "US20150042766A1",
    "US20150042767A1",
    "US9147254B2",
    "CN107346061A",
    "US8619082B1",
    "US20180211402A1",
    "CN104685513B",
    "US20180124311A1",
    "EP2888698A2",
    "WO2014032020A3",
    "US20160165134A1",
    "CN104685513A",
    "WO2014032020A2",
    "US9813616B2",
    "US20150248744A1",
    "US20140079336A1",
    "US9214013B2",
    "US20140081454A1",
    "US20140078333A1",
    "US20140092281A1",
    "CN104685860A",
    "WO2014052974A2",
    "EP2901671A2",
    "US20160255333A1",
    "US20140104490A1",
    "US20140118584A1",
    "WO2014078443A1",
    "US20140132810A1",
    "US20160249001A1",
    "US9143711B2",
    "US9749568B2",
    "US9253397B2",
    "US20140139642A1",
    "US20150085174A1",
    "US9001226B1",
    "US20140186045A1",
    "US20140183334A1",
    "US20180024330A1",
    "US20140192253A1",
    "US20140204183A1",
    "US9769365B1",
    "US9462164B2",
    "US20140232822A1",
    "US20170257562A1",
    "US10009538B2",
    "WO2014130849A1",
    "US20170054901A1",
    "US20170085845A1",
    "US20140240528A1",
    "US9774831B2",
    "WO2014133974A9",
    "US20160269651A1",
    "US9743051B2",
    "US9253380B2",
    "US9374512B2",
    "US20140240529A1",
    "WO2014133974A1",
    "US9638883B1",
    "US9917998B2",
    "WO2014138697A1",
    "US20160044257A1",
    "US9774789B2",
    "US20180013945A1",
    "WO2014138695A1",
    "US20160057332A1",
    "US20140253738A1",
    "US9124864B2",
    "US20150035992A1",
    "US8866912B2",
    "US20160165212A1",
    "US9986224B2",
    "US10225543B2",
    "US20180270473A1",
    "US9521416B1",
    "US9741118B2",
    "US20140267890A1",
    "US9519972B2",
    "US20180040135A1",
    "US20160037097A1",
    "WO2014165244A1",
    "US20140267243A1",
    "US9733486B2",
    "US20160163051A1",
    "US10127682B2",
    "WO2014164909A1",
    "US20140285675A1",
    "US9888194B2",
    "US20170094243A1",
    "US9800856B2",
    "US20160195733A1",
    "WO2014164550A2",
    "WO2014159721A1",
    "WO2014160142A1",
    "US9124831B2",
    "US10091405B2",
    "WO2014159779A1",
    "US20170163862A1",
    "WO2014153098A1",
    "US20160198096A1",
    "US20190037116A1",
    "US9787911B2",
    "US20140267829A1",
    "US9100586B2",
    "US20180035057A1",
    "US20160044252A1",
    "US9578259B2",
    "US20180302554A1",
    "WO2014149403A1",
    "US9497370B2",
    "US20150312455A1",
    "US20140267286A1",
    "EP2973476A1",
    "JP2016524125A",
    "US10182216B2",
    "US10122993B2",
    "US9633442B2",
    "US20190089947A1",
    "WO2014149902A1",
    "US9955070B2",
    "US20150264337A1",
    "US20170099465A1",
    "US9800859B2",
    "US9438888B2",
    "WO2014150856A1",
    "WO2014144157A1",
    "US9602805B2",
    "US20140267762A1",
    "US20140267633A1",
    "WO2014145856A1",
    "US9445003B1",
    "US20170070673A1",
    "US20150161798A1",
    "US9497429B2",
    "US20150002734A1",
    "US9898856B2",
    "US20150091900A1",
    "US20180240265A1",
    "WO2015048694A2",
    "US20150098079A1",
    "US20150104101A1",
    "US20150124151A1",
    "WO2015070105A1",
    "US9264592B2",
    "US9426343B2",
    "US20170070672A1",
    "US9185276B2",
    "EP3066690A1",
    "US9924092B2",
    "US20150124113A1",
    "US20150122411A1",
    "US20150138346A1",
    "US20190063905A1",
    "US10119808B2",
    "WO2015074078A1",
    "EP3075140A1",
    "US20190098209A1",
    "US20150146030A1",
    "US9813617B2",
    "US9456134B2",
    "US20150146029A1",
    "WO2015081279A1",
    "EP3075140B1",
    "US9426361B2",
    "US20170078568A1",
    "US20180139382A1",
    "US20150244927A1",
    "US20150243480A1",
    "US10089740B2",
    "US20190037150A1",
    "US20150254868A1",
    "WO2015134996A1",
    "US20170188011A1",
    "WO2015183824A1",
    "US9521319B2",
    "US20150373261A1",
    "US20160065934A1",
    "US20170244960A1",
    "WO2016054089A1",
    "JP2017531976A",
    "KR20170063827A"
  ]
}