Systems and methods for decoding image files containing depth maps stored as metadata

{
  "publication_number": "US10430682B2",
  "country": "US",
  "kind": "B2",
  "title": "Systems and methods for decoding image files containing depth maps stored as metadata",
  "abstract": "Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.",
  "claims": [
    "1. A system for rendering an image using an image container file, the system comprising: a processor; and memory containing a rendering application and an image container file, wherein the image container file comprises: an encoded image synthesized from a plurality of images captured by a plurality of heterogeneous cameras, wherein each camera of the plurality of heterogeneous cameras captures the scene from a different viewpoint; a depth map that specifies depths from a reference viewpoint for pixels in the encoded image based on disparity between pixels of the plurality of images; an auxiliary map that provides information corresponding to pixel locations within a synthesized image; and metadata describing the image container file, wherein the metadata comprises offset information to locate the encoded image, the depth map, and the auxiliary map; wherein the rendering application configures the processor to: locate the encoded image within the image container file; decode the encoded image; locate the depth map and the auxiliary map within the image container file; and post process the decoded image to apply a depth based effect to the pixels of the decoded image based on the depth map, the auxiliary map, and the metadata to create a rendered image.",
    "2. The system of claim 1, wherein the image container file further comprises at least one of the plurality of images captured by the plurality of heterogeneous cameras.",
    "3. The system of claim 2, wherein post processing the decoded image comprises interpolating to fill in occluded pixels based on adjacent pixels that are not occluded.",
    "4. The system of claim 1, wherein the metadata further comprises occluded pixel data for pixels that are occluded.",
    "5. The system of claim 1, wherein the encoded image is focused at a first focal plane, wherein post processing comprises modifying the pixels so that the rendered image is focused at a different, second focal plane.",
    "6. The system of claim 1, wherein the depth based effect simulates motion parallax in the decoded image.",
    "7. The system of claim 1, wherein the depth based effect simulates a dolly zoom in the decoded image.",
    "8. The system of claim 1, wherein at least one of the plurality of images have a lower resolution than the encoded image.",
    "9. The system of claim 1, wherein the encoded image is synthesized from a first image from a first viewpoint and a second image from a second viewpoint, wherein the encoded image is synthesized from a different, third viewpoint.",
    "10. The system of claim 1, wherein at least one of the depth map and the auxiliary map are encoded as an image.",
    "11. A method for rendering an image using an image container file, the method comprising: locating the encoded image within an image container file, wherein the image container file comprises: an encoded image synthesized from a plurality of images captured by a plurality of heterogeneous cameras, wherein each camera of the plurality of heterogeneous cameras captures the scene from a different viewpoint; a depth map that specifies depths from a reference viewpoint for pixels in the encoded image based on disparity between pixels of the plurality of images; an auxiliary map that provides information corresponding to pixel locations within a synthesized image; and metadata describing the image container file, wherein the metadata comprises offset information to locate the encoded image, the depth map, and the auxiliary map; decoding the encoded image; locating the depth map and the auxiliary map within the image container file; and post processing the decoded image to apply a depth based effect to the pixels of the decoded image based on the depth map, the auxiliary map, and the metadata to create a rendered image.",
    "12. The method of claim 11, wherein the image container file further comprises at least one of the plurality of images captured by the plurality of heterogeneous cameras.",
    "13. The method of claim 12, wherein post processing the decoded image comprises interpolating to fill in occluded pixels based on adjacent pixels that are not occluded.",
    "14. The method of claim 11, wherein the metadata further comprises occluded pixel data for pixels that are occluded.",
    "15. The method of claim 11, wherein the encoded image is focused at a first focal plane, wherein post processing comprises modifying the pixels so that the rendered image is focused at a different, second focal plane.",
    "16. The method of claim 11, wherein the depth based effect simulates motion parallax in the decoded image.",
    "17. The method of claim 11, wherein the depth based effect simulates a dolly zoom in the decoded image.",
    "18. The method of claim 11, wherein at least one of the plurality of images have a lower resolution than the encoded image.",
    "19. The method of claim 11, wherein the encoded image is synthesized from a first image from a first viewpoint and a second image from a second viewpoint, wherein the encoded image is synthesized from a different, third viewpoint.",
    "20. The method of claim 11, wherein at least one of the depth map and the auxiliary map are encoded as an image."
  ],
  "description_excerpt": "The present invention relates to decoding of image files and more specifically to the decoding of light field image files.\n\nThe ISO/IEC 10918-1 standard, more commonly referred to as the JPEG standard after the Joint Photographic Experts Group that developed the standard, establishes a standard process for digital compression and coding of still images. The JPEG standard specifies a codec for compressing an image into a bitstream and for decompressing the bitstream back into an image.\n\nA variety of container file formats including the JPEG File Interchange Format (JFIF) specified in ISO/IEC 10918-5 and the Exchangeable Image File Format (Exif) and can be used to store a JPEG bitstream. JFIF can be considered a minimal file format that enables JPEG bitstreams to be exchanged between a wide variety of platforms and applications. The color space used in JFIF files is YCbCr as defined by CCIR Recommendation 601, involving 256 levels. The Y, Cb, and Cr components of the image file are converted from R, G, and B, but are normalized so as to occupy the full 256 levels of an 8-bit binary encoding. YCbCr is one of the compression formats used by JPEG. Another popular option is to perform compression directly on the R, G and B color planes. Direct RGB color plane compression is also popular when lossless compression is being applied.\n\nA JPEG bitstream stores 16-bit word values in big-endian format. JPEG data in general is stored as a stream of blocks, and each block is identified by a marker value. The first two bytes of every JPEG bitstream are the Start Of Image (SOI) marker values FFh D8h.",
  "cpc": [
    "H04N 13/178",
    "G06K 9/36",
    "G06T 15/08",
    "G06T 2207/10052",
    "G06T 3/4007",
    "G06T 3/4053",
    "G06T 7/50",
    "G06T 7/596",
    "G06T 9/00",
    "G06T 9/20",
    "H04N 13/128",
    "H04N 13/139",
    "H04N 13/161",
    "H04N 13/243",
    "H04N 13/271",
    "H04N 19/136",
    "H04N 19/593",
    "H04N 19/597",
    "H04N 19/625",
    "H04N 19/70",
    "H04N 19/85",
    "H04N 2013/0081"
  ],
  "ipc": [
    "G06K 9/36",
    "G06T 15/08",
    "G06T 3/40",
    "G06T 7/50",
    "G06T 7/593",
    "G06T 9/00",
    "G06T 9/20",
    "H04N 13/128",
    "H04N 13/161",
    "H04N 13/243",
    "H04N 13/271",
    "H04N 19/136",
    "H04N 19/597",
    "H04N 19/625",
    "H04N 19/85"
  ],
  "assignees": [
    "Fotonation Ireland Ltd"
  ],
  "inventors": [
    "Kartik Venkataraman",
    "Semyon Nisenzon",
    "Dan Lelescu"
  ],
  "filing_date": "2018-07-09",
  "publication_date": "2019-10-01",
  "grant_date": "2019-10-01",
  "priority_date": "2011-09-28",
  "application_number": "US-201816030597-A",
  "family_id": "47911367",
  "cited_by_count": 59,
  "citations": [
    "US4124798A",
    "US4198646A",
    "US4323925A",
    "US4467365A",
    "JPS5925483A",
    "US4652909A",
    "US4460449A",
    "JPS6140709A",
    "US4899060A",
    "JPS6437177A",
    "US5005083A",
    "US5070414A",
    "JPH02285772A",
    "US5157499A",
    "US5144448A",
    "US5488674A",
    "US5325449A",
    "US5327125A",
    "JPH06129851A",
    "US6130786A",
    "JPH0715457A",
    "EP0677821A2",
    "US5638461A",
    "US5629524A",
    "US5933190A",
    "US5963664A",
    "US6175379B1",
    "US6005607A",
    "US5833507A",
    "US5880691A",
    "JPH09171075A",
    "JPH09181913A",
    "US5793900A",
    "US6124974A",
    "US5973844A",
    "US20020039438A1",
    "US5832312A",
    "US5911008A",
    "US6002743A",
    "US6034690A",
    "US6141048A",
    "US6137535A",
    "EP0840502A2",
    "US5808350A",
    "US20020113867A1",
    "JPH10253351A",
    "US5801919A",
    "US6097394A",
    "US20010005225A1",
    "US6563537B1",
    "US6163414A",
    "US6765617B1",
    "JPH11142609A",
    "US6069365A",
    "US6239909B1",
    "US20020101528A1",
    "JPH11223708A",
    "US6172352B1",
    "US6160909A",
    "US7333651B1",
    "US6445815B1",
    "US6909121B2",
    "EP0957642B1",
    "EP0957642A2",
    "US6373518B1",
    "JPH11325889A",
    "US6205241B1",
    "US6137100A",
    "US6069351A",
    "US6903770B1",
    "US6340994B1",
    "US20010019621A1",
    "US20030190072A1",
    "US6879735B1",
    "US20020027608A1",
    "US6750904B1",
    "US6477260B1",
    "US6611289B1",
    "JP2000209503A",
    "US6603513B1",
    "US20020171666A1",
    "US20020012056A1",
    "US20020063807A1",
    "US6819358B1",
    "US6292713B1",
    "US7924321B2",
    "JP2001008235A",
    "US6627896B1",
    "US6801653B1",
    "US20020122113A1",
    "US7015954B1",
    "US6647142B1",
    "US6771833B1",
    "US6628330B1",
    "US6358862B1",
    "US6552742B1",
    "US6639596B1",
    "US6774941B1",
    "US6671399B1",
    "US6674892B1",
    "US6819328B1",
    "US7161614B1",
    "US20010038387A1",
    "US7295697B1",
    "US20060210186A1",
    "US20030140347A1",
    "US6502097B1",
    "US6476805B1",
    "JP2001194114A",
    "US20020120634A1",
    "JP2001264033A",
    "US6571466B1",
    "JP2001277260A",
    "US20010028038A1",
    "US20020015536A1",
    "JP2001337263A",
    "US6985175B2",
    "US7245761B2",
    "US20040056966A1",
    "US20070052825A1",
    "US20020028014A1",
    "US7085409B2",
    "US20020061131A1",
    "US20020057845A1",
    "US20040207600A1",
    "US7262799B2",
    "JP2002205310A",
    "EP1201407A2",
    "US6657218B2",
    "US20030231179A1",
    "US6788338B1",
    "US20020075450A1",
    "US20040151401A1",
    "US20040071367A1",
    "JP2002252338A",
    "US20020113888A1",
    "JP2002195910A",
    "US20020089596A1",
    "US20020087403A1",
    "US20020094027A1",
    "JP2002250607A",
    "US20020118113A1",
    "EP1243945A2",
    "EP1243945B1",
    "US20020163054A1",
    "US6635941B2",
    "US20020177054A1",
    "US6443579B1",
    "US20050205785A1",
    "US20020167537A1",
    "US7235785B2",
    "US20020190991A1",
    "US20050068436A1",
    "US7738013B2",
    "US20030124763A1",
    "US6525302B2",
    "US20020195548A1",
    "US20030025227A1",
    "US20110211077A1",
    "US7369165B2",
    "JP2003094445A",
    "JP2003139910A",
    "US20030086079A1",
    "JP2003163938A",
    "US6927922B2",
    "US20030156189A1",
    "US20080025649A1",
    "US20030179418A1",
    "US20120044249A1",
    "US20110090217A1",
    "US8254668B2",
    "JP2003298920A",
    "US20030188659A1",
    "US7215364B2",
    "EP1355274A2",
    "US20030198377A1",
    "US6917702B2",
    "US6795253B2",
    "US20030211405A1",
    "US20040234873A1",
    "CN1669332A",
    "US20050175257A1",
    "US6897454B2",
    "US20040003409A1",
    "US20040047274A1",
    "US20040066454A1",
    "US20040008271A1",
    "US20060049930A1",
    "US20040012689A1",
    "US20040027358A1",
    "US7639838B2",
    "US20040096119A1",
    "US20040050104A1",
    "US20040207836A1",
    "US20040061787A1",
    "US20090263017A1",
    "US20040075654A1",
    "US20060072029A1",
    "US20040100570A1",
    "US20120176479A1",
    "US20040105021A1",
    "US20040114807A1",
    "JP2004221585A",
    "US20040141659A1",
    "US7706634B2",
    "US20050012035A1",
    "US20060138322A1",
    "US20060038891A1",
    "US20040213449A1",
    "US8164629B1",
    "US8773536B1",
    "US20040165090A1",
    "US20060203113A1",
    "US20040170340A1",
    "US20040169617A1",
    "US20040174439A1",
    "US20040179008A1",
    "US20040179834A1",
    "US7206449B2",
    "US20040196379A1",
    "US7425984B2",
    "US20070127831A1",
    "US20040239885A1",
    "US6958862B1",
    "US20040218809A1",
    "US20070171290A1",
    "US20070040828A1",
    "US7657090B2",
    "US20040239782A1",
    "US20040240052A1",
    "US20050009313A1",
    "US20040251509A1",
    "US20050048690A1",
    "US20040264806A1",
    "US8098304B2",
    "US20050006477A1",
    "US20050010621A1",
    "CN1839394A",
    "US20050007461A1",
    "US20090237520A1",
    "US20050036778A1",
    "US20050047678A1",
    "US20050084179A1",
    "US20050151759A1",
    "JP2005116022A",
    "US20050083531A1",
    "US20050134699A1",
    "US20110141309A1",
    "US7840067B2",
    "US20060203100A1",
    "US20070158427A1",
    "US20070160310A1",
    "US20050128509A1",
    "US20050132098A1",
    "WO2005057922A1",
    "US20050128595A1",
    "JP2005181460A",
    "US20050134698A1",
    "US20050134712A1",
    "JP2007520107A",
    "US20050147277A1",
    "US7496293B2",
    "US20060221250A1",
    "US20050168924A1",
    "US20050185711A1",
    "US8077245B2",
    "JP2006047944A",
    "US20080019611A1",
    "US20050219264A1",
    "US7633511B2",
    "JP2005295381A",
    "US20050219363A1",
    "US20050224843A1",
    "US20050225654A1",
    "US7620265B1",
    "JP2005303694A",
    "US7292735B2",
    "US20080310501A1",
    "US20060034531A1",
    "US20070225600A1",
    "JP2005341569A",
    "US20050275946A1",
    "US20050265633A1",
    "JP2005354124A",
    "US20060013318A1",
    "US20050286756A1",
    "US20050286612A1",
    "US20060007331A1",
    "US20060002635A1",
    "JP2006033228A",
    "JP2006033493A",
    "US20060243889A1",
    "US20060018509A1",
    "US8027531B2",
    "JP2008507874A",
    "US20090050946A1",
    "US20060023197A1",
    "US20060023314A1",
    "US20060176566A1",
    "US20060028476A1",
    "US20060029270A1",
    "US20060029271A1",
    "US20080117289A1",
    "US20060039611A1",
    "US20060033005A1",
    "US20060035415A1",
    "US20060034003A1",
    "US20070247517A1",
    "US20080030597A1",
    "US20060054782A1",
    "US20100060746A9",
    "US20080174670A1",
    "US20070211164A1",
    "US20090302205A9",
    "US20100208100A9",
    "CN101427372A",
    "US7199348B2",
    "US20110108708A1",
    "US20070139333A1",
    "CN101010619A",
    "US20060046204A1",
    "US20060050980A1",
    "US20060055811A1",
    "US20060054780A1",
    "US20070126898A1",
    "US20060069478A1",
    "US20090052743A1",
    "WO2006039906A2",
    "WO2006039906A3",
    "US20060087747A1",
    "US20060098888A1",
    "US7741620B2",
    "US20070296721A1",
    "US20100002126A1",
    "US20060103754A1",
    "US20060289772A1",
    "US20060125936A1",
    "US20070030356A1",
    "US20120062756A1",
    "US20100133418A1",
    "US20060210146A1",
    "US7430312B2",
    "US20060152803A1",
    "US20100220212A1",
    "US20090167922A1",
    "US20060157640A1",
    "US20060159369A1",
    "US20060197937A1",
    "US7965314B1",
    "US20060187338A1",
    "US7912673B2",
    "JP2006258930A",
    "US20080156991A1",
    "US20090201371A1",
    "CN101147392A",
    "US20060214085A1",
    "US20060239549A1",
    "US7956871B2",
    "US20060251410A1",
    "US20090147919A1",
    "US20060274174A1",
    "US20060278948A1",
    "US20060279648A1",
    "US20070008575A1",
    "EP1734766A2",
    "US20070035707A1",
    "US20090140131A1",
    "US20070002159A1",
    "US20070102622A1",
    "US20070009150A1",
    "US20090268983A1",
    "WO2007013250A1",
    "US20070024614A1",
    "US20090127430A1",
    "US20110221939A1",
    "US20070036427A1",
    "US20070041391A1",
    "US20070040922A1",
    "US20070257184A1",
    "US7564019B2",
    "US20070296835A1",
    "US20130027580A1",
    "US20070258006A1",
    "US20070083114A1",
    "US7408725B2",
    "US20080218610A1",
    "US7723662B2",
    "US20070085917A1",
    "US8300085B2",
    "US20070092245A1",
    "US20080211737A1",
    "US20070146511A1",
    "US20090207235A1",
    "US7599547B2",
    "US20070165931A1",
    "US20070140685A1",
    "US20070153335A1",
    "US20070146503A1",
    "US8089515B2",
    "US20070159541A1",
    "US7675080B2",
    "WO2007083579A1",
    "US20090179142A1",
    "US20070182843A1",
    "US20070201859A1",
    "US7391572B2",
    "US20070206241A1",
    "US20070216765A1",
    "US8360574B2",
    "US7606484B1",
    "JP2007259136A",
    "US20070228256A1",
    "US8044994B2",
    "US20080043096A1",
    "US20080043095A1",
    "US20070236595A1",
    "US20070242141A1",
    "CN101064780A",
    "US20070263114A1",
    "US20070258706A1",
    "WO2007134137A2",
    "US20070263113A1",
    "US20070268374A1",
    "US8194296B2",
    "US20110285910A1",
    "US8169486B2",
    "US20070177004A1",
    "US20070296832A1",
    "US7990447B2",
    "US20080006859A1",
    "US20070296847A1",
    "US20070297696A1",
    "CN101102388A",
    "US20080024683A1",
    "JP2008039852A",
    "US20080030592A1",
    "US20080062164A1",
    "US8406562B2",
    "US8854462B2",
    "US8687087B2",
    "US20080056302A1",
    "JP2008055908A",
    "US20080054518A1",
    "US20110149409A1",
    "US20110149408A1",
    "US20080088793A1",
    "US20080079805A1",
    "US20080080028A1",
    "US20080084486A1",
    "WO2008045198A2",
    "US20100091389A1",
    "CN101606086A",
    "US20100133230A1",
    "US20080273751A1",
    "US20080095523A1",
    "US7986018B2",
    "WO2008050904A1",
    "US20100103175A1",
    "US20080099804A1",
    "US20080106620A1",
    "US20080112059A1",
    "US20080112635A1",
    "US20080118241A1",
    "US20100074532A1",
    "US7826153B2",
    "US20080131107A1",
    "US20080131019A1",
    "US8559705B2",
    "US20140013273A1",
    "EP2104334A1",
    "US8242426B2",
    "US7646549B2",
    "US20080152296A1",
    "TW200828994A",
    "US20080151097A1",
    "US20080152215A1",
    "US20080158259A1",
    "US20080158375A1",
    "US20080158698A1",
    "US20080165257A1",
    "JP2008172735A",
    "US20090273663A1",
    "US8655052B2",
    "US7675681B2",
    "US20080187305A1",
    "US7667824B1",
    "US20080193026A1",
    "US8130120B2",
    "WO2008108271A1",
    "WO2008108926A1",
    "US20080218611A1",
    "US20080218613A1",
    "US20080219654A1",
    "US20080218612A1",
    "US20080247638A1",
    "US20090060281A1",
    "US20080239116A1",
    "US8055466B2",
    "US20080240598A1",
    "US8493496B2",
    "US20080247653A1",
    "US8213711B2",
    "JP2008258885A",
    "US7639435B2",
    "US20090152664A1",
    "US20100111444A1",
    "US20080272416A1",
    "US20080278591A1",
    "US20080278610A1",
    "US20080284880A1",
    "US20080291295A1",
    "US20080298674A1",
    "WO2008150817A1",
    "US8290358B1",
    "US20100195716A1",
    "US20100182406A1",
    "US20120153153A1",
    "US20090027543A1",
    "US8559756B2",
    "US20100202054A1",
    "EP2026563A1",
    "US7782364B2",
    "JP2009064421A",
    "US20090066693A1",
    "US7973834B2",
    "US20090079862A1",
    "US20090086074A1",
    "US20090091645A1",
    "US20090091806A1",
    "US8541730B2",
    "US20090096050A1",
    "US20090175349A1",
    "US20090102956A1",
    "US20090103792A1",
    "TW200939739A",
    "US20090109306A1",
    "US20100223237A1",
    "US20090128833A1",
    "US20090128644A1",
    "US20090129667A1",
    "US8126279B2",
    "JP2009132010A",
    "US20100309292A1",
    "US20090141933A1",
    "US20100265346A1",
    "WO2009073950A1",
    "US8000498B2",
    "US20090167934A1",
    "US8180145B2",
    "US20110031381A1",
    "US20100289941A1",
    "US20090180021A1",
    "US20110211824A1",
    "US8189065B2",
    "US8244027B2",
    "US20110064327A1",
    "US20110043661A1",
    "US20090200622A1",
    "US20090225203A1",
    "US20120176481A1",
    "US20090219435A1",
    "US20090245573A1",
    "US20110018973A1",
    "US20100013927A1",
    "US20090256947A1",
    "US20090268192A1",
    "US8280194B2",
    "US20090268970A1",
    "US20090274387A1",
    "US20110121421A1",
    "US20090279800A1",
    "US20090284651A1",
    "US20180048830A1",
    "US20170006233A1",
    "US9055233B2",
    "US9060124B2",
    "US9060120B2",
    "US9077893B2",
    "US9094661B2",
    "US9124815B2",
    "US9191580B2",
    "US9188765B2",
    "US20140368662A1",
    "US9235898B2",
    "US20140368685A1",
    "US20140354844A1",
    "US20160227195A1",
    "US20160267665A1",
    "US9041829B2",
    "US9041823B2",
    "US20160269650A1",
    "US20140354843A1",
    "US20110069189A1",
    "US20110080487A1",
    "US9485496B2",
    "US9049367B2",
    "WO2009151903A2",
    "US20140354855A1",
    "US9576369B2",
    "CN102037717A",
    "US10142560B2",
    "US20140354853A1",
    "US20140354854A1",
    "US9712759B2",
    "US9749547B2",
    "JP2017163550A",
    "US20180007284A1",
    "KR101843994B1",
    "US20140368684A1",
    "US20150009354A1",
    "EP3328048A1",
    "US10027901B2",
    "US20150009362A1",
    "US20140368683A1",
    "US20140355870A1",
    "US20140354773A1",
    "US20150009353A1",
    "JP2011523538A",
    "US8866920B2",
    "US8885059B1",
    "US20140333787A1",
    "US20140333764A1",
    "US20140333731A1",
    "US20140340539A1",
    "US8896719B1",
    "US20140347509A1",
    "US8902321B2",
    "US20090290811A1",
    "US8830375B2",
    "US20110032370A1",
    "US20090297056A1",
    "US8131097B2",
    "US8244058B1",
    "JP2009300268A",
    "US20090317061A1",
    "WO2009157273A1",
    "US20090323206A1",
    "US20090322876A1",
    "US20090323195A1",
    "US20090324118A1",
    "US20100002314A1",
    "US20100002313A1",
    "US8456517B2",
    "US20100007714A1",
    "US8284240B2",
    "US20110142138A1",
    "US20100044815A1",
    "US20100045809A1",
    "US20100053600A1",
    "US20110181797A1",
    "US8098297B2",
    "US20100053342A1",
    "US20100073463A1",
    "US8553093B2",
    "WO2010037512A1",
    "JP2012504805A",
    "US20100085351A1",
    "US20100086227A1",
    "US20100085425A1",
    "US20130259317A1",
    "US20100103259A1",
    "US20130229540A1",
    "US20100097491A1",
    "US20110255592A1",
    "US20100103308A1",
    "US20100118127A1",
    "US20110255745A1",
    "US20100142839A1",
    "US20100129048A1",
    "US8279325B2",
    "US20100128145A1",
    "US8111910B2",
    "US8289440B2",
    "US20120327222A1",
    "US20100141802A1",
    "US8013904B2",
    "JP2010139288A",
    "US20100142828A1",
    "US8149323B2",
    "US20100157073A1",
    "US20100166410A1",
    "US20100165152A1",
    "US20100171866A1",
    "US20110274175A1",
    "EP2381418A1",
    "US20100177411A1",
    "US20110292216A1",
    "US8189089B1",
    "US8315476B1",
    "US20100194901A1",
    "US20100194860A1",
    "US20100202683A1",
    "US20110285701A1",
    "US20100201834A1",
    "US20120155830A1",
    "US20100225740A1",
    "US8294754B2",
    "US20100231285A1",
    "US20100238327A1",
    "US8106949B2",
    "US20100244165A1",
    "US20100245684A1",
    "US20120026297A1",
    "US20100254627A1",
    "US20120026366A1",
    "US20100259610A1",
    "US8294099B2",
    "US20100265381A1",
    "US20140118493A1",
    "US20120249550A1",
    "US20100265385A1",
    "US20110234841A1",
    "EP2244484A1",
    "US20110044502A1",
    "US20100290483A1",
    "US20100281070A1",
    "US20120127275A1",
    "US20100302423A1",
    "US20100309368A1",
    "US20140139643A1",
    "US20100321595A1",
    "US20100321640A1",
    "US20100329556A1",
    "WO2011008443A2",
    "JP2011030184A",
    "US20110001037A1",
    "JP2011017764A",
    "US8345144B1",
    "US20110019243A1",
    "US8212914B2",
    "US20110019048A1",
    "US20140009586A1",
    "US20110032341A1",
    "US20110033129A1",
    "US8577183B2",
    "US20120113413A1",
    "US20110038536A1",
    "US20110043665A1",
    "US20110043668A1",
    "US20110051255A1",
    "US20110055729A1",
    "US8411146B2",
    "WO2011026527A1",
    "US20120170134A1",
    "US20140076336A1",
    "US8754941B1",
    "US20120188341A1",
    "US20110228142A1",
    "WO2011046607A2",
    "US20120200669A1",
    "JP2013509022A",
    "US20110085028A1",
    "US20110169994A1",
    "US20110207074A1",
    "US20140098267A1",
    "US20120019530A1",
    "WO2011055655A1",
    "US20120229628A1",
    "EP2339532A1",
    "US20110115886A1",
    "JP2011109484A",
    "EP2502115A2",
    "US8514491B2",
    "US20140368686A1",
    "US20110122308A1",
    "WO2011063347A2",
    "US9264610B2",
    "US8861089B2",
    "US20170187933A1",
    "US20160269664A1",
    "US20130308197A1",
    "WO2011063347A3",
    "US20110128412A1",
    "US20110129165A1",
    "US20110128393A1",
    "US8400555B1",
    "EP2336816A2",
    "US8446492B2",
    "US20110273531A1",
    "US20120249750A1",
    "US20110150321A1",
    "US20110153248A1",
    "US20120262607A1",
    "US20110157321A1",
    "US9019426B2",
    "US8514291B2",
    "US20110157451A1",
    "US8289409B2",
    "US20110176020A1",
    "US20110206291A1",
    "US20110193944A1",
    "US20110200319A1",
    "US20110199458A1",
    "US20150332468A1",
    "US8648918B2",
    "US20130033579A1",
    "KR20110097647A",
    "WO2011105814A2",
    "US20120314033A1",
    "US20120314937A1",
    "US9456196B2",
    "US20110221658A1",
    "JP2011203238A",
    "US20110211068A1",
    "US20130120605A1",
    "US20110221599A1",
    "US20110222757A1",
    "US20110221950A1",
    "WO2011116203A1",
    "US8231814B2",
    "US20120198677A1",
    "US20110241234A1",
    "US20120147139A1",
    "US20110228144A1",
    "US20110298917A1",
    "US20110243428A1",
    "US20110242355A1",
    "US20110242342A1",
    "US20110242356A1",
    "US20120081519A1",
    "US8565547B2",
    "US20110261993A1",
    "US20110267264A1",
    "US20110267348A1",
    "US20130250150A1",
    "US9256974B1",
    "US20110274366A1",
    "US20110298898A1",
    "US20120057040A1",
    "US20160269627A1",
    "US20110279721A1",
    "US20130147979A1",
    "US9936148B2",
    "US8576302B2",
    "US20120012748A1",
    "WO2011143501A1",
    "KR101824672B1",
    "US8928793B2",
    "US20170048468A1",
    "JP2013526801A",
    "US20110279705A1",
    "US20110285866A1",
    "US20120114224A1",
    "US20110300929A1",
    "US20120062697A1",
    "US20130120536A1",
    "US20110310980A1",
    "US20110317766A1",
    "US20110316968A1",
    "CN101883291A",
    "US20130088489A1",
    "US20130113888A1",
    "GB2482022A",
    "US20120014456A1",
    "US20120023456A1",
    "US20120019700A1",
    "US20120026342A1",
    "US20120026451A1",
    "CN102375199A",
    "US20120039525A1",
    "US8977038B2",
    "US8836793B1",
    "US20120044372A1",
    "US20130128069A1",
    "US20130128087A1",
    "US20130128068A1",
    "US20120051624A1",
    "US20120056982A1",
    "US20120062702A1",
    "US20130128121A1",
    "US20130176394A1",
    "US20130162641A1",
    "US20120069235A1",
    "US20130222556A1",
    "US20120086803A1",
    "WO2012057620A2",
    "WO2012057622A1",
    "WO2012057621A1",
    "WO2012057620A3",
    "WO2012057619A1",
    "WO2012057623A1",
    "US20120105590A1",
    "US20140146132A1",
    "US20120105691A1",
    "US20120113318A1",
    "US20120113232A1",
    "WO2012074361A1",
    "US20130258067A1",
    "WO2012078126A1",
    "US20150036014A1",
    "US20150036015A1",
    "EP2652678A1",
    "US8878950B2",
    "US20150042833A1",
    "US9361662B2",
    "US20120147205A1",
    "US9047684B2",
    "SG191151A1",
    "US9041824B2",
    "WO2012082904A1",
    "US20170053382A1",
    "EP2652678B1",
    "US20120154551A1",
    "US20120163672A1",
    "US8682107B2",
    "US20120169433A1",
    "TWI535292B",
    "TW201228382A",
    "US8842201B2",
    "US20120188634A1",
    "US8581995B2",
    "US20120188389A1",
    "US20120188420A1",
    "US20120188235A1",
    "US20140037140A1",
    "US20120200734A1",
    "US20120200726A1",
    "US20120206582A1",
    "US20140176592A1",
    "US20120293695A1",
    "US20120219236A1",
    "US20120224083A1",
    "US20120262601A1",
    "US20120229602A1",
    "US20120237114A1",
    "US20120249853A1",
    "US20120249836A1",
    "US20120250990A1",
    "US9030528B2",
    "US20120268574A1",
    "US20120274626A1",
    "US20140059462A1",
    "US20130057710A1",
    "US20140218546A1",
    "WO2012155119A1",
    "US8305456B1",
    "US20160269626A1",
    "US8692893B2",
    "US9197821B2",
    "US20120287291A1",
    "US20120290257A1",
    "US20120293624A1",
    "US20120293489A1",
    "US20120307099A1",
    "US20120307093A1",
    "US20140085502A1",
    "US9635274B2",
    "US8885922B2",
    "US20130003184A1",
    "US8804255B2",
    "US20130265459A1",
    "US20140347748A1",
    "US9578237B2",
    "WO2013003276A1",
    "US20150296137A1",
    "US9516222B2",
    "JP2014521117A",
    "US9128228B2",
    "US20130002828A1",
    "US20130010073A1",
    "US20130016885A1",
    "US20130016245A1",
    "US20130022111A1",
    "US20130033585A1",
    "US20140192154A1",
    "US20130038696A1",
    "US20130050526A1",
    "US8866951B2",
    "US20130050504A1",
    "US20130047396A1",
    "US20160316140A1",
    "US20130070060A1",
    "US20140098266A1",
    "WO2013043761A1",
    "US9794476B2",
    "WO2013043751A1",
    "US20180097993A1",
    "US20130215231A1",
    "US20140198188A1",
    "US20130077859A1",
    "US20150055884A1",
    "US20170178363A1",
    "IN2014CN02708A",
    "US10275676B2",
    "US20150199793A1",
    "US20150199841A1",
    "US9536166B2",
    "US20130077880A1",
    "US9129183B2",
    "CN107230236A",
    "US20130077882A1",
    "CN104081414A",
    "US20180197035A1",
    "US10019816B2",
    "JP2017163587A",
    "US9042667B2",
    "US20130076967A1",
    "US9811753B2",
    "US9036928B2",
    "US9036931B2",
    "US9031335B2",
    "US9031343B2",
    "WO2013049699A1",
    "US9031342B2",
    "US9864921B2",
    "US9025894B2",
    "US8542933B2",
    "US20140369612A1",
    "US9025895B2",
    "US20140369615A1",
    "CN104081414B",
    "US8831367B2",
    "JP6140709B2",
    "JP2014535191A",
    "US20140376826A1",
    "US20140376825A1",
    "EP2761534A1",
    "US20150003753A1",
    "US20150003752A1",
    "US20150015669A1",
    "US20130083172A1",
    "US20160165106A1",
    "US20130088637A1",
    "WO2013055960A1",
    "US20130093842A1",
    "US20130107061A1",
    "US20130250123A1",
    "US20130113899A1",
    "US20130113939A1",
    "US20140313315A1",
    "US20130121559A1",
    "US20130127988A1",
    "US9661310B2",
    "US20130135448A1",
    "US20130135315A1",
    "US20140300706A1",
    "US20130155050A1",
    "US20130169754A1",
    "WO2013119706A1",
    "US20130208138A1",
    "EP2817955A1",
    "US9412206B2",
    "WO2013126578A1",
    "US20130215108A1",
    "US20170365104A1",
    "US20150235476A1",
    "US9754422B2",
    "EP2817955B1",
    "US9413953B2",
    "US20130223759A1",
    "US20130222656A1",
    "US20130230237A1",
    "US20140125771A1",
    "US20130274923A1",
    "US20130274596A1",
    "US20130286236A1",
    "CN104335246B",
    "WO2013166215A1",
    "US20130293760A1",
    "US9706132B2",
    "US9210392B2",
    "US20160165147A1",
    "CN104335246A",
    "US20150085073A1",
    "US20140146201A1",
    "US20130321581A1",
    "US20150124059A1",
    "US20130335598A1",
    "US9807382B2",
    "WO2014005123A1",
    "US9100635B2",
    "JP2015534734A",
    "US20140002675A1",
    "CN104508681A",
    "US20150326852A1",
    "US20180109782A1",
    "EP2873028A1",
    "US20150104076A1",
    "US20140002674A1",
    "US20180081090A1",
    "US9766380B2",
    "EP2867718A1",
    "US8896594B2",
    "US20160266284A1",
    "WO2014004134A1",
    "JP2015522178A",
    "US20140037137A1",
    "US20140043507A1",
    "US8780113B1",
    "WO2014031795A1",
    "US8619082B1",
    "US20150049916A1",
    "US20150049915A1",
    "US20140321712A1",
    "EP2888720A1",
    "US20180211402A1",
    "US9123117B2",
    "US9123118B2",
    "CN104662589A",
    "US20150049917A1",
    "US20150042767A1",
    "CN107346061A",
    "US9129377B2",
    "US20150042766A1",
    "US9858673B2",
    "US9240049B2",
    "US9235900B2",
    "US20160267672A1",
    "US9147254B2",
    "WO2014032020A2",
    "CN104685513B",
    "CN104685513A",
    "EP2888698A2",
    "WO2014032020A3",
    "US9813616B2",
    "US20180124311A1",
    "US20160165134A1",
    "US20150248744A1",
    "US9214013B2",
    "US20140079336A1",
    "US20140081454A1",
    "US20140078333A1",
    "US20160255333A1",
    "CN104685860A",
    "US20140092281A1",
    "WO2014052974A2",
    "EP2901671A2",
    "US20140104490A1",
    "US20140118584A1",
    "US20160249001A1",
    "WO2014078443A1",
    "US20140132810A1",
    "US9749568B2",
    "US9143711B2",
    "US20150085174A1",
    "US9001226B1",
    "US20140186045A1",
    "US20140183334A1",
    "US20140192253A1",
    "US20180024330A1",
    "US20140204183A1",
    "US9769365B1",
    "US20170257562A1",
    "WO2014130849A1",
    "US20140232822A1",
    "US20170054901A1",
    "US9462164B2",
    "US10009538B2",
    "US20170085845A1",
    "US9743051B2",
    "WO2014133974A1",
    "US9774831B2",
    "US20140240529A1",
    "US9253380B2",
    "US9374512B2",
    "US20140240528A1",
    "US20160269651A1",
    "WO2014133974A9",
    "US9638883B1",
    "US20160044257A1",
    "US9917998B2",
    "US9774789B2",
    "WO2014138697A1",
    "US20160057332A1",
    "WO2014138695A1",
    "US20180013945A1",
    "US20140253738A1",
    "US9124864B2",
    "US9986224B2",
    "US20160165212A1",
    "US20150035992A1",
    "US8866912B2",
    "US9521416B1",
    "US20160037097A1",
    "US20140267243A1",
    "US9519972B2",
    "WO2014164550A2",
    "US9733486B2",
    "WO2014165244A1",
    "US9741118B2",
    "US9124831B2",
    "WO2014159721A1",
    "US20160163051A1",
    "WO2014160142A1",
    "US20160195733A1",
    "US20140285675A1",
    "US20140267890A1",
    "US9800856B2",
    "WO2014164909A1",
    "US20170094243A1",
    "US20180040135A1",
    "US9888194B2",
    "US20180035057A1",
    "US20140267829A1",
    "US20160198096A1",
    "WO2014153098A1",
    "US20170163862A1",
    "US9787911B2",
    "WO2014159779A1",
    "US9100586B2",
    "US10091405B2",
    "US9578259B2",
    "US20160044252A1",
    "US20190037116A1",
    "US20140267633A1",
    "US20180048879A1",
    "US9497429B2",
    "EP2973476A1",
    "US9497370B2",
    "US10182216B2",
    "US20150312455A1",
    "US20150264337A1",
    "US9445003B1",
    "US9438888B2",
    "WO2014150856A1",
    "US20170070673A1",
    "WO2014149403A1",
    "WO2014149902A1",
    "US20150161798A1",
    "US9602805B2",
    "US9955070B2",
    "US9800859B2",
    "JP2016524125A",
    "US20140267286A1",
    "WO2014144157A1",
    "US20140267762A1",
    "WO2014145856A1",
    "US20170099465A1",
    "US9633442B2",
    "US20150002734A1",
    "WO2015048694A2",
    "US20180240265A1",
    "US9898856B2",
    "US20150091900A1",
    "US20150098079A1",
    "US20150104101A1",
    "US9264592B2",
    "US9924092B2",
    "EP3066690A1",
    "US9426343B2",
    "WO2015070105A1",
    "US20150124113A1",
    "US20150124151A1",
    "US9185276B2",
    "US20170070672A1",
    "US20150122411A1",
    "US20190063905A1",
    "WO2015074078A1",
    "US20150138346A1",
    "US10119808B2",
    "US20150146029A1",
    "EP3075140A1",
    "US20170078568A1",
    "US20180139382A1",
    "WO2015081279A1",
    "US20150146030A1",
    "EP3075140B1",
    "US9456134B2",
    "US9426361B2",
    "US9813617B2",
    "US20150244927A1",
    "US20150243480A1",
    "WO2015134996A1",
    "US20150254868A1",
    "US10089740B2",
    "US20190037150A1",
    "US20150373261A1",
    "US9521319B2",
    "US20160065934A1",
    "WO2016054089A1",
    "KR20170063827A",
    "JP2017531976A",
    "US20170244960A1"
  ]
}