MLchartDataset catalogue

Patent · US10110875B2 · B2 · US

Image capture system with image conversion mechanism and method of operation thereof

(11) Publication number
US10110875B2
(21) Application number
14/026,073
(22) Filing date
2013-09-13
(30) Priority date
2012-09-18
(43) Publication date
2018-10-23
(45) Date of grant
2018-10-23
(51) IPC
H04N 13/122; G03B 35/10; H04N 13/207
(52) CPC
  • H04N Pictorial communication, e.g. television: 13/207, 13/0018, 13/0022, 13/0217, 13/0253, 13/0271, 13/122, 13/128, 13/218, 13/254, 13/271, 2013/0081
  • G03B Apparatus or arrangements for taking photographs or for projecting or viewing them; apparatus or arrangements employing analogous techniques using waves other than optical waves; accessories therefor: 35/10
(73) Assignee
Samsung Electronics Co Ltd
(72) Inventors
Pranav Mistry; Nikhil Naik
(54) Title
Image capture system with image conversion mechanism and method of operation thereof
(57) Abstract

A three dimensional image capture system includes: an image capture device configured to generate video data; a lens, coupled to the image capture device, configured to focus a left image and a right image; a microprism array, coupled to the lens, configured to horizontally deflect the left image and the right image; and an image processing unit, coupled to the image capture device, configured to calculate a depthmap from the left image and the right image in the video data, rendered by the microprism array.

Full text
View on Google Patents

Claims (20)

  1. A three dimensional image capture system comprising: an image capture device configured to generate video data; a lens, coupled to the image capture device, configured to focus a left image and a right image; a microprism array, coupled to the lens, configured to horizontally deflect the left image and the right image; and an image processing unit, coupled to the image capture device, configured to calculate a depthmap from the left image and the right image, captured simultaneously, in the video data including identifying the video data that falls outside a depth sensing region as background data, wherein the depth sensing region extends from the microprism array and reduces linearly based on a deviation angle, of the microprism array, and a distance from the microprism array to a target object.
  2. The system as claimed in claim 1 wherein the image processing unit includes a video processor configured to calculate the depthmap.
  3. The system as claimed in claim 1 wherein the microprism array includes multiple vertically-aligned uniform triangular prisms configured to deflect a left virtual object and a right virtual object.
  4. The system as claimed in claim 1 wherein the image processing unit includes a video acquisition function configured to buffer the video data for identifying a correspondence point.
  5. The system as claimed in claim 1 further comprising an illumination source, coupled to the image processing unit, configured to illuminate the target object.
  6. The system as claimed in claim 1 wherein: the image capture device has a width centered on an optical axis of the lens; the lens is spaced a focal distance (fx) from the image capture device; the microprism array is spaced an array distance (U Z) from the lens opposite the focal distance (fx); and the image processing unit is configured to calculate a disparity map from the left image and the right image.
  7. The system as claimed in claim 1 wherein the image processing unit includes a video processor configured to calculate a disparity map from a video acquisition function and to calculate the depthmap for a display application function.
  8. The system as claimed in claim 1 wherein the microprism array includes multiple vertically-aligned uniform triangular prisms having equal base angles.
  9. The system as claimed in claim 1 wherein the image processing unit includes a video acquisition function that provides a memory structure configured to buffer the video data for identifying a disparity map.
  10. The system as claimed in claim 1 further comprising an illumination source coupled to the image processing unit configured to illuminate the target object to generate a left virtual object and a right virtual object from the microprism array.
  11. A method to capture three dimensional images comprising: illuminating an image capture function configured to generate video data; focusing a left image and a right image, through a lens, on the image capture function; horizontally deflecting the left image and the right image from a microprism array; and calculating a depthmap from the left image and the right image, captured simultaneously, in the video data including identifying the video data that falls outside a depth sensing region as background data, wherein the depth sensing region extends from the microprism array and reduces linearly based on a deviation angle, of the microprism array, and a distance from the microprism array to a target object.
  12. The method as claimed in claim 11 wherein calculating the depthmap from the left image and the right image includes parsing a disparity map.
  13. The method as claimed in claim 11 further comprising horizontally deflecting a left virtual object and a right virtual object for forming the left image and the right image.
  14. The method as claimed in claim 11 wherein calculating the depthmap includes buffering the video data for identifying a correspondence point.
  15. The method as claimed in claim 11 further comprising illuminating the target object for horizontally deflecting the left image and the right image.
  16. The method as claimed in claim 11 further comprising: centering a width of the image capture function on an optical axis of the lens; determining a focal distance (fx) between the lens and the image capture function; recording an array distance (U Z) between the lens and the microprism array; and calculating a disparity map from the left image and the right image.
  17. The method as claimed in claim 11 further comprising calculating a disparity map and calculating the depthmap for a display application function.
  18. The method as claimed in claim 11 wherein horizontally deflecting the left image and the right image includes illuminating multiple vertically-aligned uniform triangular prisms having equal base angles configured to generate a deflection angle.
  19. The method as claimed in claim 11 wherein calculating the depthmap includes calculating a disparity map while buffering the video data.
  20. The method as claimed in claim 11 further comprising illuminating the target object for horizontally deflecting the left image and the right image includes reflecting a left virtual object and a right virtual object from the microprism array.

Description

An embodiment of the present invention relates generally to image capture system, and more particularly to a system for image conversion.

Modern consumer and industrial electronics, especially devices such as graphical display systems, televisions, projectors, cellular phones, portable digital assistants, and combination devices, are providing increasing levels of functionality to support modern life including three-dimensional (3D) display services. Research and development in the existing technologies can take a myriad of different directions.

3D image capturing generally requires two image capture modules: a first image capture module imitates the human left eye; and a second image capture module imitates the human right eye. The combination of the first image and the second image can present very difficult technical issues.

In conventional techniques, the first and second image capture modules, assembled in a portable electronic device with 3D, are spaced apart by a fixed distance. When a subject to be captured is very close to the device, the image difference between a first image captured by the first image capture module and a second image captured by the second image capture module may be too significant to form a 3D image.

If the first image and the second image are not properly combined, the resultant image can look unnatural or present an unnerving effect on the viewer. In many cases having an incorrect blending of the first image and the second image can result in a shadow image that can give a viewer a headache when it is observed.

Citations (16)

  • US5652616A
  • WO2001076260A1
  • US20030076279A1
  • US20040263698A1
  • US20050168616A1
  • US20060082726A1
  • US20120057000A1
  • US8290358B1
  • US20110211043A1
  • US20110050858A1
  • US8422131B2
  • JP2011182041A
  • US20130093858A1
  • US20120038749A1
  • US20120176506A1
  • US20120176475A1
Record as JSON
{
  "publication_number": "US10110875B2",
  "country": "US",
  "kind": "B2",
  "title": "Image capture system with image conversion mechanism and method of operation thereof",
  "abstract": "A three dimensional image capture system includes: an image capture device configured to generate video data; a lens, coupled to the image capture device, configured to focus a left image and a right image; a microprism array, coupled to the lens, configured to horizontally deflect the left image and the right image; and an image processing unit, coupled to the image capture device, configured to calculate a depthmap from the left image and the right image in the video data, rendered by the microprism array.",
  "claims": [
    "1. A three dimensional image capture system comprising: an image capture device configured to generate video data; a lens, coupled to the image capture device, configured to focus a left image and a right image; a microprism array, coupled to the lens, configured to horizontally deflect the left image and the right image; and an image processing unit, coupled to the image capture device, configured to calculate a depthmap from the left image and the right image, captured simultaneously, in the video data including identifying the video data that falls outside a depth sensing region as background data, wherein the depth sensing region extends from the microprism array and reduces linearly based on a deviation angle, of the microprism array, and a distance from the microprism array to a target object.",
    "2. The system as claimed in claim 1 wherein the image processing unit includes a video processor configured to calculate the depthmap.",
    "3. The system as claimed in claim 1 wherein the microprism array includes multiple vertically-aligned uniform triangular prisms configured to deflect a left virtual object and a right virtual object.",
    "4. The system as claimed in claim 1 wherein the image processing unit includes a video acquisition function configured to buffer the video data for identifying a correspondence point.",
    "5. The system as claimed in claim 1 further comprising an illumination source, coupled to the image processing unit, configured to illuminate the target object.",
    "6. The system as claimed in claim 1 wherein: the image capture device has a width centered on an optical axis of the lens; the lens is spaced a focal distance (fx) from the image capture device; the microprism array is spaced an array distance (U Z) from the lens opposite the focal distance (fx); and the image processing unit is configured to calculate a disparity map from the left image and the right image.",
    "7. The system as claimed in claim 1 wherein the image processing unit includes a video processor configured to calculate a disparity map from a video acquisition function and to calculate the depthmap for a display application function.",
    "8. The system as claimed in claim 1 wherein the microprism array includes multiple vertically-aligned uniform triangular prisms having equal base angles.",
    "9. The system as claimed in claim 1 wherein the image processing unit includes a video acquisition function that provides a memory structure configured to buffer the video data for identifying a disparity map.",
    "10. The system as claimed in claim 1 further comprising an illumination source coupled to the image processing unit configured to illuminate the target object to generate a left virtual object and a right virtual object from the microprism array.",
    "11. A method to capture three dimensional images comprising: illuminating an image capture function configured to generate video data; focusing a left image and a right image, through a lens, on the image capture function; horizontally deflecting the left image and the right image from a microprism array; and calculating a depthmap from the left image and the right image, captured simultaneously, in the video data including identifying the video data that falls outside a depth sensing region as background data, wherein the depth sensing region extends from the microprism array and reduces linearly based on a deviation angle, of the microprism array, and a distance from the microprism array to a target object.",
    "12. The method as claimed in claim 11 wherein calculating the depthmap from the left image and the right image includes parsing a disparity map.",
    "13. The method as claimed in claim 11 further comprising horizontally deflecting a left virtual object and a right virtual object for forming the left image and the right image.",
    "14. The method as claimed in claim 11 wherein calculating the depthmap includes buffering the video data for identifying a correspondence point.",
    "15. The method as claimed in claim 11 further comprising illuminating the target object for horizontally deflecting the left image and the right image.",
    "16. The method as claimed in claim 11 further comprising: centering a width of the image capture function on an optical axis of the lens; determining a focal distance (fx) between the lens and the image capture function; recording an array distance (U Z) between the lens and the microprism array; and calculating a disparity map from the left image and the right image.",
    "17. The method as claimed in claim 11 further comprising calculating a disparity map and calculating the depthmap for a display application function.",
    "18. The method as claimed in claim 11 wherein horizontally deflecting the left image and the right image includes illuminating multiple vertically-aligned uniform triangular prisms having equal base angles configured to generate a deflection angle.",
    "19. The method as claimed in claim 11 wherein calculating the depthmap includes calculating a disparity map while buffering the video data.",
    "20. The method as claimed in claim 11 further comprising illuminating the target object for horizontally deflecting the left image and the right image includes reflecting a left virtual object and a right virtual object from the microprism array."
  ],
  "description_excerpt": "An embodiment of the present invention relates generally to image capture system, and more particularly to a system for image conversion.\n\nModern consumer and industrial electronics, especially devices such as graphical display systems, televisions, projectors, cellular phones, portable digital assistants, and combination devices, are providing increasing levels of functionality to support modern life including three-dimensional (3D) display services. Research and development in the existing technologies can take a myriad of different directions.\n\n3D image capturing generally requires two image capture modules: a first image capture module imitates the human left eye; and a second image capture module imitates the human right eye. The combination of the first image and the second image can present very difficult technical issues.\n\nIn conventional techniques, the first and second image capture modules, assembled in a portable electronic device with 3D, are spaced apart by a fixed distance. When a subject to be captured is very close to the device, the image difference between a first image captured by the first image capture module and a second image captured by the second image capture module may be too significant to form a 3D image.\n\nIf the first image and the second image are not properly combined, the resultant image can look unnatural or present an unnerving effect on the viewer. In many cases having an incorrect blending of the first image and the second image can result in a shadow image that can give a viewer a headache when it is observed.",
  "cpc": [
    "H04N 13/207",
    "G03B 35/10",
    "H04N 13/0018",
    "H04N 13/0022",
    "H04N 13/0217",
    "H04N 13/0253",
    "H04N 13/0271",
    "H04N 13/122",
    "H04N 13/128",
    "H04N 13/218",
    "H04N 13/254",
    "H04N 13/271",
    "H04N 2013/0081"
  ],
  "ipc": [
    "H04N 13/122",
    "G03B 35/10",
    "H04N 13/207"
  ],
  "assignees": [
    "Samsung Electronics Co Ltd"
  ],
  "inventors": [
    "Pranav Mistry",
    "Nikhil Naik"
  ],
  "filing_date": "2013-09-13",
  "publication_date": "2018-10-23",
  "grant_date": "2018-10-23",
  "priority_date": "2012-09-18",
  "application_number": "US-201314026073-A",
  "family_id": "50274058",
  "cited_by_count": 1,
  "citations": [
    "US5652616A",
    "WO2001076260A1",
    "US20030076279A1",
    "US20040263698A1",
    "US20050168616A1",
    "US20060082726A1",
    "US20120057000A1",
    "US8290358B1",
    "US20110211043A1",
    "US20110050858A1",
    "US8422131B2",
    "JP2011182041A",
    "US20130093858A1",
    "US20120038749A1",
    "US20120176506A1",
    "US20120176475A1"
  ]
}

Record 3,223 of 8,000 in Patents full text (MLC-0201). Request the full dataset.