MLchartDataset catalogue

Patent · US2019174077A1 · A1 · US

Examination device, examination method, and program

(11) Publication number
US2019174077A1
(21) Application number
16/301,987
(22) Filing date
2017-08-03
(30) Priority date
2016-08-17
(43) Publication date
2019-06-06
(51) IPC
G06T 3/40; H04N 23/11; H04N 23/12; A01G 7/00; G01N 21/25; G01N 21/27; G01N 21/3563; G01N 33/00
(52) CPC
  • G06T Image data processing or generation, in general: 3/4038, 2207/10036, 2207/30188
  • G01N Investigating or analysing materials by determining their chemical or physical properties: 2021/3148, 21/21, 21/255
  • G02B Optical elements, systems or apparatus: 5/3025
  • H04N Pictorial communication, e.g. television: 23/10, 23/11, 23/555, 23/698, 25/41, 5/332, 9/045
(73) Assignee
Sony Corp
(72) Inventors
Hitoshi Mitani; Masafumi Wakazono
(54) Title
Examination device, examination method, and program
(57) Abstract

The present disclosure includes an imaging sensor, an imaging method, and a non-transitory computer-readable medium. The imaging sensor includes a plurality of wavelength detection regions. The plurality of wavelength detection regions including at least a first wavelength detection region. The first wavelength detection region comprises a plurality of pixels configured to detect light within a first pre-determined wavelength range, and detect the light at different pre-determined polarization directions.

Full text
View on Google Patents

Claims (1)

  1. An imaging sensor comprising: a plurality of wavelength detection regions, the plurality of wavelength detection regions including at least a first wavelength detection region, wherein the first wavelength detection region comprises a plurality of pixels configured to detect light within a first pre-determined wavelength range, and detect the light at different pre-determined polarization directions. 2. The imaging sensor according to claim 1, wherein the plurality of wavelength detection regions further includes a second wavelength detection region, the second wavelength detection region comprises a second plurality of pixels configured to detect the light within a second pre-determined wavelength range, and detect the light at different pre-determined polarization directions, the second pre-determined wavelength range is different than the first pre-determined wavelength range. 3. The imaging sensor according to claim 2, wherein the first wavelength detection region and the second wavelength detection region are adjacent to each other. 4. The imaging sensor according to claim 1, wherein the plurality of pixels includes groups of pixels, each pixel of one of the groups of pixels is configured to detect the light at a pre-determined polarization direction, the groups of pixels are arranged to repeat within the first wavelength detection region. 5. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions is formed in a rectangular shape elongated along a first direction, and when viewed in a second direction perpendicular to the first direction, the each wavelength detection region of the plurality of wavelength detection regions is arranged at one or more points. 6. The imaging sensor according to claim 5, wherein the second direction is a direction of movement relative to an examination target. 7. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions is arranged at one or more points when viewed in a row direction and a column direction. 8. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions includes an array of at least sixteen pixels, the array of at least sixteen pixels including at least four row pixels and at least four column pixels. 9. The imaging sensor according to claim 8, wherein the array of at least sixteen pixels is configured to detect the light in at least three or more polarization directions. 10. The imaging sensor according to claim 1, wherein a first one of the plurality of wavelength detection regions is configured to detect the light within a red wavelength range, a second one of the plurality of wavelength detection regions is configured to detect the light within a green wavelength range, a third one of the plurality of wavelength detection regions is configured to detect the light within a blue wavelength range, and a fourth one of the plurality of wavelength detection regions is configured to detect the light with a near-infrared wavelength range. 11. The imaging sensor according to claim 10, further comprising: a detection region configured to detect non-polarized light in all wavelength ranges. 12. The imaging sensor according to claim 10, further comprising: a detection region comprising a second plurality of pixels, a first pixel of the second plurality of pixels is configured to detect a non-polarized light within the red wavelength range, a second pixel of the plurality of pixels is configured to detect the non-polarized light within the green wavelength range, and a third pixel of the plurality of pixels is configured to detect the non-polarized light within the blue wavelength range, the plurality of pixels is arranged in a Bayer array. 13. The imaging sensor according to claim 1, wherein four of the plurality of pixels are configured to detect the light in one of four different polarization directions, the four of the plurality of pixels are arranged as a single set, and the single set is disposed in a matrix of four rows×four columns. 14. The imaging sensor according to claim 1, further comprising: signal processing circuitry, wherein each wavelength region of the plurality of wavelength detection regions includes a different plurality of pixels, wherein the signal processing circuitry is configured to generate an image acquired for a wider area on a basis of a detection value detected by each pixel of the plurality of wavelength regions. 15. An imaging method, the method comprising: detecting, with an imaging sensor, incident light; and outputting, with the imaging sensor, a plurality of image signals based on different polarizations of the incident light, wherein a first one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a first pre-determined wavelength range, wherein a second one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a second pre-determined wavelength range, wherein the first pre-determined wavelength range and the second pre-determined wavelength range are different from each other. 16. The imaging method according to claim 15, wherein the first one or more image signals are from a first wavelength detection region, and wherein the second one or more image signals are from a second wavelength detection region. 17. The imaging method according to claim 16, wherein the first wavelength detection region and the second wavelength detection region are adjacent to each other. 18. The imaging method according to claim 15, further comprising: outputting, with the imaging sensor, a third one or more image signals of the plurality of image signals based on non-polarized light. 19. The imaging method according to claim 15, further comprising: generating, with signal processing circuitry, an image acquired for a wider area on a basis of the plurality of image signals. 20. A non-transitory computer-readable medium storing a program that, when executed by electronic processor, causes the electronic processor to perform a set of operations comprising: receiving a plurality of image signals from an image sensor, wherein a first one or more image signals of the plurality of image signals are indicative of different polarizations of incident light in a first pre-determined wavelength range, wherein a second one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a second pre-determined wavelength range, wherein the first pre-determined wavelength range and the second pre-determined wavelength range are different from each other; and processing the plurality of image signals to generate an image that is based on a combination of the plurality of image signals.

Description

The present disclosure relates to an examination device, an examination method, and a program. In particular, the present disclosure relates to an examination device, an examination method, and a program configured to favorably perform desired examination.

Typically, a normalized difference vegetation index (NDVI) has been utilized as an index for distribution status and activity of plant.

For example, in applications in the area of remote sensing and precision agriculture, a growing status of crops is examined using an image acquired in such a manner that an examination target is imaged by spectroscopy for a near-infrared light component and a red light component. Alternatively, a polarization imager configured such that various polarization filter are arranged for pixels is utilized so that an image having characteristics according to a polarization direction can be acquired. Note that the polarization imager is configured such that the pixels on a light receiving surface are divided according to multiple polarization directions, and generates an image for each polarization direction. Thus, a resolution is decreased (e.g., the resolution is decreased to ¼ when four polarization directions are used).

For example, Patent Literature 1 discloses an imaging device configured such that a polarizer array including polarizers (a polarization filter for each pixel) arranged in an array is shifted in units of pixel by an actuator to acquire multiple images and a resolution is held by processing of these images.

Record as JSON
{
  "publication_number": "US2019174077A1",
  "country": "US",
  "kind": "A1",
  "title": "Examination device, examination method, and program",
  "abstract": "The present disclosure includes an imaging sensor, an imaging method, and a non-transitory computer-readable medium. The imaging sensor includes a plurality of wavelength detection regions. The plurality of wavelength detection regions including at least a first wavelength detection region. The first wavelength detection region comprises a plurality of pixels configured to detect light within a first pre-determined wavelength range, and detect the light at different pre-determined polarization directions.",
  "claims": [
    "1. An imaging sensor comprising: a plurality of wavelength detection regions, the plurality of wavelength detection regions including at least a first wavelength detection region, wherein the first wavelength detection region comprises a plurality of pixels configured to detect light within a first pre-determined wavelength range, and detect the light at different pre-determined polarization directions. 2. The imaging sensor according to claim 1, wherein the plurality of wavelength detection regions further includes a second wavelength detection region, the second wavelength detection region comprises a second plurality of pixels configured to detect the light within a second pre-determined wavelength range, and detect the light at different pre-determined polarization directions, the second pre-determined wavelength range is different than the first pre-determined wavelength range. 3. The imaging sensor according to claim 2, wherein the first wavelength detection region and the second wavelength detection region are adjacent to each other. 4. The imaging sensor according to claim 1, wherein the plurality of pixels includes groups of pixels, each pixel of one of the groups of pixels is configured to detect the light at a pre-determined polarization direction, the groups of pixels are arranged to repeat within the first wavelength detection region. 5. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions is formed in a rectangular shape elongated along a first direction, and when viewed in a second direction perpendicular to the first direction, the each wavelength detection region of the plurality of wavelength detection regions is arranged at one or more points. 6. The imaging sensor according to claim 5, wherein the second direction is a direction of movement relative to an examination target. 7. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions is arranged at one or more points when viewed in a row direction and a column direction. 8. The imaging sensor according to claim 1, wherein each wavelength detection region of the plurality of wavelength detection regions includes an array of at least sixteen pixels, the array of at least sixteen pixels including at least four row pixels and at least four column pixels. 9. The imaging sensor according to claim 8, wherein the array of at least sixteen pixels is configured to detect the light in at least three or more polarization directions. 10. The imaging sensor according to claim 1, wherein a first one of the plurality of wavelength detection regions is configured to detect the light within a red wavelength range, a second one of the plurality of wavelength detection regions is configured to detect the light within a green wavelength range, a third one of the plurality of wavelength detection regions is configured to detect the light within a blue wavelength range, and a fourth one of the plurality of wavelength detection regions is configured to detect the light with a near-infrared wavelength range. 11. The imaging sensor according to claim 10, further comprising: a detection region configured to detect non-polarized light in all wavelength ranges. 12. The imaging sensor according to claim 10, further comprising: a detection region comprising a second plurality of pixels, a first pixel of the second plurality of pixels is configured to detect a non-polarized light within the red wavelength range, a second pixel of the plurality of pixels is configured to detect the non-polarized light within the green wavelength range, and a third pixel of the plurality of pixels is configured to detect the non-polarized light within the blue wavelength range, the plurality of pixels is arranged in a Bayer array. 13. The imaging sensor according to claim 1, wherein four of the plurality of pixels are configured to detect the light in one of four different polarization directions, the four of the plurality of pixels are arranged as a single set, and the single set is disposed in a matrix of four rows×four columns. 14. The imaging sensor according to claim 1, further comprising: signal processing circuitry, wherein each wavelength region of the plurality of wavelength detection regions includes a different plurality of pixels, wherein the signal processing circuitry is configured to generate an image acquired for a wider area on a basis of a detection value detected by each pixel of the plurality of wavelength regions. 15. An imaging method, the method comprising: detecting, with an imaging sensor, incident light; and outputting, with the imaging sensor, a plurality of image signals based on different polarizations of the incident light, wherein a first one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a first pre-determined wavelength range, wherein a second one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a second pre-determined wavelength range, wherein the first pre-determined wavelength range and the second pre-determined wavelength range are different from each other. 16. The imaging method according to claim 15, wherein the first one or more image signals are from a first wavelength detection region, and wherein the second one or more image signals are from a second wavelength detection region. 17. The imaging method according to claim 16, wherein the first wavelength detection region and the second wavelength detection region are adjacent to each other. 18. The imaging method according to claim 15, further comprising: outputting, with the imaging sensor, a third one or more image signals of the plurality of image signals based on non-polarized light. 19. The imaging method according to claim 15, further comprising: generating, with signal processing circuitry, an image acquired for a wider area on a basis of the plurality of image signals. 20. A non-transitory computer-readable medium storing a program that, when executed by electronic processor, causes the electronic processor to perform a set of operations comprising: receiving a plurality of image signals from an image sensor, wherein a first one or more image signals of the plurality of image signals are indicative of different polarizations of incident light in a first pre-determined wavelength range, wherein a second one or more image signals of the plurality of image signals are indicative of the different polarizations of the incident light in a second pre-determined wavelength range, wherein the first pre-determined wavelength range and the second pre-determined wavelength range are different from each other; and processing the plurality of image signals to generate an image that is based on a combination of the plurality of image signals."
  ],
  "description_excerpt": "The present disclosure relates to an examination device, an examination method, and a program. In particular, the present disclosure relates to an examination device, an examination method, and a program configured to favorably perform desired examination.\n\nTypically, a normalized difference vegetation index (NDVI) has been utilized as an index for distribution status and activity of plant.\n\nFor example, in applications in the area of remote sensing and precision agriculture, a growing status of crops is examined using an image acquired in such a manner that an examination target is imaged by spectroscopy for a near-infrared light component and a red light component. Alternatively, a polarization imager configured such that various polarization filter are arranged for pixels is utilized so that an image having characteristics according to a polarization direction can be acquired. Note that the polarization imager is configured such that the pixels on a light receiving surface are divided according to multiple polarization directions, and generates an image for each polarization direction. Thus, a resolution is decreased (e.g., the resolution is decreased to ¼ when four polarization directions are used).\n\nFor example, Patent Literature 1 discloses an imaging device configured such that a polarizer array including polarizers (a polarization filter for each pixel) arranged in an array is shifted in units of pixel by an actuator to acquire multiple images and a resolution is held by processing of these images.",
  "cpc": [
    "G06T 3/4038",
    "G01N 2021/3148",
    "G01N 21/21",
    "G01N 21/255",
    "G02B 5/3025",
    "G06T 2207/10036",
    "G06T 2207/30188",
    "H04N 23/10",
    "H04N 23/11",
    "H04N 23/555",
    "H04N 23/698",
    "H04N 25/41",
    "H04N 5/332",
    "H04N 9/045"
  ],
  "ipc": [
    "G06T 3/40",
    "H04N 23/11",
    "H04N 23/12",
    "A01G 7/00",
    "G01N 21/25",
    "G01N 21/27",
    "G01N 21/3563",
    "G01N 33/00"
  ],
  "assignees": [
    "Sony Corp"
  ],
  "inventors": [
    "Hitoshi Mitani",
    "Masafumi Wakazono"
  ],
  "filing_date": "2017-08-03",
  "publication_date": "2019-06-06",
  "priority_date": "2016-08-17",
  "application_number": "US-201716301987-A",
  "family_id": "60953922",
  "cited_by_count": 20
}

Record 2,779 of 8,000 in Patents full text (MLC-0201). Request the full dataset.