Patent · US10498944B2 · B2 · US

Wearable apparatus with wide viewing angle image sensor

(11) Publication number

US10498944B2

(21) Application number

16/421,028

(22) Filing date

2019-05-23

(30) Priority date

2014-07-23

(43) Publication date

2019-12-03

(45) Date of grant

2019-12-03

(51) IPC

G01S 3/786; G02B 27/00; G02B 27/01; G06F 1/16; G06F 1/18; G06F 16/51; G06F 16/53; G06F 16/532; G06F 3/00; G06F 3/01; G06F 3/03; G06F 3/038; G06Q 30/02; G06T 7/00; G06T 7/20; G06T 7/73; G06V 10/776; H04N 1/21; H04N 23/80; H04N 5/44; H04N 7/18

(52) CPC

G06F Electric digital data processing: 1/1686, 1/163, 1/18, 1/188, 16/51, 16/53, 16/532, 18/217, 2203/011, 3/005, 3/011, 3/012, 3/017, 3/0304, 3/038
G01S Radio direction-finding; radio navigation; determining distance or velocity by use of radio waves; locating or presence-detecting by use of the reflection or reradiation of radio waves; analogous arrangements using other waves: 3/7864
G02B Optical elements, systems or apparatus: 2027/0138, 2027/014, 2027/0178, 2027/0187, 27/0093, 27/017
G06K Graphical data reading; presentation of data; record carriers; handling record carriers: 2209/21, 2209/25, 9/00201, 9/00208, 9/00221, 9/00288, 9/00335, 9/00624, 9/00671, 9/00677, 9/00718, 9/6262
G06Q Information and communication technology [ICT] specially adapted for administrative, commercial, financial, managerial or supervisory purposes; systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not otherwise provided for: 30/0246, 30/0257, 30/0267, 30/0269
G06T Image data processing or generation, in general: 2207/10004, 2207/10016, 2207/30232, 7/20, 7/74, 7/97
G06V Image or video recognition or understanding: 10/776, 20/20, 20/30, 20/41, 20/64, 20/647, 2201/07, 2201/09, 40/16, 40/172, 40/20
H04N Pictorial communication, e.g. television: 1/2112, 23/45, 23/50, 23/51, 23/57, 23/58, 23/61, 23/611, 23/62, 23/661, 23/667, 23/6812, 23/73, 23/80, 5/2251, 5/2252, 5/2254, 5/2257, 5/2258, 5/2259, 5/23206, 5/23216, 5/23219, 5/23229, 5/23245, 5/23258, 5/2353, 5/44, 7/183, 7/185

(73) Assignee

Orcam Technologies Ltd

(72) Inventors

Yonatan Wexler; Amnon Shashua

(54) Title

Wearable apparatus with wide viewing angle image sensor

(57) Abstract

A wearable apparatus and method are provided for capturing image data. In one implementation, a wearable apparatus for capturing image data is provided. The wearable apparatus includes at least one image sensor for capturing image data of an environment of a user, wherein a field of view of the image sensor includes a chin of the user. The wearable apparatus includes two or more microphones, and an attachment mechanism configured to enable the image sensor and microphones to be worn by the user. The wearable apparatus includes a processing device programmed to capture at least one image, identify the chin of the user to obtain a location of the chin, select a microphone from the two or more microphones based on the location, process input from the selected microphone using a first processing scheme, and process input from a microphone that is not selected using a second processing scheme.

Full text

View on Google Patents

Claims (18)

A wearable apparatus, the wearable apparatus comprising: at least one image sensor for capturing data plurality of images of an environment of a user of the wearable apparatus, wherein a field of view of the image sensor includes at least a portion of a head of the user; at least one microphone; an attachment mechanism configured to attach the at least one image sensor and the at least one microphone to the user; and at least one processing device programmed to: identify a head of the user in at least one of the plurality of images; determine, based on at least one of the plurality of images, a direction the head of the user is facing with respect to a body of the user; and based on the direction the head of the user is facing, activate the at least one microphone to record sound in the direction the head is facing.
The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 180°.
The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 300°.
The wearable apparatus of claim 1, further comprising at least one solar cell configured to provide power to the at least one image sensor.
The wearable apparatus of claim 4, wherein the at least one solar cell is included in a capturing unit that includes the at least one image sensor.
The wearable apparatus of claim 1, further comprising a power unit including an energy storage device configured to store energy derived from movements of the user.
The wearable apparatus of claim 6, wherein the stored energy is used to power the at least one image sensor.
The wearable apparatus of claim 1, the at least one processing device further programmed to store the plurality of images.
The wearable apparatus of claim 1, the at least one processing device further programmed to identify a direction of sound received by the at least one microphone.
The wearable apparatus of claim 1, the at least one processing device further programmed to, after identifying the direction of the sound, adjust a pixel resolution for capturing subsequent images at a higher resolution.
A method, the method comprising: capturing, via at least one image sensor, data plurality of images of an environment of a user, wherein a field of view of the image sensor includes at least a portion of a head of a user; identifying, a head of the user in at least one of the plurality of images; determine, based on at least one of the plurality of images, a direction the head of the user is facing; and based on the direction the head of the user is facing, activating the at least one microphone to record sound in the direction the head is facing.
The method of claim 11, wherein the field of view of the at least one image sensor is more than 180°.
The method of claim 11, wherein the field of view of the at least one image sensor is more than 300°.
The method of claim 11, the method further comprising providing power to the at least one image sensor.
The method of claim 11, the method further comprising adding at least one solar cell in a capturing unit that includes the at least one image sensor.
The method of claim 11, the method further comprising storing energy derived from movements of the user.
The method of claim 16, wherein the stored energy is used to power the at least one image sensor.
The method of claim 11, the method further comprising storing the plurality of images.

Description

This disclosure generally relates to devices and methods for capturing and processing images from an environment of a user. More particularly, this disclosure relates to a wearable apparatus including an image sensor having a wide viewing angle for capturing image data, and methods for processing the captured image data.

Today, technological advancements make it possible for wearable devices to automatically capture images and store information that is associated with the captured images. Certain devices have been used to digitally record aspects and personal experiences of one's life in an exercise typically called “lifelogging.” Some individuals log their life so they can retrieve moments from past activities, for example, social events, trips, etc. Lifelogging may also have significant benefits in other fields (e.g., business, fitness and healthcare, and social research). Lifelogging devices, while useful for tracking daily activities, may be improved with capability to enhance one's interaction in his environment with feedback and other advanced functionality based on the analysis of captured image data.

Even though users can capture images with their smartphones and some smartphone applications can process the captured images, smartphones may not be the best platform for serving as lifelogging apparatuses in view of their size and design. Lifelogging apparatuses should be small and light, so they can be easily worn. Moreover, with improvements in image capture devices, including wearable apparatuses, additional functionality may be provided to assist users in navigating in and around an environment.

Citations (10)

US20020113687A1
US20090147126A1
US20120147184A1
US20090021191A1
US20090190914A1
US20110164141A1
US20100262470A1
US8786636B2
US20120147204A1
US20130080168A1

Record as JSON

{
  "publication_number": "US10498944B2",
  "country": "US",
  "kind": "B2",
  "title": "Wearable apparatus with wide viewing angle image sensor",
  "abstract": "A wearable apparatus and method are provided for capturing image data. In one implementation, a wearable apparatus for capturing image data is provided. The wearable apparatus includes at least one image sensor for capturing image data of an environment of a user, wherein a field of view of the image sensor includes a chin of the user. The wearable apparatus includes two or more microphones, and an attachment mechanism configured to enable the image sensor and microphones to be worn by the user. The wearable apparatus includes a processing device programmed to capture at least one image, identify the chin of the user to obtain a location of the chin, select a microphone from the two or more microphones based on the location, process input from the selected microphone using a first processing scheme, and process input from a microphone that is not selected using a second processing scheme.",
  "claims": [
    "1. A wearable apparatus, the wearable apparatus comprising: at least one image sensor for capturing data plurality of images of an environment of a user of the wearable apparatus, wherein a field of view of the image sensor includes at least a portion of a head of the user; at least one microphone; an attachment mechanism configured to attach the at least one image sensor and the at least one microphone to the user; and at least one processing device programmed to: identify a head of the user in at least one of the plurality of images; determine, based on at least one of the plurality of images, a direction the head of the user is facing with respect to a body of the user; and based on the direction the head of the user is facing, activate the at least one microphone to record sound in the direction the head is facing.",
    "2. The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 180°.",
    "3. The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 300°.",
    "4. The wearable apparatus of claim 1, further comprising at least one solar cell configured to provide power to the at least one image sensor.",
    "5. The wearable apparatus of claim 4, wherein the at least one solar cell is included in a capturing unit that includes the at least one image sensor.",
    "6. The wearable apparatus of claim 1, further comprising a power unit including an energy storage device configured to store energy derived from movements of the user.",
    "7. The wearable apparatus of claim 6, wherein the stored energy is used to power the at least one image sensor.",
    "8. The wearable apparatus of claim 1, the at least one processing device further programmed to store the plurality of images.",
    "9. The wearable apparatus of claim 1, the at least one processing device further programmed to identify a direction of sound received by the at least one microphone.",
    "10. The wearable apparatus of claim 1, the at least one processing device further programmed to, after identifying the direction of the sound, adjust a pixel resolution for capturing subsequent images at a higher resolution.",
    "11. A method, the method comprising: capturing, via at least one image sensor, data plurality of images of an environment of a user, wherein a field of view of the image sensor includes at least a portion of a head of a user; identifying, a head of the user in at least one of the plurality of images; determine, based on at least one of the plurality of images, a direction the head of the user is facing; and based on the direction the head of the user is facing, activating the at least one microphone to record sound in the direction the head is facing.",
    "12. The method of claim 11, wherein the field of view of the at least one image sensor is more than 180°.",
    "13. The method of claim 11, wherein the field of view of the at least one image sensor is more than 300°.",
    "14. The method of claim 11, the method further comprising providing power to the at least one image sensor.",
    "15. The method of claim 11, the method further comprising adding at least one solar cell in a capturing unit that includes the at least one image sensor.",
    "16. The method of claim 11, the method further comprising storing energy derived from movements of the user.",
    "17. The method of claim 16, wherein the stored energy is used to power the at least one image sensor.",
    "18. The method of claim 11, the method further comprising storing the plurality of images."
  ],
  "description_excerpt": "This disclosure generally relates to devices and methods for capturing and processing images from an environment of a user. More particularly, this disclosure relates to a wearable apparatus including an image sensor having a wide viewing angle for capturing image data, and methods for processing the captured image data.\n\nToday, technological advancements make it possible for wearable devices to automatically capture images and store information that is associated with the captured images. Certain devices have been used to digitally record aspects and personal experiences of one's life in an exercise typically called “lifelogging.” Some individuals log their life so they can retrieve moments from past activities, for example, social events, trips, etc. Lifelogging may also have significant benefits in other fields (e.g., business, fitness and healthcare, and social research). Lifelogging devices, while useful for tracking daily activities, may be improved with capability to enhance one's interaction in his environment with feedback and other advanced functionality based on the analysis of captured image data.\n\nEven though users can capture images with their smartphones and some smartphone applications can process the captured images, smartphones may not be the best platform for serving as lifelogging apparatuses in view of their size and design. Lifelogging apparatuses should be small and light, so they can be easily worn. Moreover, with improvements in image capture devices, including wearable apparatuses, additional functionality may be provided to assist users in navigating in and around an environment.",
  "cpc": [
    "G06F 1/1686",
    "G01S 3/7864",
    "G02B 2027/0138",
    "G02B 2027/014",
    "G02B 2027/0178",
    "G02B 2027/0187",
    "G02B 27/0093",
    "G02B 27/017",
    "G06F 1/163",
    "G06F 1/18",
    "G06F 1/188",
    "G06F 16/51",
    "G06F 16/53",
    "G06F 16/532",
    "G06F 18/217",
    "G06F 2203/011",
    "G06F 3/005",
    "G06F 3/011",
    "G06F 3/012",
    "G06F 3/017",
    "G06F 3/0304",
    "G06F 3/038",
    "G06K 2209/21",
    "G06K 2209/25",
    "G06K 9/00201",
    "G06K 9/00208",
    "G06K 9/00221",
    "G06K 9/00288",
    "G06K 9/00335",
    "G06K 9/00624",
    "G06K 9/00671",
    "G06K 9/00677",
    "G06K 9/00718",
    "G06K 9/6262",
    "G06Q 30/0246",
    "G06Q 30/0257",
    "G06Q 30/0267",
    "G06Q 30/0269",
    "G06T 2207/10004",
    "G06T 2207/10016",
    "G06T 2207/30232",
    "G06T 7/20",
    "G06T 7/74",
    "G06T 7/97",
    "G06V 10/776",
    "G06V 20/20",
    "G06V 20/30",
    "G06V 20/41",
    "G06V 20/64",
    "G06V 20/647",
    "G06V 2201/07",
    "G06V 2201/09",
    "G06V 40/16",
    "G06V 40/172",
    "G06V 40/20",
    "H04N 1/2112",
    "H04N 23/45",
    "H04N 23/50",
    "H04N 23/51",
    "H04N 23/57",
    "H04N 23/58",
    "H04N 23/61",
    "H04N 23/611",
    "H04N 23/62",
    "H04N 23/661",
    "H04N 23/667",
    "H04N 23/6812",
    "H04N 23/73",
    "H04N 23/80",
    "H04N 5/2251",
    "H04N 5/2252",
    "H04N 5/2254",
    "H04N 5/2257",
    "H04N 5/2258",
    "H04N 5/2259",
    "H04N 5/23206",
    "H04N 5/23216",
    "H04N 5/23219",
    "H04N 5/23229",
    "H04N 5/23245",
    "H04N 5/23258",
    "H04N 5/2353",
    "H04N 5/44",
    "H04N 7/183",
    "H04N 7/185"
  ],
  "ipc": [
    "G01S 3/786",
    "G02B 27/00",
    "G02B 27/01",
    "G06F 1/16",
    "G06F 1/18",
    "G06F 16/51",
    "G06F 16/53",
    "G06F 16/532",
    "G06F 3/00",
    "G06F 3/01",
    "G06F 3/03",
    "G06F 3/038",
    "G06Q 30/02",
    "G06T 7/00",
    "G06T 7/20",
    "G06T 7/73",
    "G06V 10/776",
    "H04N 1/21",
    "H04N 23/80",
    "H04N 5/44",
    "H04N 7/18"
  ],
  "assignees": [
    "Orcam Technologies Ltd"
  ],
  "inventors": [
    "Yonatan Wexler",
    "Amnon Shashua"
  ],
  "filing_date": "2019-05-23",
  "publication_date": "2019-12-03",
  "grant_date": "2019-12-03",
  "priority_date": "2014-07-23",
  "application_number": "US-201916421028-A",
  "family_id": "54347590",
  "cited_by_count": 2,
  "citations": [
    "US20020113687A1",
    "US20090147126A1",
    "US20120147184A1",
    "US20090021191A1",
    "US20090190914A1",
    "US20110164141A1",
    "US20100262470A1",
    "US8786636B2",
    "US20120147204A1",
    "US20130080168A1"
  ]
}

Record 2,423 of 8,000 in Patents full text (MLC-0201). Request the full dataset.