Patent · US9646574B2 · B2 · US

Head-mounted display apparatus for retaining a portable electronic device with display

(11) Publication number

US9646574B2

(21) Application number

15/274,901

(22) Filing date

2016-09-23

(30) Priority date

2008-09-30

(43) Publication date

2017-05-09

(45) Date of grant

2017-05-09

(52) CPC

H04M Telephonic communication: 1/05, 1/0266, 1/72454, 1/72569
A45F Travelling or camp equipment: sacks or packs carried on the body: 5/00
G02B Optical elements, systems or apparatus: 2027/0132, 2027/014, 2027/0156, 2027/0169, 2027/0178, 27/0093, 27/017, 27/0172, 27/0176, 27/022, 27/028
G06F Electric digital data processing: 1/163, 1/1632, 1/20, 1/203, 1/206, 3/012, 3/013, 3/0362, 3/041, 3/0412, 3/14, 3/16
G06T Image data processing or generation, in general: 19/006
G09G Arrangements or circuits for control of indicating devices using static means to present variable information: 2320/10, 2340/0407, 3/001, 5/005, 5/14, 5/377, 5/391
H04B Transmission: 1/385, 2001/3866
H04N Pictorial communication, e.g. television: 23/51, 5/2252
H04W Wireless communication networks: 4/80

(73) Assignee

APPLE INC

(54) Title

Head-mounted display apparatus for retaining a portable electronic device with display

(57) Abstract

Head-mounted display systems and methods of operation that allow users to couple and decouple a portable electronic device such as a handheld portable electronic device with a separate head-mounted device (e.g., temporarily integrates the separate devices into a single unit) are disclosed. The portable electronic may be physically coupled to the head-mounted device such that the portable electronic device can be worn on the user's head. The portable electronic device may be operatively coupled to the head-mounted device such that the portable electronic device and head mounted device can communicate and operate with one another. Each device may be allowed to extend its features and/or services to the other device for the purpose of enhancing, increasing and/or eliminating redundant functions between the head-mounted device and the portable electronic device.

Full text

View on Google Patents

Claims (26)

A head-mounted apparatus comprising: a frame; a display supported by the frame; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor.
The head-mounted apparatus defined in claim 1, wherein the processor is configured to overlay the captured image over a portion of the image based content in the second mode.
The head-mounted apparatus defined in claim 1, further comprising: communications circuitry that receives the image based content from an electronic device.
The head-mounted apparatus defined in claim 3, wherein the communications circuitry is wireless communications circuitry that wirelessly receives the image based content from the electronic device.
The head-mounted apparatus defined in claim 1, wherein the stimulus is a sound and wherein the sensor is a microphone configured to detect the sound.
The head-mounted apparatus defined in claim 1, wherein the stimulus is a voice command and wherein the sensor is a microphone configured to detect the voice command.
The head-mounted apparatus defined in claim 6, wherein the processor is configured to operate in the second mode in response to determining that the voice command is a voice command of a person on a contact list.
The head-mounted apparatus defined in claim 1, further comprising: a speaker that is configured to provide audio at a volume that is lowered in response to the stimulus.
The head-mounted apparatus defined in claim 1, wherein the display is configured to display a visual cue in response to detection of the stimulus by the sensor and wherein the visual cue is associated with a direction of the stimulus.
The head-mounted apparatus defined in claim 1, further comprising a haptic device that produces vibrations corresponding to the image based content.
The head-mounted apparatus defined in claim 1, wherein the sensor is a proximity sensor and wherein the stimulus is associated with detection of an object by the proximity sensor.
A head-mounted apparatus configured to be worn by a user, the head-mounted apparatus comprising: a frame; a display supported by the frame; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor, wherein the sensor is a proximity sensor, and wherein the stimulus is associated with detection of an object around the user by the proximity sensor.
A head-mounted apparatus comprising: a frame; a display supported by the frame, wherein the display is configured to present a left image frame and a right image frame; lenses adjacent to the display through which the display is viewable; and an optical sensor that is configured to gather eye location information, wherein the display is configured to adjust a position of the left image frame on the display and a position of the right image frame on the display based on the eye location information to accommodate an interpupillary distance.
A head-mounted apparatus comprising: a support structure; a display supported by the support structure; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor.
The head-mounted apparatus defined in claim 14, wherein the processor is configured to overlay the captured image over a portion of the image based content in the second mode.
The head-mounted apparatus defined in claim 14, further comprising: communications circuitry that receives the image based content from an electronic device.
The head-mounted apparatus defined in claim 16, wherein the communications circuitry is wireless communications circuitry that wirelessly receives the image based content from the electronic device.
The head-mounted apparatus defined in claim 14, wherein the stimulus is a sound and wherein the sensor is a microphone configured to detect the sound.
The head-mounted apparatus defined in claim 14, wherein the stimulus is a voice command and wherein the sensor is a microphone configured to detect the voice command.
The head-mounted apparatus defined in claim 19, wherein the processor is configured to operate in the second mode in response to determining that the voice command is a voice command of a person on a contact list.
The head-mounted apparatus defined in claim 14, further comprising: a speaker that is configured to provide audio at a volume that is lowered in response to the stimulus.
The head-mounted apparatus defined in claim 14, wherein the display is configured to display a visual cue in response to detection of the stimulus by the sensor and wherein the visual cue is associated with a direction of the stimulus.
The head-mounted apparatus defined in claim 14, further comprising a haptic device that produces vibrations corresponding to the image based content.
The head-mounted apparatus defined in claim 14, wherein the sensor is a proximity sensor and wherein the stimulus is associated with detection of an object by the proximity sensor.
The head-mounted apparatus defined in claim 14, wherein the support structure has a goggles form factor.
The head-mounted apparatus defined in claim 14, wherein the support structure has a glasses form factor.

Citations (59)

DE10047237A1
DE10103922A1
US2002082879A1
US2002101568A1
US2002140633A1
US2002186180A1
US2002196202A1
US2003062675A1
US2003142081A1
US2004113867A1
US2005278750A1
US2006017657A1
US2006052146A1
US2006061555A1
US2006098087A1
US2006119539A1
US2006119576A1
US2006197750A1
US2007162853A1
US2007195012A1
US2007201737A1
US2007237491A1
US2008088529A1
US2008088936A1
US2008088937A1
US2008249895A1
US2008255889A1
US2008276178A1
US2008276196A1
US2009102746A1
US2009128448A1
US2010331721A1
US2011090135A1
US4575722A
US5003300A
US5451976A
US5632742A
US5696521A
US6046712A
US6101038A
US6320559B1
US6323846B1
US6450639B1
US6480174B1
US6611653B1
US6734834B1
US6760772B2
US6971072B1
US7245273B2
US7530019B2
US7542012B2
US7595933B2
US7631968B1
US7675683B2
US8957835B2
WO0231577A1
WO0231578A1
WO0231580A1
WO0233472A2

Record as JSON

{
  "publication_number": "US9646574B2",
  "country": "US",
  "kind": "B2",
  "title": "Head-mounted display apparatus for retaining a portable electronic device with display",
  "abstract": "Head-mounted display systems and methods of operation that allow users to couple and decouple a portable electronic device such as a handheld portable electronic device with a separate head-mounted device (e.g., temporarily integrates the separate devices into a single unit) are disclosed. The portable electronic may be physically coupled to the head-mounted device such that the portable electronic device can be worn on the user's head. The portable electronic device may be operatively coupled to the head-mounted device such that the portable electronic device and head mounted device can communicate and operate with one another. Each device may be allowed to extend its features and/or services to the other device for the purpose of enhancing, increasing and/or eliminating redundant functions between the head-mounted device and the portable electronic device.",
  "claims": [
    "1. A head-mounted apparatus comprising: a frame; a display supported by the frame; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor.",
    "2. The head-mounted apparatus defined in claim 1, wherein the processor is configured to overlay the captured image over a portion of the image based content in the second mode.",
    "3. The head-mounted apparatus defined in claim 1, further comprising: communications circuitry that receives the image based content from an electronic device.",
    "4. The head-mounted apparatus defined in claim 3, wherein the communications circuitry is wireless communications circuitry that wirelessly receives the image based content from the electronic device.",
    "5. The head-mounted apparatus defined in claim 1, wherein the stimulus is a sound and wherein the sensor is a microphone configured to detect the sound.",
    "6. The head-mounted apparatus defined in claim 1, wherein the stimulus is a voice command and wherein the sensor is a microphone configured to detect the voice command.",
    "7. The head-mounted apparatus defined in claim 6, wherein the processor is configured to operate in the second mode in response to determining that the voice command is a voice command of a person on a contact list.",
    "8. The head-mounted apparatus defined in claim 1, further comprising: a speaker that is configured to provide audio at a volume that is lowered in response to the stimulus.",
    "9. The head-mounted apparatus defined in claim 1, wherein the display is configured to display a visual cue in response to detection of the stimulus by the sensor and wherein the visual cue is associated with a direction of the stimulus.",
    "10. The head-mounted apparatus defined in claim 1, further comprising a haptic device that produces vibrations corresponding to the image based content.",
    "11. The head-mounted apparatus defined in claim 1, wherein the sensor is a proximity sensor and wherein the stimulus is associated with detection of an object by the proximity sensor.",
    "12. A head-mounted apparatus configured to be worn by a user, the head-mounted apparatus comprising: a frame; a display supported by the frame; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor, wherein the sensor is a proximity sensor, and wherein the stimulus is associated with detection of an object around the user by the proximity sensor.",
    "13. A head-mounted apparatus comprising: a frame; a display supported by the frame, wherein the display is configured to present a left image frame and a right image frame; lenses adjacent to the display through which the display is viewable; and an optical sensor that is configured to gather eye location information, wherein the display is configured to adjust a position of the left image frame on the display and a position of the right image frame on the display based on the eye location information to accommodate an interpupillary distance.",
    "14. A head-mounted apparatus comprising: a support structure; a display supported by the support structure; a camera configured to capture an image; a sensor that is configured to detect a stimulus; lenses adjacent to the display through which the display is viewable; and a processor configured to operate in a first mode in which image based content is displayed on the display without displaying the captured image and in a second mode in which the captured image is displayed on at least a portion of the display, wherein the processor is configured to operate in the second mode in response to detection of the stimulus by the sensor.",
    "15. The head-mounted apparatus defined in claim 14, wherein the processor is configured to overlay the captured image over a portion of the image based content in the second mode.",
    "16. The head-mounted apparatus defined in claim 14, further comprising: communications circuitry that receives the image based content from an electronic device.",
    "17. The head-mounted apparatus defined in claim 16, wherein the communications circuitry is wireless communications circuitry that wirelessly receives the image based content from the electronic device.",
    "18. The head-mounted apparatus defined in claim 14, wherein the stimulus is a sound and wherein the sensor is a microphone configured to detect the sound.",
    "19. The head-mounted apparatus defined in claim 14, wherein the stimulus is a voice command and wherein the sensor is a microphone configured to detect the voice command.",
    "20. The head-mounted apparatus defined in claim 19, wherein the processor is configured to operate in the second mode in response to determining that the voice command is a voice command of a person on a contact list.",
    "21. The head-mounted apparatus defined in claim 14, further comprising: a speaker that is configured to provide audio at a volume that is lowered in response to the stimulus.",
    "22. The head-mounted apparatus defined in claim 14, wherein the display is configured to display a visual cue in response to detection of the stimulus by the sensor and wherein the visual cue is associated with a direction of the stimulus.",
    "23. The head-mounted apparatus defined in claim 14, further comprising a haptic device that produces vibrations corresponding to the image based content.",
    "24. The head-mounted apparatus defined in claim 14, wherein the sensor is a proximity sensor and wherein the stimulus is associated with detection of an object by the proximity sensor.",
    "25. The head-mounted apparatus defined in claim 14, wherein the support structure has a goggles form factor.",
    "26. The head-mounted apparatus defined in claim 14, wherein the support structure has a glasses form factor."
  ],
  "cpc": [
    "H04M 1/05",
    "A45F 5/00",
    "G02B 2027/0132",
    "G02B 2027/014",
    "G02B 2027/0156",
    "G02B 2027/0169",
    "G02B 2027/0178",
    "G02B 27/0093",
    "G02B 27/017",
    "G02B 27/0172",
    "G02B 27/0176",
    "G02B 27/022",
    "G02B 27/028",
    "G06F 1/163",
    "G06F 1/1632",
    "G06F 1/20",
    "G06F 1/203",
    "G06F 1/206",
    "G06F 3/012",
    "G06F 3/013",
    "G06F 3/0362",
    "G06F 3/041",
    "G06F 3/0412",
    "G06F 3/14",
    "G06F 3/16",
    "G06T 19/006",
    "G09G 2320/10",
    "G09G 2340/0407",
    "G09G 3/001",
    "G09G 5/005",
    "G09G 5/14",
    "G09G 5/377",
    "G09G 5/391",
    "H04B 1/385",
    "H04B 2001/3866",
    "H04M 1/0266",
    "H04M 1/72454",
    "H04M 1/72569",
    "H04N 23/51",
    "H04N 5/2252",
    "H04W 4/80"
  ],
  "assignees": [
    "APPLE INC"
  ],
  "filing_date": "2016-09-23",
  "publication_date": "2017-05-09",
  "grant_date": "2017-05-09",
  "priority_date": "2008-09-30",
  "application_number": "US-201615274901-A",
  "family_id": "42056846",
  "citations": [
    "DE10047237A1",
    "DE10103922A1",
    "US2002082879A1",
    "US2002101568A1",
    "US2002140633A1",
    "US2002186180A1",
    "US2002196202A1",
    "US2003062675A1",
    "US2003142081A1",
    "US2004113867A1",
    "US2005278750A1",
    "US2006017657A1",
    "US2006052146A1",
    "US2006061555A1",
    "US2006098087A1",
    "US2006119539A1",
    "US2006119576A1",
    "US2006197750A1",
    "US2007162853A1",
    "US2007195012A1",
    "US2007201737A1",
    "US2007237491A1",
    "US2008088529A1",
    "US2008088936A1",
    "US2008088937A1",
    "US2008249895A1",
    "US2008255889A1",
    "US2008276178A1",
    "US2008276196A1",
    "US2009102746A1",
    "US2009128448A1",
    "US2010331721A1",
    "US2011090135A1",
    "US4575722A",
    "US5003300A",
    "US5451976A",
    "US5632742A",
    "US5696521A",
    "US6046712A",
    "US6101038A",
    "US6320559B1",
    "US6323846B1",
    "US6450639B1",
    "US6480174B1",
    "US6611653B1",
    "US6734834B1",
    "US6760772B2",
    "US6971072B1",
    "US7245273B2",
    "US7530019B2",
    "US7542012B2",
    "US7595933B2",
    "US7631968B1",
    "US7675683B2",
    "US8957835B2",
    "WO0231577A1",
    "WO0231578A1",
    "WO0231580A1",
    "WO0233472A2"
  ]
}

Record 1,688 of 5,000 in Patents full text (MLC-0201). Request the full dataset.