Systems and methods for reducing boot time and power consumption in wearable display systems

{
  "publication_number": "US9678338B1",
  "country": "US",
  "kind": "B1",
  "title": "Systems and methods for reducing boot time and power consumption in wearable display systems",
  "abstract": "Systems and methods for communications with wearable devices having displays with low boot time are provided. In one example embodiment, a display command is received at a low-power processor, and the low-power processor boots a video processor. The video processor then boots a high-speed processor as part of managing display of content. In certain embodiments, a low-power wireless connection from a camera to a client device is established. Based on this connection, the low-power processor initiates boot-up of a high-speed processor and wireless communication circuitry, which is used to receive content for display on the wearable device.",
  "claims": [
    "1. A method comprising: establishing a low-power wireless connection between a wearable device and a client device; receiving, at low-power wireless circuitry of the wearable device, a display communication comprising instructions to display content data on a display of the wearable device, wherein the content data comprises map information and visual direction information received via a high-speed wireless circuitry; processing, by a low-power processor coupled to the low-power wireless circuitry, the display communication; powering, in response to the processing of the display communication, a high-speed processor; accessing, by the high-speed processor, the content data, wherein accessing the content data comprises: establishing a high-speed wireless connection with the client device and receiving the content data from the client device via the high-speed wireless connection, and wherein the map information and visual direction information is streamed to the wearable device from a server via the client device; determining, by the high-speed processor, a first period of time for display of the content data; powering on the display and displaying, using the display, the content data for the first period of time; automatically turning off the display following display of the content data for the first period of time; automatically turning off the high-speed processor following display of the content data for the first period of time; accessing, by the wearable device, location data from a positioning system; determining, using the high-speed processor and the location data, that a physical location of a user is approaching a direction path of the visual direction information; and displaying the visual direction information in response to the determining that the physical location of the user is approaching the direction path; determining, using the positioning system, that the visual direction information displayed on the wearable device has been followed; and wherein the first period of time is determined based on the determining that the visual direction information has been followed.",
    "2. The method of claim 1 further comprising: communicating, from the low-power wireless circuitry of the wearable device to the client device, a high-speed power on query; and receiving, at the low-power wireless circuitry, a response from the client device indicating that high-speed wireless circuitry should be powered on; and powering on the high-speed wireless circuitry in response to the response from the client device; wherein the high-speed processor is further booted in response to the response from the client device.",
    "3. The method of claim 2 wherein establishing the high-speed wireless connection further comprises: failing to establish the high-speed wireless connection following receipt of the response from the client device; and powering down the high-speed wireless circuitry and the high-speed processor following the failure to establish the high-speed wireless connection; wherein the display communication is received via the low-power wireless circuitry following the failure to establish the high-speed wireless connection.",
    "4. The method of claim 1 wherein the location data is received at the wearable device from the positioning system operating on the client device.",
    "5. The method of claim 1 wherein the first period of time is a predetermined number fixed by a device setting.",
    "6. The method of claim 1 wherein the first period of time is determined by sensor data from the wearable device.",
    "7. The method of claim 1 further comprising: determining, from the display communication, that the content data is not stored locally in a memory of the wearable device.",
    "8. The method of claim 1 further comprising: receiving, at an interface of a camera device during display of the content data, a user input; interrupting display of the content data in response to receipt of the user input; transmitting a user input signal from the interface to the low-power processor of the camera device; and in response to the user input signal, automatically: booting a video processor; capturing, using the video processor, first camera data; writing the first camera data to a memory; shutting down the video processor after writing the first camera data to the memory; and resuming display of the content data.",
    "9. A device comprising: a frame; a display coupled to the frame; a memory coupled to the frame; low-power circuitry comprising a low-power processor and low-power wireless circuitry configured to receive a display communication, the display communication comprising instructions to display content data on a display of the wearable device, wherein the content data comprises map information and visual direction information received the high-speed wireless circuitry; a video processor coupled to the low-power processor, the video processor configured to, in response to a boot signal from the low-power circuitry initiated by the display communication: access content data, wherein accessing the content data comprises establishing a high-speed wireless connection with the client device and receiving the content data from the client device via the high-speed wireless connection, and wherein the map information and visual direction information is streamed to the wearable device from a server via the client device; determine a first period of time for display of the content data; power on the display and display the content data for the first period of time; automatically turn off the display following output of the content data for the first period of time; automatically turn off the video processor following display of the content data for the first period of time; accessing, by the wearable device, location data from a positioning system; determining, using a high-speed processor and the location data, that a physical location of a user is approaching a direction path of the visual direction information; displaying the visual direction information in response to the determining that the physical location of the user is approaching the direction path; determining, using the positioning system, that the visual direction information displayed on the wearable device has been followed; and wherein the first period of time is determined based on the determining that the visual direction information has been followed.",
    "10. The device of claim 9 further comprising: first optical assembly extending over at least a portion of a first optical element holder of the frame, wherein the first optical assembly comprises the display.",
    "11. The device of claim 10 wherein the display comprises a liquid crystal display.",
    "12. The device of claim 10 further comprising: one or more speakers coupled to the frame; a second display; and a second optical assembly coupled to the frame and extending over at least a portion of a second optical element holder of the frame, wherein the second optical assembly comprises the second display; wherein the second display is operated by the video processor.",
    "13. A non-transitory machine-readable medium comprising instructions that, when executed by a wearable device, configures the wearable device for a set of operations comprising: establishing a low-power wireless connection between the wearable device and a client device; receiving, at low-power wireless circuitry of the wearable device, a display communication comprising instructions to display content data on a display of the wearable device, wherein the content data comprises map information and visual direction information received via a high-speed wireless circuitry; processing, by a low-power processor coupled to the low-power wireless circuitry, the display communication; powering, in response to the processing of the display communication, a high-speed processor; accessing, by the high-speed processor, the content data, wherein accessing the content data comprises: establishing a high-speed wireless connection with the client device and receiving the content data from the client device via the high-speed wireless connection, and wherein the map information and visual direction information is streamed to the wearable device from a server via the client device; determining, by the high-speed processor, a first period of time for display of the content data; powering on the display and displaying, using the display, the content data for the first period of time; automatically turning off the display following display of the content data for the first period of time; automatically turning off the high-speed processor following display of the content data for the first period of time; accessing, by the wearable device, location data from a positioning system; determining, using the high-speed processor and the location data, that a physical location of a user is approaching a direction path of the visual direction information; displaying the visual direction information in response to the determining that the physical location of the user is approaching the direction path; determining, using the positioning system, that the visual direction information displayed on the wearable device has been followed; and wherein the first period of time is determined based on the determining that the visual direction information has been followed.",
    "14. The non-transitory machine-readable medium of claim 13, wherein the instructions further cause the low-power processor to: periodically transmit a service set identifier (SSID) using low-power wireless circuitry integrated with the low-power processor; receive, from a client device, a connection request in response to the SSID transmission; establish a low-power wireless connection with a client device in response to the connection request; and terminate periodic transmission of the SSID for a duration of the low-power wireless connection.",
    "15. The non-transitory machine-readable medium of claim 13, wherein the instructions further cause the wearable device to perform operations comprising: communicating, from the low-power wireless circuitry of the wearable device to the client device, a high-speed power on query; and receiving, at the low-power wireless circuitry, a response from the client device indicating that high-speed wireless circuitry should be powered on; and powering on the high-speed wireless circuitry in response to the response from the client device; wherein the high-speed processor is further booted in response to the response from the client device.",
    "16. The non-transitory machine-readable medium of claim 15, wherein the instructions further cause the wearable device to perform operations comprising: failing to establish the high-speed wireless connection following receipt of the response from the client device; and powering down the high-speed wireless circuitry and the high-speed processor following the failure to establish the high-speed wireless connection; wherein the display communication is received via the low-power wireless circuitry following the failure to establish the high-speed wireless connection.",
    "17. The non-transitory machine-readable medium of claim 13, wherein the location data is received at the wearable device from the positioning system operating on the client device.",
    "18. The non-transitory machine-readable medium of claim 13 wherein the first period of time is a predetermined number fixed by a device setting.",
    "19. The non-transitory machine-readable medium of claim 13 wherein the first period of time is determined by sensor data from the wearable device.",
    "20. The non-transitory machine-readable medium of claim 13, wherein the instructions further cause the wearable device to perform operations comprising: receiving, at an interface of a camera device during display of the content data, a user input; interrupting display of the content data in response to receipt of the user input; transmitting a user input signal from the interface to the low-power processor of the camera device; and in response to the user input signal, automatically: booting a video processor; capturing, using the video processor, first camera data; writing the first camera data to a memory; shutting down the video processor after writing the first camera data to the memory; and resuming display of the content data."
  ],
  "description_excerpt": "This application is a continuation of and claims the benefit of priority of U.S. patent application Ser. No. 14/665,964, filed on Mar. 23, 2015, which is herein incorporated by reference in its entirety.\n\nMany wearable display systems are severely constrained by form factor which limits battery size and single charge use time. This is particularly true for glasses with an integrated camera or display and wearable devices that integrate multiple functions using additional sensor or circuitry for other functions, all of which make use of the device battery.\n\nSystems and methods described herein therefore include wearable display systems with improved boot operation and power consumption.\n\nVarious ones of the appended drawings merely illustrate example embodiments of the present disclosure and should not be considered as limiting its scope.\n\nFIG. 1 is a front perspective view of one embodiment of a camera device.\n\nFIG. 2 is a block diagram illustrating a networked system including details of a camera device, according to some example embodiments.\n\nFIG. 3 is a flow diagram illustrating aspects of camera device operation according to some example embodiments.\n\nFIG. 4 is a diagram illustrating a method of camera device operation according to some example embodiments.\n\nFIGS. 5 and 6 illustrate camera devices including displays according to certain example embodiments.\n\nFIG. 7 is a flow diagram illustrating aspects of camera device operation according to some example embodiments.\n\nFIG. 8 is a flow diagram illustrating a method of camera device operation according to some example embodiments.",
  "cpc": [
    "G02B 27/01",
    "G02B 2027/0178",
    "G02B 27/017",
    "G02C 11/10",
    "G06F 1/163",
    "G06F 1/32",
    "G06F 1/3203",
    "G06F 1/3206",
    "G06F 1/3287",
    "G06F 1/3293",
    "H04N 23/631",
    "H04N 23/64",
    "H04N 23/651",
    "H04N 23/66",
    "H04N 23/661",
    "H04N 5/23203",
    "H04N 5/23222",
    "H04N 5/76",
    "Y02D 10/00",
    "Y02D 30/50"
  ],
  "ipc": [
    "G02B 27/01",
    "G02C 11/00",
    "G06F 1/16",
    "H04N 5/232"
  ],
  "assignees": [
    "Snap Inc"
  ],
  "inventors": [
    "Alex BAMBERGER",
    "Peter BROOK",
    "Nicolas Dahlquist",
    "Matthew Hanover",
    "Russell Douglas Patton",
    "II Jonathan M Rodriguez"
  ],
  "filing_date": "2015-06-19",
  "publication_date": "2017-06-13",
  "grant_date": "2017-06-13",
  "priority_date": "2015-03-23",
  "application_number": "US-201514744832-A",
  "family_id": "59009171",
  "cited_by_count": 40,
  "citations": [
    "US20100271490A1",
    "US20060284876A1",
    "US20100141762A1",
    "US20090251558A1",
    "US20110221656A1",
    "US20110296222A1",
    "US20120084547A1",
    "US8934045B2",
    "US8549205B1",
    "US20130335546A1",
    "US20140075169A1",
    "US20140204245A1",
    "US20140368688A1",
    "US20150103235A1",
    "US20150121108A1",
    "US20150195442A1"
  ]
}