Patent · US9919712B1 · B1 · US

Crew biometrics and aircraft data analysis with real-time and proactive actions

(11) Publication number

US9919712B1

(21) Application number

14/937,591

(22) Filing date

2015-11-10

(30) Priority date

2015-08-10

(43) Publication date

2018-03-20

(45) Date of grant

2018-03-20

(51) IPC

B60W 40/08; G08B 23/00

(52) CPC

B60W Conjoint control of vehicle sub-units of different type or different function; control systems specially adapted for hybrid vehicles; road vehicle drive control systems for purposes not related to the control of a particular sub-unit: 40/08, 2040/0818, 2050/143, 2050/146, 2540/215, 2540/221, 2756/10, 50/16, 60/0051
A61B Diagnosis; surgery; identification: 2560/0214, 2560/0242, 5/002, 5/0022, 5/02055, 5/02416, 5/02438, 5/0816, 5/082, 5/1118, 5/14542, 5/18, 5/4266, 5/486, 5/746, 5/747
B60K Arrangement or mounting of propulsion units or of transmissions in vehicles; arrangement or mounting of plural diverse prime-movers in vehicles; auxiliary drives for vehicles; instrumentation or dashboards for vehicles; arrangements in connection with cooling, air intake, gas exhaust or fuel supply of propulsion units in vehicles: 28/066
G16H Healthcare informatics, i.e. information and communication technology [ICT] specially adapted for the handling or processing of medical or healthcare data: 40/67, 80/00

(73) Assignee

Rockwell Collins Inc

(72) Inventors

William G. Doyen; Simon Critchley; Patrick D. McCusker; Talha S. Ansari; John M. Connelly

(54) Title

Crew biometrics and aircraft data analysis with real-time and proactive actions

(57) Abstract

A system and method may monitor the biometric data of an operator in real time or near real time. Low cost electronic devices may monitor operator vital signs and biometric data allowing the system to determine stress levels, hydration levels, possible illness, body or blood chemical levels, incapacitation risks, and other biometric parameters of the operator, and proactively notify the operator, others aboard the vehicle, the vehicle control systems, or ground control to take responsive action. Industrial electronics may enable the system to monitor ambient workspace temperature, pressure, oxygen levels, and other environmental parameters, offering the system an additional second source of information to detect and address factors affecting the capacity of the operator. The system may further compare biometric and ambient parameters to archived operator, ambient, location, route, or vehicle performance data to determine and respond to long-term data patterns.

Full text

View on Google Patents

Claims (13)

A method for monitoring a capacity of an operator, comprising: accessing, via a processor, an acceptable range associated with at least one operator biometric parameter of an operator of a vehicle; receiving, via the processor, the at least one operator biometric parameter from at least one operator biometric monitor; comparing, via the processor, the received at least one operator biometric parameter with the at least one acceptable range; directing, via the processor, at least one warning device of the vehicle to send a first warning to the operator if a result of the comparing includes at least one operator biometric parameter outside the associated acceptable range; receiving, via the processor, at least one operator workspace ambient parameter from a workspace ambient monitor; identifying, via the processor, at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter; directing, via the processor, the at least one warning device to send the first warning to the operator if the at least one target data pattern is identified; executing a response action via the processor if either a) the result of the comparing includes the at least one operator biometric parameter outside the associated acceptable range or b) the at least one target data pattern is identified, the execution of the response action after a variable delay and including at least one of: 1) directing the at least one warning device to send a second warning to at least one of the operator and an individual aboard the vehicle; 2) directing a vehicle control device to adjust the at least one operator workspace ambient parameter; 3) activating an autopilot system of the vehicle; and 4) directing a communications device to send a notification offboard the vehicle; and discontinuing the response action based on a receipt of an intervention from the operator during the variable delay.
The method of claim 1, wherein the at least one operator biometric parameter includes at least one of a pulse rate, a respiration rate, a skin temperature, an activity level, a perspiration level, a voice stress level, a blood chemical level, and a breath chemical level.
The method of claim 1, wherein directing, via the processor, at least one warning device of the vehicle to send a first warning to the operator includes at least one of: 1) directing, via the processor, at least one audio warning device of the vehicle to send a first auditory warning to the operator; 2) directing, via the processor, at least one of a visual warning device of the vehicle and an operational display of the vehicle to send a first visual warning to the operator; and 3) directing, via the processor, at least one physical warning device of the vehicle to send a first tactile warning to the operator.
The method of claim 3, wherein the at least one physical warning device includes the at least one operator biometric monitor.
The method of claim 1, further comprising: acquiring, via the processor, at least one operator specific detail, the at least one operator specific detail acquired via at least one of the at least one operator biometric monitor, an input from the operator, and a memory; acquiring, via the processor, an operational status of the vehicle; and adjusting, via the processor, the at least one acceptable range based on at least one of the at least one received operator specific detail and the received operational status of the vehicle.
The method of claim 1, wherein the at least one operator workspace ambient parameter includes at least one of an air temperature level, a motion level, an air pressure level, a humidity level, a light level, and an air chemical level.
The method of claim 1, wherein identifying, via the processor, at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter includes: identifying, via the processor, the at least one target data pattern based on one or more of the received at least one operator biometric parameter, the received at least one operator workspace ambient parameter, archived data associated with the at least one operator, archived data associated with the at least one operator workspace ambient parameter, archived data associated with at least one location of the vehicle, and data associated with the performance of the vehicle.
A system for monitoring a capacity of an operator, comprising: at least one processor; a memory operatively connected with the at least one processor, the memory storing non-transitory computer readable program code for monitoring the capacity of an operator of a vehicle, the computer readable program code comprising instructions which, when executed by the at least one processor, cause the at least one processor to perform and direct the steps of: accessing an acceptable range associated with at least one operator biometric parameter of an operator of a vehicle; receiving the at least one operator biometric parameter from at least one operator biometric monitor communicatively coupled to the at least one processor; comparing the received at least one operator biometric parameter with the acceptable range; directing at least one warning device of the vehicle to send a first warning to the operator if a result of the comparing includes at least one operator biometric parameter outside the associated acceptable range; receiving at least one operator workspace ambient parameter from a workspace ambient monitor; identifying at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter; directing the at least one warning device to send the first warning to the operator if the at least one target data pattern is identified; executing a response action if either a) the result of the comparing includes the at least one operator biometric parameter outside the associated acceptable range or b) the at least one target data pattern is identified, the execution of the response action after a variable delay and including at least one of: 1) directing the at least one warning device to send a second warning to at least one of the operator and an individual aboard the vehicle; 2) directing a vehicle control device to adjust the at least one operator workspace ambient parameter; 3) activating an autopilot system of the vehicle; and 4) directing a communications device of the vehicle to send a notification offboard the vehicle; and discontinuing the response action based on a receipt of an intervention from the operator during the variable delay.
The system of claim 8, wherein the at least one processor is housed within at least one of a battery powered portable electronic device, a battery powered electronic flight bag, and an aircraft powered and certified electronic flight bag.
The system of claim 8, wherein the at least one workspace ambient monitor includes one of a portable battery powered monitor configured to be carried by the operator and a sensor installed in the workspace and receiving power from a vehicle power supply, and wherein the at least one operator workspace ambient parameter includes at least one of an air temperature level, a motion level, an air pressure level, a humidity level, a light level, a volume level, and an air chemical level.
The system of claim 8, wherein: the at least one operator biometric monitor includes at least one of a monitor worn on a wrist of the operator, a monitor worn on a leg of the operator, a monitor worn on an extremity of the operator, a monitor proximal to a skin of the operator, and a monitor attached to a torso of the operator; and the at least one operator biometric parameter includes at least one of a pulse rate, a respiration rate, a skin temperature, an activity level, a perspiration level, a voice stress level, a blood chemical level, and a breath chemical level.
The system of claim 8, wherein the instructions further cause the at least one processor to perform and direct the steps of: acquiring at least one operator specific detail, the at least one operator specific detail acquired via at least one of the at least one operator biometric monitor, an input from the operator, and a memory; acquiring an operational status of the vehicle; and adjusting the at least one acceptable range based on at least one of the at least one received operator specific detail and the received operational status of the vehicle.
The system of claim 8, wherein the instructions further cause the at least one processor to perform and direct the steps of: determining the at least one target data pattern by comparing one or more of the received at least one operator biometric parameter, the received at least one operator workspace ambient parameter, archived data associated with the at least one operator, archived data associated with the at least one operator workspace ambient parameter, archived data associated with at least one location of the vehicle, and data associated with the performance of the vehicle.

Description

Embodiments of the inventive concepts disclosed herein relate generally to monitoring a capacity of an operator of a vehicle. More particularly, embodiments of the inventive concepts disclosed herein relate to a system and related method for biometric monitoring of an operator as well as monitoring of an environment in which the operator is physically located and execution of a responsive action should the monitoring reveal an abnormality.

In single operator vehicles, early detection of operator incapacitation may be one method to reduce accidents. Some examples of single operator vehicles may include a small business aircraft as well as a current military fighter aircraft and a commuter train. Incapacitation of the single operator may lead to dire consequences.

In aviation, a number of catastrophic or near catastrophic events including pilot suicide, and errors due to pilot fatigue such as inadvertent pilot sleep, overflying a destination, and/or landing at the wrong airport can occur. These situations may pose serious potential consequences to the safety of the passengers, crew and those on the ground.

Traditional operator monitoring solutions may employ a pulse oximeter system physically temporarily attached to the finger of the single operator to measure blood oxygen saturation. During high workload where the operator may need the use of the finger, these devices are problematic as they interfere with the operator's ability to manipulate controls.

Citations (2)

US20160082838A1
US9637133B1

Record as JSON

{
  "publication_number": "US9919712B1",
  "country": "US",
  "kind": "B1",
  "title": "Crew biometrics and aircraft data analysis with real-time and proactive actions",
  "abstract": "A system and method may monitor the biometric data of an operator in real time or near real time. Low cost electronic devices may monitor operator vital signs and biometric data allowing the system to determine stress levels, hydration levels, possible illness, body or blood chemical levels, incapacitation risks, and other biometric parameters of the operator, and proactively notify the operator, others aboard the vehicle, the vehicle control systems, or ground control to take responsive action. Industrial electronics may enable the system to monitor ambient workspace temperature, pressure, oxygen levels, and other environmental parameters, offering the system an additional second source of information to detect and address factors affecting the capacity of the operator. The system may further compare biometric and ambient parameters to archived operator, ambient, location, route, or vehicle performance data to determine and respond to long-term data patterns.",
  "claims": [
    "1. A method for monitoring a capacity of an operator, comprising: accessing, via a processor, an acceptable range associated with at least one operator biometric parameter of an operator of a vehicle; receiving, via the processor, the at least one operator biometric parameter from at least one operator biometric monitor; comparing, via the processor, the received at least one operator biometric parameter with the at least one acceptable range; directing, via the processor, at least one warning device of the vehicle to send a first warning to the operator if a result of the comparing includes at least one operator biometric parameter outside the associated acceptable range; receiving, via the processor, at least one operator workspace ambient parameter from a workspace ambient monitor; identifying, via the processor, at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter; directing, via the processor, the at least one warning device to send the first warning to the operator if the at least one target data pattern is identified; executing a response action via the processor if either a) the result of the comparing includes the at least one operator biometric parameter outside the associated acceptable range or b) the at least one target data pattern is identified, the execution of the response action after a variable delay and including at least one of: 1) directing the at least one warning device to send a second warning to at least one of the operator and an individual aboard the vehicle; 2) directing a vehicle control device to adjust the at least one operator workspace ambient parameter; 3) activating an autopilot system of the vehicle; and 4) directing a communications device to send a notification offboard the vehicle; and discontinuing the response action based on a receipt of an intervention from the operator during the variable delay.",
    "2. The method of claim 1, wherein the at least one operator biometric parameter includes at least one of a pulse rate, a respiration rate, a skin temperature, an activity level, a perspiration level, a voice stress level, a blood chemical level, and a breath chemical level.",
    "3. The method of claim 1, wherein directing, via the processor, at least one warning device of the vehicle to send a first warning to the operator includes at least one of: 1) directing, via the processor, at least one audio warning device of the vehicle to send a first auditory warning to the operator; 2) directing, via the processor, at least one of a visual warning device of the vehicle and an operational display of the vehicle to send a first visual warning to the operator; and 3) directing, via the processor, at least one physical warning device of the vehicle to send a first tactile warning to the operator.",
    "4. The method of claim 3, wherein the at least one physical warning device includes the at least one operator biometric monitor.",
    "5. The method of claim 1, further comprising: acquiring, via the processor, at least one operator specific detail, the at least one operator specific detail acquired via at least one of the at least one operator biometric monitor, an input from the operator, and a memory; acquiring, via the processor, an operational status of the vehicle; and adjusting, via the processor, the at least one acceptable range based on at least one of the at least one received operator specific detail and the received operational status of the vehicle.",
    "6. The method of claim 1, wherein the at least one operator workspace ambient parameter includes at least one of an air temperature level, a motion level, an air pressure level, a humidity level, a light level, and an air chemical level.",
    "7. The method of claim 1, wherein identifying, via the processor, at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter includes: identifying, via the processor, the at least one target data pattern based on one or more of the received at least one operator biometric parameter, the received at least one operator workspace ambient parameter, archived data associated with the at least one operator, archived data associated with the at least one operator workspace ambient parameter, archived data associated with at least one location of the vehicle, and data associated with the performance of the vehicle.",
    "8. A system for monitoring a capacity of an operator, comprising: at least one processor; a memory operatively connected with the at least one processor, the memory storing non-transitory computer readable program code for monitoring the capacity of an operator of a vehicle, the computer readable program code comprising instructions which, when executed by the at least one processor, cause the at least one processor to perform and direct the steps of: accessing an acceptable range associated with at least one operator biometric parameter of an operator of a vehicle; receiving the at least one operator biometric parameter from at least one operator biometric monitor communicatively coupled to the at least one processor; comparing the received at least one operator biometric parameter with the acceptable range; directing at least one warning device of the vehicle to send a first warning to the operator if a result of the comparing includes at least one operator biometric parameter outside the associated acceptable range; receiving at least one operator workspace ambient parameter from a workspace ambient monitor; identifying at least one target data pattern based on one or more of the at least one operator biometric parameter and the at least one operator workspace ambient parameter; directing the at least one warning device to send the first warning to the operator if the at least one target data pattern is identified; executing a response action if either a) the result of the comparing includes the at least one operator biometric parameter outside the associated acceptable range or b) the at least one target data pattern is identified, the execution of the response action after a variable delay and including at least one of: 1) directing the at least one warning device to send a second warning to at least one of the operator and an individual aboard the vehicle; 2) directing a vehicle control device to adjust the at least one operator workspace ambient parameter; 3) activating an autopilot system of the vehicle; and 4) directing a communications device of the vehicle to send a notification offboard the vehicle; and discontinuing the response action based on a receipt of an intervention from the operator during the variable delay.",
    "9. The system of claim 8, wherein the at least one processor is housed within at least one of a battery powered portable electronic device, a battery powered electronic flight bag, and an aircraft powered and certified electronic flight bag.",
    "10. The system of claim 8, wherein the at least one workspace ambient monitor includes one of a portable battery powered monitor configured to be carried by the operator and a sensor installed in the workspace and receiving power from a vehicle power supply, and wherein the at least one operator workspace ambient parameter includes at least one of an air temperature level, a motion level, an air pressure level, a humidity level, a light level, a volume level, and an air chemical level.",
    "11. The system of claim 8, wherein: the at least one operator biometric monitor includes at least one of a monitor worn on a wrist of the operator, a monitor worn on a leg of the operator, a monitor worn on an extremity of the operator, a monitor proximal to a skin of the operator, and a monitor attached to a torso of the operator; and the at least one operator biometric parameter includes at least one of a pulse rate, a respiration rate, a skin temperature, an activity level, a perspiration level, a voice stress level, a blood chemical level, and a breath chemical level.",
    "12. The system of claim 8, wherein the instructions further cause the at least one processor to perform and direct the steps of: acquiring at least one operator specific detail, the at least one operator specific detail acquired via at least one of the at least one operator biometric monitor, an input from the operator, and a memory; acquiring an operational status of the vehicle; and adjusting the at least one acceptable range based on at least one of the at least one received operator specific detail and the received operational status of the vehicle.",
    "13. The system of claim 8, wherein the instructions further cause the at least one processor to perform and direct the steps of: determining the at least one target data pattern by comparing one or more of the received at least one operator biometric parameter, the received at least one operator workspace ambient parameter, archived data associated with the at least one operator, archived data associated with the at least one operator workspace ambient parameter, archived data associated with at least one location of the vehicle, and data associated with the performance of the vehicle."
  ],
  "description_excerpt": "Embodiments of the inventive concepts disclosed herein relate generally to monitoring a capacity of an operator of a vehicle. More particularly, embodiments of the inventive concepts disclosed herein relate to a system and related method for biometric monitoring of an operator as well as monitoring of an environment in which the operator is physically located and execution of a responsive action should the monitoring reveal an abnormality.\n\nIn single operator vehicles, early detection of operator incapacitation may be one method to reduce accidents. Some examples of single operator vehicles may include a small business aircraft as well as a current military fighter aircraft and a commuter train. Incapacitation of the single operator may lead to dire consequences.\n\nIn aviation, a number of catastrophic or near catastrophic events including pilot suicide, and errors due to pilot fatigue such as inadvertent pilot sleep, overflying a destination, and/or landing at the wrong airport can occur. These situations may pose serious potential consequences to the safety of the passengers, crew and those on the ground.\n\nTraditional operator monitoring solutions may employ a pulse oximeter system physically temporarily attached to the finger of the single operator to measure blood oxygen saturation. During high workload where the operator may need the use of the finger, these devices are problematic as they interfere with the operator's ability to manipulate controls.",
  "cpc": [
    "B60W 40/08",
    "A61B 2560/0214",
    "A61B 2560/0242",
    "A61B 5/002",
    "A61B 5/0022",
    "A61B 5/02055",
    "A61B 5/02416",
    "A61B 5/02438",
    "A61B 5/0816",
    "A61B 5/082",
    "A61B 5/1118",
    "A61B 5/14542",
    "A61B 5/18",
    "A61B 5/4266",
    "A61B 5/486",
    "A61B 5/746",
    "A61B 5/747",
    "B60K 28/066",
    "B60W 2040/0818",
    "B60W 2050/143",
    "B60W 2050/146",
    "B60W 2540/215",
    "B60W 2540/221",
    "B60W 2756/10",
    "B60W 50/16",
    "B60W 60/0051",
    "G16H 40/67",
    "G16H 80/00"
  ],
  "ipc": [
    "B60W 40/08",
    "G08B 23/00"
  ],
  "assignees": [
    "Rockwell Collins Inc"
  ],
  "inventors": [
    "William G. Doyen",
    "Simon Critchley",
    "Patrick D. McCusker",
    "Talha S. Ansari",
    "John M. Connelly"
  ],
  "filing_date": "2015-11-10",
  "publication_date": "2018-03-20",
  "grant_date": "2018-03-20",
  "priority_date": "2015-08-10",
  "application_number": "US-201514937591-A",
  "family_id": "61600184",
  "cited_by_count": 52,
  "citations": [
    "US20160082838A1",
    "US9637133B1"
  ]
}

Record 3,521 of 8,000 in Patents full text (MLC-0201). Request the full dataset.