Hybrid interface for simultaneous biosensing and user input

{
  "publication_number": "US12039100B2",
  "country": "US",
  "kind": "B2",
  "title": "Hybrid interface for simultaneous biosensing and user input",
  "abstract": "Dynamically adjustable EDA measurement device may include: a dynamically formable base comprising a soft robotics material, wherein the dynamically formable base comprises a formable surface configured to be dynamically formed in response to input signals; and an EDA sensing layer affixed to the formable surface of the dynamically formable base, the EDA sensing layer comprising a plurality of electrodes arranged on a flexible substrate and configured to be connected to a power supply; wherein, in response to input signals, the formable surface of the dynamically formable base and the EDA sensing layer affixed thereto are reformed into a desired contour.",
  "claims": [
    "1. A dynamically formable electrodermal activity (EDA) sensor, comprising: a dynamically formable base comprising a formable surface configured to be dynamically formed in response to input signals; an EDA sensing layer affixed to the formable surface of the dynamically formable base, the EDA sensing layer comprising a plurality of sensors connected to a power supply; and a processor configured to determine an EDA of a user based on EDA measurements from the EDA sensing layer, wherein the input signals are based on the determined EDA of the user, wherein, in response to the input signals, the formable surface of the dynamically formable base and the EDA sensing layer affixed thereto are reformed into a desired contour.",
    "2. The dynamically formable EDA sensor of claim 1, wherein the processor is further configured to provide the input signals to the dynamically formable base in response to pressure measurements to adjust the formable surface of the dynamically formable base to conform to a body part of the user.",
    "3. The dynamically formable EDA sensor of claim 1, wherein the dynamically formable base comprises a plurality of separately actuatable elements arranged in a matrix, such that controlling the input signals to each of the separately actuatable elements determines a result in contour of the formable surface.",
    "4. The dynamically formable EDA sensor of claim 1, wherein the dynamically formable base comprises a soft robotics material.",
    "5. The dynamically formable EDA sensor of claim 1, wherein the EDA sensing layer comprises a plurality of electrodes on a flexible substrate, and wherein the processor is configured to evaluate a connection strength between electrodes of the EDA sensing layer and skin of the user at a given time and to identify electrodes from which EDA measurements are to be made based on the evaluation.",
    "6. The dynamically formable EDA sensor of claim 5, wherein the processor is further configured to determine the EDA of the user based on EDA measurements from the identified electrodes.",
    "7. The dynamically formable EDA sensor of claim 5, wherein the EDA of the user is determined based on a combination of measurements from the identified electrodes.",
    "8. The dynamically formable EDA sensor of claim 1, wherein the dynamically formable base is configured to be reformed to conform to at least a portion of a hand of the user.",
    "9. The dynamically formable EDA sensor of claim 1, wherein the dynamically formable base is configured to be reformed to provide a haptic response to the user of the dynamically formable EDA sensor.",
    "10. The dynamically formable EDA sensor of claim 1, wherein the dynamically formable base is configured to be reformed to provide one or more raised regions on the formable surface based on the input signals, each of the one or more raised regions indicating a button configured to receive a user input.",
    "11. A hybrid electrodermal activity (EDA) sensor and user input device, comprising: a flexible EDA layer comprising a first flexible substrate and a plurality of electrodes disposed on the first flexible substrate; a flexible actuation layer affixed to the flexible EDA layer, the flexible actuation layer comprising electrical contacts disposed on a second flexible substrate; and a processor configured to determine an EDA of a user based on EDA measurements from one or more electrodes of the plurality of electrodes and provide an input signal to a formable surface based, in part, on the determined EDA of the user, wherein the formable surface is formed into a desired contour in response to the input signal.",
    "12. The hybrid EDA sensor and user input device of claim 11, wherein the first and second flexible substrates comprise transparent substrates, and wherein the plurality of electrodes disposed on the first flexible substrate and the electrical contacts disposed on the second flexible substrate comprise transparent conductive materials.",
    "13. The hybrid EDA sensor and user input device of claim 11, wherein the processor is further configured to provide the input signal to the flexible actuation layer based on an amount of pressure applied by the user to the flexible EDA layer.",
    "14. The hybrid EDA sensor and user input device of claim 11, wherein the processor is further configured to evaluate a connection strength between electrodes of the flexible EDA layer and skin of the user at a given time and to identify electrodes from which the EDA measurements are to be made based on the evaluation.",
    "15. The hybrid EDA sensor and user input device of claim 14, wherein the processor is further configured to determine the EDA of the user based on the EDA measurements from the identified electrodes.",
    "16. The hybrid EDA sensor and user input device of claim 14, wherein the EDA of the user is determined based on a combination of measurements from the identified electrodes.",
    "17. A system for processing information from a plurality of electrodermal activity (EDA) sensors to determine an EDA of a user, comprising: a processor; and a non-transitory memory coupled to the processor and configured to store instructions, the instructions, which when executed cause the processor to perform operations comprising: receiving information from a plurality of electrodes of an EDA sensor; determining an EDA measurement for the user based on the information received from the plurality of electrodes; and providing an input signal to a formable surface based, in part, on the determined EDA measurement for the user, wherein the formable surface is formed into a desired contour in response to the input signal.",
    "18. The system of claim 17, wherein determining an EDA measurement comprises computing a weighted average of EDA measurements from the plurality of electrodes.",
    "19. A method of processing information from a plurality of electrodermal activity (EDA) sensors to determine an EDA of a user, comprising: receiving information from a plurality of electrodes of an EDA sensor; determining an EDA measurement for the user based on the information received from the plurality of electrodes; and providing an input signal to a formable surface based, in part, on the determined EDA measurement for the user, wherein the formable surface is formed into a desired contour in response to the input signal.",
    "20. The method of claim 19, wherein determining an EDA measurement comprises computing a weighted average of EDA measurements from the plurality of electrodes."
  ],
  "description_excerpt": "The present disclosure relates generally to biosensing, and in particular, some implementations may relate to a conformable biosensor for various applications.\n\nUser-facing technology in passenger vehicles has evolved dramatically over recent years, and some vehicles have taken advantage of the latest advancements available. Accordingly, contemporary user interfaces are being tasked to allow the user to control greater functionality than ever before as well as to access a greater amount of information. Although today's user interfaces in the cabin are far from the simple switchgear that was common in 20 th century vehicles, these interfaces are still limited to somewhat conventional applications of buttons, knobs and touchscreen interfaces. In addition, vehicles are increasingly incorporating technology to sense and utilize bioinformatics from vehicle passengers. Bioinformatics information is used in a number of places, including vehicle safety systems to sense driver awareness and capacity. Some biosensing devices capable of measuring Electrodermal Activity (EDA) have been used to measure emotional state of the driver, which can be used to recognize driver stress levels. These methods typically require fixed electrodes adhered to the skin, such as those used with ECG devices. Accordingly, conventional biosensing devices for EDA measurements are not well suited to the passenger cabin.\n\nVarious embodiments of the disclosed technology relate to each hybrid surface for user input that allows a combination of touch input for actuation and sensing of Electrodermal Activity (EDA).",
  "cpc": [
    "G06F 3/015",
    "A61B 2562/0247",
    "A61B 2562/164",
    "A61B 5/0533",
    "A61B 5/165",
    "A61B 5/18",
    "B25J 13/084",
    "G06F 2203/011",
    "G06F 2203/04105",
    "G06F 3/011",
    "G06F 3/014",
    "G06F 3/016",
    "G06F 3/0446"
  ],
  "ipc": [
    "A61B 5/0533",
    "A61B 5/16",
    "A61B 5/18",
    "B25J 13/08",
    "G06F 3/01",
    "G06F 3/044"
  ],
  "assignees": [
    "TOYOTA ENG & MFG NORTH AMERICA"
  ],
  "inventors": [
    "SEVERGNINI FREDERICO MARCOLINO QUINTAO",
    "DEDE ERCAN MEHMET",
    "SCHMALENBERG PAUL D"
  ],
  "filing_date": "2023-04-28",
  "publication_date": "2024-07-16",
  "grant_date": "2024-07-16",
  "priority_date": "2020-10-21",
  "application_number": "US-202318309712-A",
  "family_id": "81186159",
  "citations": [
    "US11550385B2",
    "US2020164175A1"
  ]
}