MLchartDataset catalogue

Patent · US11412203B1 · B1 · US

Smart sensor and its system for autonomous system

(11) Publication number
US11412203B1
(21) Application number
17/079,469
(22) Filing date
2020-10-24
(30) Priority date
2017-10-15
(43) Publication date
2022-08-09
(45) Date of grant
2022-08-09
(51) IPC
B25J 9/16; G05D 1/00; H04N 13/204; H04N 13/25; H04N 13/254; H04N 13/271
(52) CPC
  • H04N Pictorial communication, e.g. television: 13/254, 13/204, 13/271, 2213/001, 25/705, 25/772, 25/78
  • B25J Manipulators; chambers provided with manipulation devices: 9/163, 9/1697
  • G01S Radio direction-finding; radio navigation; determining distance or velocity by use of radio waves; locating or presence-detecting by use of the reflection or reradiation of radio waves; analogous arrangements using other waves: 17/86, 17/89
  • G05D Systems for controlling or regulating non-electric variables: 1/0088
(73) Assignee
Banpil Photonics Inc
(72) Inventors
Achyut Kumar Dutta
(54) Title
Smart sensor and its system for autonomous system
(57) Abstract

This invention relates to a sensor and sensor platform, for an autonomous system. The sensor and its platform sense, perform signal or data processing, and make the decision locally at the point of sensing. More specifically, the sensor along with its platform simulates the human-like or human capacity to make decisions by combing the data from several sensors that detect different data sets, and combine them in a series of data processes that allows autonomous decisions to be made. Additionally, the sensor platform combines multiple sensors in one metasensor with the functionality of multiple sensors placed on a common carrier or platform.

Full text
View on Google Patents

Claims (20)

  1. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types; a motion information of the object with respect to the sensor; and determine the object type, and/or a combination of thereof; a processor, wherein the processor configured to provide a decision to the autonomous vehicle on a moving motion and a direction and/or the state of movement from the output image, the motion information and the distance information of the object in the scene.
  2. A sensor system according to claim 1, further comprising an electronic means, interfacing with the signal processing unit and/or the processor.
  3. A sensor system according to 1, wherein the signal processing unit and/or the processor further configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.
  4. A sensor system according to claim 1, wherein the sensor unit further comprising another sensor selected from a group consisting of radar, ultrasound sensor, range sensor, image sensor, or a combination of thereof.
  5. A sensor system according to claim 1, further comprising an preprocessing unit located close proximity to the signal processing unit wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.
  6. A sensor system according to claim 1, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.
  7. A sensor system according to claim 1, wherein the signal processing unit and the processor are a single electronic means.
  8. A sensor system according to claim 1, further comprising a emitter, wherein the emitter provides electromagnetic radiation.
  9. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located close proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types, a motion information of the object with respect to the sensor; and determine the object type, and/or a combination of thereof; a processor, wherein the processor configured to provide a decision to the autonomous vehicle on a moving motion and a direction and/or the state of movement from the output image, the motion information and the distance information of the object in the scene, and; a communication network to communicate information between the signal processing unit and the sensor unit and/or between the signal processing unit and the processor.
  10. A sensor system according to 9, wherein the signal processing unit and/or the processor further configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.
  11. A sensor system according to claim 9, wherein the sensor unit further comprising another sensor selected from a group consisting of radar, ultrasound sensor, range sensor, image sensor, or a combination of thereof.
  12. A sensor system according to claim 9, further comprising an preprocessing unit located close proximity to the signal processing unit, wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.
  13. A sensor system according to claim 9, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.
  14. A sensor system according to claim 9, wherein the signal processing unit and the processor are a single electronic means.
  15. A sensor system according to claim 9, further comprising a emitter, wherein the emitter provides electromagnetic radiation.
  16. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located close proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types, a motion information of the object with respect to the sensor; determine the object type, and/or a combination of thereof; a processor unit comprising a first section, wherein the first section gathers an information from the signal processing unit; a second section having machine trained model, created in the processor and/or outside the sensor system; a third section making a decision information based on an output information from the first section and/or the second section, and; a communication network to communicate information between the signal processing unit and the sensor unit and/or between the signal processing unit and the processor.
  17. A sensor system according to 16, wherein the signal processing unit and/or the processor configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.
  18. A sensor system according to claim 16, further comprising an preprocessing unit located close proximity to the signal processing unit, wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.
  19. A sensor system according to claim 16, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.
  20. A sensor system according to claim 16, wherein the signal processing unit and the processor are a single electronic means.

Description

This is continuation application (s) Ser. No. 15/814,271 filed on Nov. 15, 2017.

This invention relates to a sensor and its associated sensor platform, comprises a single sensor (herein after mentioned as Meta Sensor) or multiple sensor devices, that can provide different sets of functional data, and processing of the functional data from a Meta Sensor into aggregated information either pre-processing and/or combination of that information in the sensor and/or a part/whole processed off-chip or on-chip to get data which can provide a decision from processed data. The decision and/or decision matrix created in real-time or pseudo-real-time from various functionality are done using a learning framework for evaluating the information to make a single or multiple decisions based on each functionality and/or single key decision which may be bound by certain conditions. This invention pertains to the functions and operations of any autonomous system including, but not limited to those used for aerial, ground, sea, space and/or aquatic applications. It also includes autonomous systems used in robotic applications including but not limited to consumer and industrial robotics, which incorporate sensors or sensing apparatus for the purpose of sensing, detecting, vision, and decisions making like human (i.e. behavior, prediction, perception, cognitive capability etc.).

This invention pertains to the functions and operations of any autonomous system including but not limited to those used for aerial, ground, space and aquatic applications.

Citations (3)

  • US20140152839A1
  • US20170061710A1
  • US10841563B1
Record as JSON
{
  "publication_number": "US11412203B1",
  "country": "US",
  "kind": "B1",
  "title": "Smart sensor and its system for autonomous system",
  "abstract": "This invention relates to a sensor and sensor platform, for an autonomous system. The sensor and its platform sense, perform signal or data processing, and make the decision locally at the point of sensing. More specifically, the sensor along with its platform simulates the human-like or human capacity to make decisions by combing the data from several sensors that detect different data sets, and combine them in a series of data processes that allows autonomous decisions to be made. Additionally, the sensor platform combines multiple sensors in one metasensor with the functionality of multiple sensors placed on a common carrier or platform.",
  "claims": [
    "1. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types; a motion information of the object with respect to the sensor; and determine the object type, and/or a combination of thereof; a processor, wherein the processor configured to provide a decision to the autonomous vehicle on a moving motion and a direction and/or the state of movement from the output image, the motion information and the distance information of the object in the scene.",
    "2. A sensor system according to claim 1, further comprising an electronic means, interfacing with the signal processing unit and/or the processor.",
    "3. A sensor system according to 1, wherein the signal processing unit and/or the processor further configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.",
    "4. A sensor system according to claim 1, wherein the sensor unit further comprising another sensor selected from a group consisting of radar, ultrasound sensor, range sensor, image sensor, or a combination of thereof.",
    "5. A sensor system according to claim 1, further comprising an preprocessing unit located close proximity to the signal processing unit wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.",
    "6. A sensor system according to claim 1, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.",
    "7. A sensor system according to claim 1, wherein the signal processing unit and the processor are a single electronic means.",
    "8. A sensor system according to claim 1, further comprising a emitter, wherein the emitter provides electromagnetic radiation.",
    "9. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located close proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types, a motion information of the object with respect to the sensor; and determine the object type, and/or a combination of thereof; a processor, wherein the processor configured to provide a decision to the autonomous vehicle on a moving motion and a direction and/or the state of movement from the output image, the motion information and the distance information of the object in the scene, and; a communication network to communicate information between the signal processing unit and the sensor unit and/or between the signal processing unit and the processor.",
    "10. A sensor system according to 9, wherein the signal processing unit and/or the processor further configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.",
    "11. A sensor system according to claim 9, wherein the sensor unit further comprising another sensor selected from a group consisting of radar, ultrasound sensor, range sensor, image sensor, or a combination of thereof.",
    "12. A sensor system according to claim 9, further comprising an preprocessing unit located close proximity to the signal processing unit, wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.",
    "13. A sensor system according to claim 9, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.",
    "14. A sensor system according to claim 9, wherein the signal processing unit and the processor are a single electronic means.",
    "15. A sensor system according to claim 9, further comprising a emitter, wherein the emitter provides electromagnetic radiation.",
    "16. A sensor system operating in an autonomous vehicle comprising: a sensor unit comprising a sensor, wherein the sensor comprising more than one pixel, wherein the more than one pixel comprises: at least one pixel of first type; wherein the at least one pixel of first type received a radiation from an object and provide a signal of first type, and; at least one pixel of second type, wherein the at least one pixel of second type receives a reflected radiation from the object and provide a signal of second type; wherein the more than one pixel is arranged in one-dimensional or 2-dimensional array; a signal processing unit, wherein the signal processing unit located close proximity to the sensor unit and configured to provide a computer readable output image of a scene and/or a distance information of the object in the scene from the signal of first type and/or the second types, a motion information of the object with respect to the sensor; determine the object type, and/or a combination of thereof; a processor unit comprising a first section, wherein the first section gathers an information from the signal processing unit; a second section having machine trained model, created in the processor and/or outside the sensor system; a third section making a decision information based on an output information from the first section and/or the second section, and; a communication network to communicate information between the signal processing unit and the sensor unit and/or between the signal processing unit and the processor.",
    "17. A sensor system according to 16, wherein the signal processing unit and/or the processor configured to provide a 3D cloud and/or mapping, tracking the object, and/or creating a machine perception.",
    "18. A sensor system according to claim 16, further comprising an preprocessing unit located close proximity to the signal processing unit, wherein the preprocessing unit collects sensor information from the sensor unit and configure to provide fused sensor information and/or unfused sensor information to the signal processing unit and/or the processor.",
    "19. A sensor system according to claim 16, wherein the sensor unit, the signal processing unit and/or the processor are in close proximate to a point of sensing and connected by wire or wireless means.",
    "20. A sensor system according to claim 16, wherein the signal processing unit and the processor are a single electronic means."
  ],
  "description_excerpt": "This is continuation application (s) Ser. No. 15/814,271 filed on Nov. 15, 2017.\n\nThis invention relates to a sensor and its associated sensor platform, comprises a single sensor (herein after mentioned as Meta Sensor) or multiple sensor devices, that can provide different sets of functional data, and processing of the functional data from a Meta Sensor into aggregated information either pre-processing and/or combination of that information in the sensor and/or a part/whole processed off-chip or on-chip to get data which can provide a decision from processed data. The decision and/or decision matrix created in real-time or pseudo-real-time from various functionality are done using a learning framework for evaluating the information to make a single or multiple decisions based on each functionality and/or single key decision which may be bound by certain conditions. This invention pertains to the functions and operations of any autonomous system including, but not limited to those used for aerial, ground, sea, space and/or aquatic applications. It also includes autonomous systems used in robotic applications including but not limited to consumer and industrial robotics, which incorporate sensors or sensing apparatus for the purpose of sensing, detecting, vision, and decisions making like human (i.e. behavior, prediction, perception, cognitive capability etc.).\n\nThis invention pertains to the functions and operations of any autonomous system including but not limited to those used for aerial, ground, space and aquatic applications.",
  "cpc": [
    "H04N 13/254",
    "B25J 9/163",
    "B25J 9/1697",
    "G01S 17/86",
    "G01S 17/89",
    "G05D 1/0088",
    "H04N 13/204",
    "H04N 13/271",
    "H04N 2213/001",
    "H04N 25/705",
    "H04N 25/772",
    "H04N 25/78"
  ],
  "ipc": [
    "B25J 9/16",
    "G05D 1/00",
    "H04N 13/204",
    "H04N 13/25",
    "H04N 13/254",
    "H04N 13/271"
  ],
  "assignees": [
    "Banpil Photonics Inc"
  ],
  "inventors": [
    "Achyut Kumar Dutta"
  ],
  "filing_date": "2020-10-24",
  "publication_date": "2022-08-09",
  "grant_date": "2022-08-09",
  "priority_date": "2017-10-15",
  "application_number": "US-202017079469-A",
  "family_id": "73263900",
  "cited_by_count": 0,
  "citations": [
    "US20140152839A1",
    "US20170061710A1",
    "US10841563B1"
  ]
}

Record 1,068 of 8,000 in Patents full text (MLC-0201). Request the full dataset.