MLchartDataset catalogue

Patent · US10594985B2 · B2 · US

Systems and methods for automated cloud-based analytics for security and/or surveillance

(11) Publication number
US10594985B2
(21) Application number
15/999,403
(22) Filing date
2018-08-20
(30) Priority date
2014-04-10
(43) Publication date
2020-03-17
(45) Date of grant
2020-03-17
(51) IPC
B25J 9/16; G05D 1/02; G06K 9/00; G06T 19/00; G08B 13/00; G08B 13/196; H04L 29/08; H04N 13/239; H04N 13/275; H04N 21/60; H04N 7/18
(52) CPC
  • H04N Pictorial communication, e.g. television: 7/181, 13/239, 13/275, 7/18
  • B25J Manipulators; chambers provided with manipulation devices: 9/1679
  • G05D Systems for controlling or regulating non-electric variables: 1/021, 2201/0209
  • G06K Graphical data reading; presentation of data; record carriers; handling record carriers: 9/00771, 9/00979
  • G06T Image data processing or generation, in general: 19/003
  • G06V Image or video recognition or understanding: 10/95, 20/52
  • G08B Signalling systems, e.g. personal calling systems; order telegraphs; alarm systems: 13/00, 13/19656
  • H04L Transmission of digital information, e.g. telegraphic communication: 67/02, 67/10, 67/1097, 67/12, 67/125, 67/22, 67/306, 67/34, 67/535
  • Y10S Technical subjects covered by former uspc cross-reference art collections [xracs] and digests: 901/01, 901/47, 901/50
(73) Assignee
Sensormatic Electronics LLC
(72) Inventors
Martin A. Renkis
(54) Title
Systems and methods for automated cloud-based analytics for security and/or surveillance
(57) Abstract

Systems and methods for virtualized computing or cloud-computing network with distributed input devices and at least one remote server computer for automatically analyzing received video, audio and/or image inputs for providing social security and/or surveillance for a surveillance environment, surveillance event, and/or surveillance target.

Full text
View on Google Patents

Claims (20)

  1. A surveillance system, comprising: at least one server computer configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer; and wherein the at least one server computer includes at least one processor and a memory storing instructions, wherein the instructions are executable by the at least one processor to cause the at least one server computer to - receive, via a network, inputs captured by the unregistered remote input devices that correspond, based on time and locations of the unregistered remote, input devices, to at least one predetermined surveillance environment, surveillance event, or surveillance target; authenticate the inputs; and analyze the authenticated inputs based on at least one predetermined surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.
  2. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to - receive an input profile; associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target based on the received input profile; receive positional information for the remote input devices; and analyze the positional information to authenticate the inputs from the unregistered remote input devices located at the at least one predetermined surveillance environment, surveillance event, or surveillance target.
  3. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to automatically associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target.
  4. The system of claim 3 wherein the association of the inputs is based at least in part on an input profile.
  5. The system of claim 1 wherein the authentication of the inputs includes - confirming global positioning system (GPS) locations of each of the remote input devices providing inputs, and matching the GPS locations with the at least one predetermined surveillance environment, surveillance event, or surveillance target.
  6. The system of claim 1, wherein the authentication of the inputs is based at least in part on (a) at least one of a device identification, a user identification, a geographic location, or a time associated with each input and (b) the at least one predetermined surveillance environment, surveillance event, or surveillance target.
  7. The system of claim 1 wherein the instructions are executable by the processor to cause the at least one sever computer to analyze the inputs to verify that the inputs have not been altered prior to their receipt by the at least one server computer.
  8. The system of claim 1 wherein the at least one surveillance profile includes at least one of a security level, an alert level, an authorized remote input device, or user information.
  9. The system of claim 1 wherein the inputs are received within a secure messaging communicated via the network.
  10. The system of claim 1 wherein the inputs are selected from the group consisting of live streaming videos, real-time images, real-time audio, previously recorded videos, previously captured images, and previously recorded audio.
  11. The system of claim 1 wherein the remote input devices are selected from the group consisting of mobile phones, smart phones, tablet computers, portable computers, mobile communication devices, wearable input capture devices, and security cameras.
  12. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to provide access of the analyzed inputs to a remote computing device.
  13. A method for providing surveillance, the method comprising: receiving, at least one server computer, inputs from unregistered remote input devices via the network, the at least one server computer is configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer; authenticating the inputs from the unregistered remote input devices at locations and time corresponding to at least one predetermined surveillance environment, surveillance event, or surveillance target; and analyzing the inputs, at the at least one server computer, based on at least one surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.
  14. The method of claim 13 wherein analyzing the inputs includes analyzing the inputs in near-real-time to determine the status of security.
  15. The method of claim 13 wherein authenticating the inputs includes automatically authenticating one or more of the remote input devices and/or users associated with the remote input devices based on at least one of a device identification, a user identification, a geographic location, or a time associated with each input.
  16. The method of claim 13, further comprising automatically associating the inputs with the at least one surveillance environment, surveillance event, or surveillance target.
  17. The method of claim 13, further comprising transmitting an indication of the status of security to a remote computing device.
  18. A method for providing surveillance, the method comprising: capturing one or more inputs via a mobile computing device, wherein the one or more inputs are associated with at least one surveillance environment, surveillance event, or surveillance target; and transmitting, from the mobile computing device, the one or more inputs to a remote server computer, wherein the mobile computing device is not registered with the remote server computer, and wherein the remote server computer is configured to (a) authenticate the one or more inputs from mobile computing devices in which time and location of the mobile computing devices correspond to at least one surveillance environment, surveillance event, or surveillance target, and (b) analyze the one or more inputs based on at least one surveillance profile for the at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.
  19. The method of claim 18, further comprising: transmitting, from the mobile computing device, metadata associated with the one or more inputs to the remote server computer, wherein the metadata includes at least one of a time associated with the inputs, a location associated with the inputs, geographic information associated with the inputs, a text notation associated with the inputs, an audio notation associated with the inputs, or a priority flag associated with the inputs, and wherein the remote server computer is configured to associate the one or more inputs with the at least one surveillance environment, surveillance event, or surveillance target based on the metadata.
  20. The method of claim 18, further comprising: automatically verifying, at the mobile computing device, a user of the mobile computing device; and transmitting, from the mobile computing device, information about the verification to the remote server computer, wherein the remote server computer is configured to authenticate the inputs based at least in part on the verification information.

Description

The present invention relates to cloud-based systems and methods for automated analytics of inputs from remote, distributed devices for security surveillance.

It is known in the prior art to use mobile devices for security surveillance, as well as to analyze image and video content for surveillance purposes. While the prior art discloses individual aspects as the present invention, very few, if any, teach the ability to authenticate and analyze captured inputs from un-registered user-devices. The present invention permits remote servers to accept captured inputs from a variety of mobile devices, authenticate metadata from the inputs, and analyze the inputs to provide surveillance information.

The proliferation of wireless, mobile devices having image and video functions is widespread and use of these device-functions continues to increase. Sporting events, social gatherings, dissident events, and emergency situations are typically captured on a multitude of devices operated by differing users. Nowhere in the prior art is provided social surveillance or security system that allows for uploading of these captured inputs, authentication of such inputs, and cloud-based analysis of the inputs in order to provide real- or near real-time surveillance of a target environment. Prior art documents teach that camera and video input devices may be equipped with a time-stamp function that embeds a date and time into an image or video for later authentication.

Citations (118)

  • US7379879B1
  • US20050055330A1
  • US6842674B2
  • US20040030571A1
  • US20040143602A1
  • US7295778B2
  • US20060037081A1
  • US20070064109A1
  • US20060066720A1
  • US20120310836A1
  • US8284254B2
  • US20100090841A1
  • US7944454B2
  • US7675520B2
  • US20070152807A1
  • US20070159323A1
  • US8395664B2
  • US20080250462A1
  • US20110034209A1
  • US20090087161A1
  • US8559914B2
  • US8745086B2
  • US8233660B2
  • US8311983B2
  • US20130027552A1
  • US20100274816A1
  • US20110018998A1
  • US20130039542A1
  • US20110090334A1
  • US20110256886A1
  • US20110187703A1
  • US20140085501A1
  • US8811697B2
  • US20110273567A1
  • US20110288684A1
  • US20110316697A1
  • US20130166621A1
  • US20120054841A1
  • US9011607B2
  • US20120114296A1
  • US20120113121A1
  • US8584209B1
  • US20120146789A1
  • US20120163657A1
  • US20130293344A1
  • US8718837B2
  • US20120262576A1
  • US20120282884A1
  • US8639644B1
  • US20130141543A1
  • US20140192159A1
  • US20130021640A1
  • KR20130011807A
  • US20130030875A1
  • US8903551B2
  • US20130063489A1
  • US8721197B2
  • US20130085625A1
  • US20130102283A1
  • US20140340510A1
  • US20130166711A1
  • US8751043B2
  • US20130188031A1
  • US20150022664A1
  • US9061561B2
  • US20130197718A1
  • US20130290234A1
  • US20130226655A1
  • US20130242107A1
  • US20130338525A1
  • US20130289858A1
  • US9058706B2
  • US20140020061A1
  • US8532820B1
  • US20140122702A1
  • US20140122720A1
  • US20140123325A1
  • US20140168453A1
  • US20140258444A1
  • US20150381536A1
  • US20140266669A1
  • US20160119607A1
  • US20140310186A1
  • US20140333615A1
  • US20140365273A1
  • US20170201725A1
  • US20150022666A1
  • US20150058447A1
  • US20140307076A1
  • US20150127191A1
  • US20150298315A1
  • US20150149392A1
  • US20150215583A1
  • US20160357762A1
  • US20150221193A1
  • US20150248503A1
  • US9216509B2
  • US9516281B1
  • US20150381417A1
  • US9407880B2
  • US9407879B2
  • US9407881B2
  • US9405979B2
  • US9420238B2
  • US9426428B2
  • US9438865B2
  • US9514370B1
  • US20150381949A1
  • US9514371B1
  • US9516279B1
  • US9516278B1
  • US9516280B1
  • US10217003B2
  • US9686514B2
  • US20150296186A1
  • US9747502B2
  • US10057546B2
  • US20150364021A1
Record as JSON 
{
  "publication_number": "US10594985B2",
  "country": "US",
  "kind": "B2",
  "title": "Systems and methods for automated cloud-based analytics for security and/or surveillance",
  "abstract": "Systems and methods for virtualized computing or cloud-computing network with distributed input devices and at least one remote server computer for automatically analyzing received video, audio and/or image inputs for providing social security and/or surveillance for a surveillance environment, surveillance event, and/or surveillance target.",
  "claims": [
    "1. A surveillance system, comprising: at least one server computer configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer; and wherein the at least one server computer includes at least one processor and a memory storing instructions, wherein the instructions are executable by the at least one processor to cause the at least one server computer to - receive, via a network, inputs captured by the unregistered remote input devices that correspond, based on time and locations of the unregistered remote, input devices, to at least one predetermined surveillance environment, surveillance event, or surveillance target; authenticate the inputs; and analyze the authenticated inputs based on at least one predetermined surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.",
    "2. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to - receive an input profile; associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target based on the received input profile; receive positional information for the remote input devices; and analyze the positional information to authenticate the inputs from the unregistered remote input devices located at the at least one predetermined surveillance environment, surveillance event, or surveillance target.",
    "3. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to automatically associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target.",
    "4. The system of claim 3 wherein the association of the inputs is based at least in part on an input profile.",
    "5. The system of claim 1 wherein the authentication of the inputs includes - confirming global positioning system (GPS) locations of each of the remote input devices providing inputs, and matching the GPS locations with the at least one predetermined surveillance environment, surveillance event, or surveillance target.",
    "6. The system of claim 1, wherein the authentication of the inputs is based at least in part on (a) at least one of a device identification, a user identification, a geographic location, or a time associated with each input and (b) the at least one predetermined surveillance environment, surveillance event, or surveillance target.",
    "7. The system of claim 1 wherein the instructions are executable by the processor to cause the at least one sever computer to analyze the inputs to verify that the inputs have not been altered prior to their receipt by the at least one server computer.",
    "8. The system of claim 1 wherein the at least one surveillance profile includes at least one of a security level, an alert level, an authorized remote input device, or user information.",
    "9. The system of claim 1 wherein the inputs are received within a secure messaging communicated via the network.",
    "10. The system of claim 1 wherein the inputs are selected from the group consisting of live streaming videos, real-time images, real-time audio, previously recorded videos, previously captured images, and previously recorded audio.",
    "11. The system of claim 1 wherein the remote input devices are selected from the group consisting of mobile phones, smart phones, tablet computers, portable computers, mobile communication devices, wearable input capture devices, and security cameras.",
    "12. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to provide access of the analyzed inputs to a remote computing device.",
    "13. A method for providing surveillance, the method comprising: receiving, at least one server computer, inputs from unregistered remote input devices via the network, the at least one server computer is configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer; authenticating the inputs from the unregistered remote input devices at locations and time corresponding to at least one predetermined surveillance environment, surveillance event, or surveillance target; and analyzing the inputs, at the at least one server computer, based on at least one surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.",
    "14. The method of claim 13 wherein analyzing the inputs includes analyzing the inputs in near-real-time to determine the status of security.",
    "15. The method of claim 13 wherein authenticating the inputs includes automatically authenticating one or more of the remote input devices and/or users associated with the remote input devices based on at least one of a device identification, a user identification, a geographic location, or a time associated with each input.",
    "16. The method of claim 13, further comprising automatically associating the inputs with the at least one surveillance environment, surveillance event, or surveillance target.",
    "17. The method of claim 13, further comprising transmitting an indication of the status of security to a remote computing device.",
    "18. A method for providing surveillance, the method comprising: capturing one or more inputs via a mobile computing device, wherein the one or more inputs are associated with at least one surveillance environment, surveillance event, or surveillance target; and transmitting, from the mobile computing device, the one or more inputs to a remote server computer, wherein the mobile computing device is not registered with the remote server computer, and wherein the remote server computer is configured to (a) authenticate the one or more inputs from mobile computing devices in which time and location of the mobile computing devices correspond to at least one surveillance environment, surveillance event, or surveillance target, and (b) analyze the one or more inputs based on at least one surveillance profile for the at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.",
    "19. The method of claim 18, further comprising: transmitting, from the mobile computing device, metadata associated with the one or more inputs to the remote server computer, wherein the metadata includes at least one of a time associated with the inputs, a location associated with the inputs, geographic information associated with the inputs, a text notation associated with the inputs, an audio notation associated with the inputs, or a priority flag associated with the inputs, and wherein the remote server computer is configured to associate the one or more inputs with the at least one surveillance environment, surveillance event, or surveillance target based on the metadata.",
    "20. The method of claim 18, further comprising: automatically verifying, at the mobile computing device, a user of the mobile computing device; and transmitting, from the mobile computing device, information about the verification to the remote server computer, wherein the remote server computer is configured to authenticate the inputs based at least in part on the verification information."
  ],
  "description_excerpt": "The present invention relates to cloud-based systems and methods for automated analytics of inputs from remote, distributed devices for security surveillance.\n\nIt is known in the prior art to use mobile devices for security surveillance, as well as to analyze image and video content for surveillance purposes. While the prior art discloses individual aspects as the present invention, very few, if any, teach the ability to authenticate and analyze captured inputs from un-registered user-devices. The present invention permits remote servers to accept captured inputs from a variety of mobile devices, authenticate metadata from the inputs, and analyze the inputs to provide surveillance information.\n\nThe proliferation of wireless, mobile devices having image and video functions is widespread and use of these device-functions continues to increase. Sporting events, social gatherings, dissident events, and emergency situations are typically captured on a multitude of devices operated by differing users. Nowhere in the prior art is provided social surveillance or security system that allows for uploading of these captured inputs, authentication of such inputs, and cloud-based analysis of the inputs in order to provide real- or near real-time surveillance of a target environment. Prior art documents teach that camera and video input devices may be equipped with a time-stamp function that embeds a date and time into an image or video for later authentication.",
  "cpc": [
    "H04N 7/181",
    "B25J 9/1679",
    "G05D 1/021",
    "G05D 2201/0209",
    "G06K 9/00771",
    "G06K 9/00979",
    "G06T 19/003",
    "G06V 10/95",
    "G06V 20/52",
    "G08B 13/00",
    "G08B 13/19656",
    "H04L 67/02",
    "H04L 67/10",
    "H04L 67/1097",
    "H04L 67/12",
    "H04L 67/125",
    "H04L 67/22",
    "H04L 67/306",
    "H04L 67/34",
    "H04L 67/535",
    "H04N 13/239",
    "H04N 13/275",
    "H04N 7/18",
    "Y10S 901/01",
    "Y10S 901/47",
    "Y10S 901/50"
  ],
  "ipc": [
    "B25J 9/16",
    "G05D 1/02",
    "G06K 9/00",
    "G06T 19/00",
    "G08B 13/00",
    "G08B 13/196",
    "H04L 29/08",
    "H04N 13/239",
    "H04N 13/275",
    "H04N 21/60",
    "H04N 7/18"
  ],
  "assignees": [
    "Sensormatic Electronics LLC"
  ],
  "inventors": [
    "Martin A. Renkis"
  ],
  "filing_date": "2018-08-20",
  "publication_date": "2020-03-17",
  "grant_date": "2020-03-17",
  "priority_date": "2014-04-10",
  "application_number": "US-201815999403-A",
  "family_id": "54266162",
  "cited_by_count": 3,
  "citations": [
    "US7379879B1",
    "US20050055330A1",
    "US6842674B2",
    "US20040030571A1",
    "US20040143602A1",
    "US7295778B2",
    "US20060037081A1",
    "US20070064109A1",
    "US20060066720A1",
    "US20120310836A1",
    "US8284254B2",
    "US20100090841A1",
    "US7944454B2",
    "US7675520B2",
    "US20070152807A1",
    "US20070159323A1",
    "US8395664B2",
    "US20080250462A1",
    "US20110034209A1",
    "US20090087161A1",
    "US8559914B2",
    "US8745086B2",
    "US8233660B2",
    "US8311983B2",
    "US20130027552A1",
    "US20100274816A1",
    "US20110018998A1",
    "US20130039542A1",
    "US20110090334A1",
    "US20110256886A1",
    "US20110187703A1",
    "US20140085501A1",
    "US8811697B2",
    "US20110273567A1",
    "US20110288684A1",
    "US20110316697A1",
    "US20130166621A1",
    "US20120054841A1",
    "US9011607B2",
    "US20120114296A1",
    "US20120113121A1",
    "US8584209B1",
    "US20120146789A1",
    "US20120163657A1",
    "US20130293344A1",
    "US8718837B2",
    "US20120262576A1",
    "US20120282884A1",
    "US8639644B1",
    "US20130141543A1",
    "US20140192159A1",
    "US20130021640A1",
    "KR20130011807A",
    "US20130030875A1",
    "US8903551B2",
    "US20130063489A1",
    "US8721197B2",
    "US20130085625A1",
    "US20130102283A1",
    "US20140340510A1",
    "US20130166711A1",
    "US8751043B2",
    "US20130188031A1",
    "US20150022664A1",
    "US9061561B2",
    "US20130197718A1",
    "US20130290234A1",
    "US20130226655A1",
    "US20130242107A1",
    "US20130338525A1",
    "US20130289858A1",
    "US9058706B2",
    "US20140020061A1",
    "US8532820B1",
    "US20140122702A1",
    "US20140122720A1",
    "US20140123325A1",
    "US20140168453A1",
    "US20140258444A1",
    "US20150381536A1",
    "US20140266669A1",
    "US20160119607A1",
    "US20140310186A1",
    "US20140333615A1",
    "US20140365273A1",
    "US20170201725A1",
    "US20150022666A1",
    "US20150058447A1",
    "US20140307076A1",
    "US20150127191A1",
    "US20150298315A1",
    "US20150149392A1",
    "US20150215583A1",
    "US20160357762A1",
    "US20150221193A1",
    "US20150248503A1",
    "US9216509B2",
    "US9516281B1",
    "US20150381417A1",
    "US9407880B2",
    "US9407879B2",
    "US9407881B2",
    "US9405979B2",
    "US9420238B2",
    "US9426428B2",
    "US9438865B2",
    "US9514370B1",
    "US20150381949A1",
    "US9514371B1",
    "US9516279B1",
    "US9516278B1",
    "US9516280B1",
    "US10217003B2",
    "US9686514B2",
    "US20150296186A1",
    "US9747502B2",
    "US10057546B2",
    "US20150364021A1"
  ]
}

Record 2,260 of 8,000 in Patents full text (MLC-0201). Request the full dataset.