Electronic apparatus and control method thereof

{
  "publication_number": "US12105780B2",
  "country": "US",
  "kind": "B2",
  "title": "Electronic apparatus and control method thereof",
  "abstract": "An electronic apparatus and a method of controlling the same are provided. The electronic apparatus includes a camera configured to capture an image, a communication interface, a memory configured to store at least one instruction, and a processor configured to obtain characteristics information of a user based on the image; based on the characteristics information of the user being obtained, identify whether first information corresponding to the characteristics information is stored in the memory; based on the corresponding first information not being stored in the memory, generate identification information corresponding to the characteristics information of the user, perform mapping of the characteristics information and the identification information of the user and store in the memory; and transmit the characteristics information and the identification information of the user to a second electronic apparatus.",
  "claims": [
    "1. An electronic apparatus, comprising: a camera configured to capture an image; a communication interface; a memory configured to store at least one instruction; and a processor configured to: obtain imaged characteristics information of a user based on the image, wherein the imaged characteristics information comprises a facial recognition information, a sex information, an age group information, a body type information and/or information on clothing worn by the user; based on the imaged characteristics information of the user being obtained, identify whether first information corresponding to the imaged characteristics information is stored in the memory as identification information; based on the corresponding first information not being stored in the memory, generate identification information corresponding to the imaged characteristics information of the user; perform mapping of the imaged characteristics information and the identification information of the user and store the mapping in the memory; and identify whether a second electronic apparatus is located in a same place as the electronic apparatus, based on the second electronic apparatus being located in the same place as the electronic apparatus, control the communication interface to transmit a first form of data including the imaged characteristics information, the identification information of the user and information related to at least one of the services requested by the user to the second electronic apparatus, based on the second electronic apparatus being located in a different place as the electronic apparatus, control the communication interface to transmit second information excluding the facial recognition information from among the imaged characteristics information to the second electronic apparatus, and to transmit the information related to the at least one of the requested services to the second electronic apparatus, identify whether a server is located in the same place as the electronic apparatus, based on the server being located in the same place as the electronic apparatus, control the communication interface to transmit the first form of data to the server, based on the server being located in the different place as the electronic apparatus, control the communication interface to transmit the second information to the server, and to transmit the information related to the at least one of the requested services to the server, wherein each of the electronic apparatus and the second electronic apparatus is configured to perform the at least one of the requested services to the user based on the information related to the at least one of the requested services, and wherein the processor is further configured to: control the communication interface to receive, from the server, service information presented to the user based on the identification information of the user, receive a user input to the service information, and in response to the user input for the service information, present additional service information to the user, the additional service information being related to the user input response to the service information, and receive a second user input to the additional service information, and control the communication interface to transmit, to the server, a request to update the additional service information with respect to the service information based on the second user input and the identification information of the user.",
    "2. The electronic apparatus of claim 1, wherein the processor is further configured to: based on the corresponding first information being stored in the memory, obtain the identification information of the user mapped in the corresponding first information from the memory, and perform the at least one of the requested services based on the obtained identification information.",
    "3. The electronic apparatus of claim 1, wherein the processor is further configured to, based on the at least one of the requested services being performed, control the communication interface to transmit the first information related to the at least one of the requested services performed to the user and the imaged characteristics information to the second electronic apparatus through a peer to peer (P2P) communication.",
    "4. The electronic apparatus of claim 1, wherein the processor is further configured to receive from the second electronic apparatus the imaged characteristics information and the identification information of the user via the communication interface and store, in the memory, the imaged characteristics information and the identification information of the user.",
    "5. The electronic apparatus of claim 1, wherein the processor is further configured to: based on respective characteristics information of a plurality of users being obtained from the image, generate respective identification information corresponding to each of the respective characteristics information of the plurality of users, and generate group identification information by grouping a plurality of identification information, generate group characteristics information based on at least one of the respective characteristics information of the plurality of users, and control the communication interface to transmit the respective identification information of the each of the plurality of users, the respective characteristics information, the group identification information and the group characteristics information to the second electronic apparatus.",
    "6. The electronic apparatus of claim 5, wherein the processor is further configured to, based on the at least one of the requested services being performed, control the communication interface to transmit, to the server, the information related to the at least one of the requested services performed and the group characteristics information.",
    "7. The electronic apparatus of claim 1, wherein the processor is further configured to: based on at least one of identifying at least one of a predetermined time passing or the user leaving the specific space, delete the imaged characteristics information and the identification information of the user from the memory.",
    "8. The electronic apparatus of claim 1, wherein the memory is configured to store a learning network model trained to obtain the imaged characteristics information of the user based on an input image, and wherein the processor is further configured to obtain the imaged characteristics information of the user by inputting the image to the learning network model.",
    "9. The electronic apparatus of claim 1, wherein both of the electronic apparatus and the second electronic apparatus is a moving robot that moves within the specific space.",
    "10. A control method of an electronic apparatus, the method comprising: obtaining imaged characteristics information of a user based on an image captured by a camera of the electronic apparatus, wherein the imaged characteristics information comprises a facial recognition information, a sex information, an age group information, a body type information and/or information on clothing worn by the user; based on the imaged characteristics information of the user being obtained, identifying whether first information corresponding to the imaged characteristics information is stored in the electronic apparatus as identification information; based on the corresponding first information not being stored in the electronic apparatus as identification information, generating identification information corresponding to the imaged characteristics information of the user; mapping and storing the imaged characteristics information and the identification information of the user; identifying whether a second electronic apparatus is located in a same place as the electronic apparatus, based on the second electronic apparatus being located in the same place as the electronic apparatus, transmitting a first form of data including the imaged characteristics information, the identification information of the user and information related to at least one of the services requested by the user to the second electronic apparatus, based on the second electronic apparatus being located in a different place as the electronic apparatus, transmitting second information excluding the facial recognition information from among the imaged characteristics information to the second electronic apparatus, and transmitting the information related to the at least one of the requested services to the second electronic apparatus, identifying whether a server is located in the same place as the electronic apparatus, based on the server being located in the same place as the electronic apparatus, transmitting the first form of data to the server, based on the server being located in the different place as the electronic apparatus, transmitting the second information to the server, and transmitting the information related to the at least one of the services to the server, wherein of the electronic apparatus and the second electronic apparatus performs the at least one of the requested services provided to the user based on the information related to the at least one of the requested services, wherein the method further comprises: receiving, from the server, service information presented to the user based on the identification information of the user; receiving a user input to the service information, and in response to the user input for the service information, present additional service information to the user, the additional service information being related to the user input response to the service information, and receiving a second user input to the additional service information, and transmitting, to the server, a request to update the additional service information with respect to the service information based on the second user input and the identification information of the user.",
    "11. The control method of claim 10, the method further comprising: based on the corresponding first information being stored in the electronic apparatus, obtaining the identification information of the user mapped in the corresponding first information from the electronic apparatus; and performing the at least one of the requested services based on the obtained identification information.",
    "12. The control method of claim 10, the method further comprising: based on the at least one of the requested services being performed, transmitting the information related to the at least one of the requested services performed to the user and the imaged characteristics information, to the second electronic apparatus through a peer to peer (P2P) communication.",
    "13. The control method of claim 10, the method further comprising: receiving from the second electronic apparatus the imaged characteristics information and the identification information of the user; and storing the imaged characteristics information and the identification information.",
    "14. The control method of claim 10, the method further comprising: based on respective characteristics information of a plurality of users being obtained from the image, generating respective identification information corresponding to each of the respective characteristics information of the plurality of users; generating group identification information by grouping a plurality of identification information; generating group characteristics information based on at least one of the respective characteristics information of the plurality of users; and transmitting the respective identification information of each of the plurality of users, the respective characteristics information, the group identification information, and the group characteristics information to the second electronic apparatus."
  ],
  "description_excerpt": "The disclosure relates to an electronic apparatus and a control method thereof, and more specifically, to an electronic apparatus for providing service to a user and a control method thereof.\n\nWith recent developments in electronic technologies, electronic apparatuses of various types are being developed and distributed.\n\nIn particular, electronic apparatuses such as a kiosk or robot, which substitutes humans are actively being supplied to shops, cafes, restaurants, and the like. The electronic apparatus such as the above may process an order for a customer, or perform an operation such as delivery to a customer.\n\nCurrently, while many electronic apparatuses such as a kiosk or a robot merely replace simple human labor, there is a growing need for automation to provide a consistent customer service or customized service by utilizing and sharing customer related information.\n\nConventionally, in order to provide consistent service or a customized service for customers, sensitive personal information had to be managed. Accordingly, there have been a growing concern over information leakage and hacking of personal information of customers.\n\nAccording to an embodiment, there is provided an electronic apparatus, including: a camera configured to capture an image; a communication interface; a memory configured to store at least one instruction; and a processor.",
  "cpc": [
    "G06F 21/32",
    "B25J 9/161",
    "B25J 9/1697",
    "G06F 18/214",
    "G06F 21/6245",
    "G06F 3/005",
    "G06F 3/011",
    "G06N 3/04",
    "G06N 3/044",
    "G06N 3/0464",
    "G06N 3/08",
    "G06Q 20/40145",
    "G06V 10/764",
    "G06V 10/82",
    "G06V 40/103",
    "G06V 40/16",
    "G06V 40/172",
    "G06V 40/50",
    "H04L 63/0861",
    "H04L 67/104",
    "H04L 67/53"
  ],
  "ipc": [
    "G06F 18/214",
    "G06F 21/32",
    "G06Q 20/40",
    "G06V 10/764",
    "G06V 10/82",
    "G06V 40/10",
    "G06V 40/16",
    "G06V 40/50",
    "H04L 9/40"
  ],
  "assignees": [
    "Samsung Electronics Co Ltd"
  ],
  "inventors": [
    "Yosub PARK",
    "Sejin KWAK"
  ],
  "filing_date": "2020-10-09",
  "publication_date": "2024-10-01",
  "grant_date": "2024-10-01",
  "priority_date": "2019-10-11",
  "application_number": "US-202017067152-A",
  "family_id": "75383280",
  "cited_by_count": 2,
  "citations": [
    "JPH07296077A",
    "JP2003162771A",
    "US20050222712A1",
    "JP2005293052A",
    "JP5040186B2",
    "US20080319296A1",
    "KR20100110143A",
    "US20160136817A1",
    "US20140316915A1",
    "US20200412133A1",
    "US20150137937A1",
    "US20160125240A1",
    "US20160189149A1",
    "KR20150140556A",
    "JP2017010179A",
    "US20180311822A1",
    "US20170255941A1",
    "US20180039745A1",
    "US20180300468A1",
    "US20180136615A1",
    "US20190108566A1",
    "US20190266344A1",
    "KR20190092337A",
    "US20210354305A1"
  ]
}