Electronic device and method for delivering message by same

{
  "publication_number": "US2019342243A1",
  "country": "US",
  "kind": "A1",
  "title": "Electronic device and method for delivering message by same",
  "abstract": "Various embodiments of the present invention relate to an electronic device and a method for delivering a message by the same. The electronic device may comprise: a camera; at least one processor functionally connected to the camera; and a memory for storing at least one program configured to be executable by the at least one processor, wherein the program comprises instructions configured to: capture an image of a sender by activating the camera in response to detection of a message input by the sender; analyze the captured image of the sender and the input message; determine a recipient and an output pattern on the basis of the result of the analysis; check whether the recipient is recognized; and when the recipient is recognized, deliver the message to the recognized recipient on the basis of the determined output pattern. Various other embodiments are possible.",
  "claims": [
    "1. An electronic device comprising: a camera; at least one processor functionally connected with the camera; and a memory configured to store at least one program configured to be executable by the at least one processor, wherein the at least one program comprises instructions that are set to: in response to an input of a message from a sender being detected, activate the camera and to capture the sender; analyze an image of the captured sender and the inputted message; determine a recipient and an output pattern based on a result of the analysis; identify whether the recipient is recognized; and when the recipient is recognized, deliver the message to the recognized recipient based on the determined output pattern. 2. The electronic device of claim 1, wherein the at least one program further comprises instructions that are set to track a pupil of the recipient when the recipient is recognized, and, when it is recognized that the pupil of the recipient gazes at the electronic device, to deliver the message. 3. The electronic device of claim 1, further comprising a driving module configured to control driving of the electronic device, wherein the at least one program further comprises instructions that are set to identify a location of the recipient when the recipient is not recognized, and to control the driving module to move to the identified location of the recipient. 4. The electronic device of claim 3, wherein the at least one program further comprises instructions that are set to estimate the location of the recipient based on whether at least one other electronic device registered at a home network to which the electronic device belongs is used. 5. The electronic device of claim 1, wherein the at least one program further comprises instructions that are set to recognize the recipient by identifying the recipient through speaker recognition when a sound of a predetermined level or higher is detected through a microphone, by identifying the recipient through face recognition when a subject is detected through the camera, or, when an external electronic device is connected through short-range wireless communication, by identifying whether the external electronic device connected through the short-range wireless communication is an electronic device of the recipient. 6. The electronic device of claim 1, wherein the at least one program comprises instructions that are set to analyze at least one of recipient information, sender information, an emotion state and an intensity of emotion of the sender, an event related to the recipient, a preference of the recipient, and whether the message is required to be kept secret. 7. The electronic device of claim 6, wherein the at least one program further comprises instructions that are set to, when the message is required to be kept secret, identify whether there are other users in the vicinity of the recipient, and, when there are no other users, to deliver the message to the recipient. 8. The electronic device of claim 1, further comprising a communication module, wherein the at least one program further comprises instructions that are set to identify whether there is an electronic device owned by the recipient, and, when there is the electronic device owned by the recipient, to control the communication module to deliver the output pattern to the electronic device owned by the recipient. 9. The electronic device of claim 1, further comprising a communication module, wherein the at least one program further comprises instructions that are set to deliver the image of the captured sender and the inputted message to an emotion analysis server through the communication module, and to request the emotion analysis sever to analyze an emotion state and an intensity of emotion of the sender, and to receive a result of the analysis. 10. The electronic device of claim 6, wherein the output pattern comprises at least one of a face expression, a motion, an AUI, or a voice type. 11. A method for delivering a message in an electronic device, the method comprising: in response to an input of a message from a sender being detected, capturing the sender; analyzing an image of the captured sender and the inputted message; determining a recipient and an output pattern based on a result of analyzing the image of the captured sender and the inputted message; identifying whether the recipient is recognized; and when the recipient is recognized, delivering the message to the recognized recipient based on the determined output pattern. 12. The method of claim 11, wherein recognizing the recipient further comprises: identifying a location of the recipient; and moving to the identified location of the recipient. 13. The method of claim 11, wherein recognizing comprises at least one of: identifying the recipient through speaker recognition when a sound of a predetermined level or higher is detected through a microphone; identifying the recipient through face recognition when a subject is detected through the camera; or when an external electronic device is connected through short-range wireless communication, identifying whether the external electronic device connected through the short-range wireless communication is an external electronic device owned by the recipient. 14. The method of claim 11, wherein analyzing comprises at least one of: analyzing recipient information and sender information; analyzing at least one of an emotion state or an intensity of emotion of the sender; analyzing an event related to the recipient; analyzing a preference of the recipient; and analyzing whether the message is required to be kept secret. 15. The method of claim 14, wherein delivering the message to the recognized recipient comprises: when the message is required to be kept secret, identifying whether there are other users in the vicinity of the recipient; and when there are no other users, delivering the message to the recipient. 16. The method of claim 14, wherein analyzing the at least one of the emotion state or the intensity of emotion of the sender is performed by an emotion analysis engine in the electronic device or an emotion analysis server. 17. The method of claim 11, wherein recognizing the recipient comprises: recognizing a face of the recipient; and tracking a pupil of the recipient and recognizing that the pupil of the recipient gazes at the electronic device. 18. The method of claim 11, wherein identifying the location of the recipient comprises: estimating the location of the recipient based on whether at least one other electronic device registered at a home network to which the electronic device belongs is used. 19. The method of claim 11, further comprising: identifying, by the electronic device, whether there is an electronic device owned by the recipient (recipient-owned electronic device); when there is the recipient-owned electronic device, delivering the output pattern to the recipient-owned electronic device; and delivering, by the recipient-owned electronic device, the message to the recognized recipient according to the output pattern. 20. The method of claim 11, wherein determining the output pattern comprises: determining at least one of a face expression, a motion, a sound effect, an AUI, or a voice type."
  ],
  "description_excerpt": "Various embodiments of the disclosure relate to an electronic device and a method for delivering a message by the same.\n\nElectronic devices (for example, mobile terminals, smartphones, wearable electronic devices, or the like) may provide various functions. For example, a smartphone may provide an Internet access function, a music or video replay function, a capturing function, a navigation function, a messenger function, etc. in addition to a basic voice communication function.\n\nThe messenger function enables messages in a text form to be exchanged with a specific user. However, a recent messenger function does not only exchange a simple text, but also transmits multimedia messages. For example, the electronic devices are able to transmit and receive emoticons, recorded files, photos and/or video files.\n\nHowever, the electronic devices simply transmit a multimedia message including a recorded file, a photo, or a video file to an electronic device of a designated reception side. The electronic device of the reception side may display the received multimedia message on a screen regardless of whether there is a recipient in the vicinity of the electronic device. In addition, since the electronic device simply transmits the multimedia message, the electronic device may not appropriately convey an emotion of a sender to the recipient.\n\nTo solve the above-described problems, various embodiments of the disclosure may receive a message that is to be delivered to a specific recipient from a sender, and may deliver the corresponding message to the recipient when the recipient is recognized.",
  "cpc": [
    "H04L 51/10",
    "B25J 5/007",
    "B25J 9/0003",
    "G06K 9/00288",
    "G06K 9/00302",
    "G06V 40/172",
    "G06V 40/174",
    "G06V 40/70",
    "G10L 25/63",
    "H04L 51/18",
    "H04L 51/222",
    "H04M 1/72415",
    "H04M 1/725"
  ],
  "ipc": [
    "G06V 40/70",
    "H04L 12/58",
    "H04M 1/725"
  ],
  "assignees": [
    "Samsung Electronics Co Ltd"
  ],
  "inventors": [
    "Im-Sung LEE",
    "Ki-Won Kim",
    "Sae Gee OH",
    "Ja-Min GOO",
    "Kiyoung Kwon",
    "Eun-Young Kim",
    "Jimin Kim",
    "Chulkwi KIM",
    "Hyung-Woo Kim",
    "Joo Namkung",
    "Ji-Hyun Park",
    "Seong-Hoon YOU",
    "Yong-Ju YU",
    "Dongkyu LEE",
    "Chanwon LEE",
    "Si-Hak JANG"
  ],
  "filing_date": "2017-12-21",
  "publication_date": "2019-11-07",
  "priority_date": "2016-12-27",
  "application_number": "US-201716474386-A",
  "family_id": "62710911",
  "cited_by_count": 12
}