Method for displaying image and electronic device thereof

{
  "publication_number": "US10410608B2",
  "country": "US",
  "kind": "B2",
  "title": "Method for displaying image and electronic device thereof",
  "abstract": "An electronic device and a method for displaying an image transmitted by a robot and remotely controlling a movement of the robot are provided. The electronic device includes a communicator, an inputter, a display, and a controller. The communicator receives, from the robot, an image photographed by the robot and time information. The inputter receives a command to control the robot. The display displays a screen corresponding to the image. The controller calculates a time delay between the electronic device and the robot based on the time information, control the display to display a graphical object to be overlaid on the screen, and control the communicator to transmit the command to the robot. The graphical object represents a field of view of the robot at a current time. The field of view of the robot at the current time may be estimated based on the time delay information.",
  "claims": [
    "1. An electronic device remotely controlling a movement of a robot, the electronic device comprising: a communicator; an inputter; a display; and a controller configured to: control the communicator to receive, from the robot, an image photographed by the robot and time information regarding the image, obtain time delay information between the electronic device and the robot based on the time information, control the display to display the image, the time delay information and a graphical object to be overlaid on the image based on the time delay information, control the communicator to transmit a command to control the robot received through the inputter, to the robot, and control the display to display an icon corresponding to the command.",
    "2. The electronic device as claimed in claim 1, wherein the controller is further configured to control the display to display a time bar including the time delay information and the icon on the time bar.",
    "3. The electronic device as claimed in claim 2, wherein the controller is further configured to determine a display position of the icon on the time bar based on the time delay information.",
    "4. The electronic device as claimed in claim 1, wherein the command is at least one of a stop command or a rotate command, and wherein the controller is further configured to determine a shape of the icon based on a type of the command.",
    "5. The electronic device as claimed in claim 1, wherein the controller is further configured to determine a shape of the graphical object based on a type of the command.",
    "6. The electronic device as claimed in claim 1, wherein the controller is further configured to identify the image into a plurality of regions based on the graphical object, and control the display to display the plurality of regions differently.",
    "7. The electronic device as claimed in claim 1, wherein the image indicates information corresponding to a viewpoint of the robot at a first time, and the graphical object indicates information corresponding to a viewpoint of the robot at a second time after the first time.",
    "8. A method for displaying a screen of an electronic device remotely controlling a movement of a robot, the method comprising: receiving, from the robot, an image photographed by the robot and time information regarding the image; obtaining time delay information between the electronic device and the robot based on the time information; displaying the image, the time delay information and a graphical object to be overlaid on the image based on the time delay information; receiving a command to control the robot; transmitting the command to the robot; and displaying an icon corresponding to the command.",
    "9. The electronic device as claimed in claim 8, wherein the displaying the image comprises displaying a time bar including the time delay information, and wherein the displaying the icon comprises displaying the icon on the time bar.",
    "10. The electronic device as claimed in claim 9, wherein the displaying the icon comprises determining a display position of the icon on the time bar based on the time delay information.",
    "11. The electronic device as claimed in claim 8, wherein the command is at least one of a stop command or a rotate command, and wherein the displaying the icon comprises determining a shape of the icon based on a type of the command.",
    "12. The electronic device as claimed in claim 8, wherein the displaying the image comprises determining a shape of the graphical object based on a type of the command.",
    "13. The electronic device as claimed in claim 8, wherein the displaying the image comprises identifying the image into a plurality of regions based on the graphical object, and displaying the plurality of regions differently.",
    "14. The electronic device as claimed in claim 8, wherein the image indicates information corresponding to a viewpoint of the robot at a first time, and the graphical object indicates information corresponding to a viewpoint of the robot at a second time after the first time."
  ],
  "description_excerpt": "Apparatuses and methods consistent with exemplary embodiments relate to an electronic device capable of remotely controlling a mobile robot and a method of displaying on a screen of the electronic device an image photographed by the mobile robot and information relevant thereto.\n\nWith advancements in electronic and robotic technology, systems have been developed where a camera is installed at a movable robot, an image is photographed by the robot, the photographed image is remotely monitored through communication, and the robot is remotely controlled.\n\nIn systems which perform remote monitoring by using such a robot, a remote user can control a mobile robot by watching on a mobile terminal the images photographed by the mobile robot. That is, a user may move the mobile robot in various directions (e.g., left, right, up, down) while watching on the mobile terminal a series of images transmitted by the mobile robot. However, while processing the images photographed by the mobile robot, time delay may occur. Specifically, due to the delay in transmission in the communication network which connects the mobile robot with the remote user's mobile terminal, time delay may occur between an image displayed on the mobile terminal of the user and the remote control signal of the user, and thus, it may be difficult for the user to control the mobile robot.\n\nExemplary embodiments may overcome the above disadvantages and other disadvantages not described above. However, it is understood that the exemplary embodiment are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.",
  "cpc": [
    "G09G 5/377",
    "B25J 9/161",
    "B25J 9/1697",
    "G01C 11/00",
    "G01C 23/00",
    "G05D 1/2247",
    "G05D 1/226",
    "G05D 2109/254",
    "G06F 3/1415",
    "G06F 3/1454",
    "G09G 2320/106",
    "G09G 2340/12",
    "G09G 5/006",
    "G09G 5/38",
    "H04N 23/661",
    "H04N 5/23206"
  ],
  "ipc": [
    "B25J 9/16",
    "G01C 11/00",
    "G01C 23/00",
    "G06F 3/14",
    "G09G 5/00",
    "G09G 5/377",
    "G09G 5/38",
    "H04N 5/232"
  ],
  "assignees": [
    "Samsung Electronics Co Ltd"
  ],
  "inventors": [
    "Yoon-sang Kim",
    "Jae-keun Na",
    "Ho-Chul Shin"
  ],
  "filing_date": "2018-12-21",
  "publication_date": "2019-09-10",
  "grant_date": "2019-09-10",
  "priority_date": "2016-01-28",
  "application_number": "US-201816230329-A",
  "family_id": "59385632",
  "cited_by_count": 3,
  "citations": [
    "US20080121097A1",
    "US7641613B2",
    "US20040267130A1",
    "JP2005161498A",
    "WO2008097252A2",
    "US20080046940A1",
    "US8718822B1",
    "US20140184640A1",
    "US20130194265A1",
    "US20140347267A1",
    "US20140032013A1",
    "US20150121222A1",
    "US8954853B2",
    "US20150057801A1",
    "US20150347827A1",
    "US20140180478A1",
    "WO2014126303A1",
    "KR20140103494A",
    "WO2014170439A1",
    "JP2015047666A",
    "EP3051808A1",
    "US20160274743A1",
    "US20170039770A1"
  ]
}