Method for projecting image and robot implementing the same

{
  "publication_number": "US10893245B1",
  "country": "US",
  "kind": "B1",
  "title": "Method for projecting image and robot implementing the same",
  "abstract": "Disclosed is a robot projecting an image that selects a projection area in a space based on at least one of first information related to content of an image to be projected and second information related to a user viewing the image to be projected, and projects the image to the projection area.",
  "claims": [
    "1. A robot, comprising: a motor assembly configured to move the robot in a space; a projector configured to project an image; and a controller configured to: select a projection area in the space based on the following: first information including type information of the image to be projected, and second information related to a user to view the image, control the motor assembly, and control the projector to project the image to the projection area.",
    "2. The robot of claim 1, wherein the controller is further configured to control the motor assembly to move the robot to a first position to project the image to the projection area, and wherein a screen size of the image is determined according to at least one of the following: a distance between the projection area and the first position of the robot, a position of the projection area, and a number of users in the space.",
    "3. The robot of claim 2, further comprising: a camera to obtain an omni-directional image of the space; and a microphone to receive a voice signal from the user, wherein the controller is further configured to calculate the number of the users based on the obtained omni-directional image and the received voice signal.",
    "4. The robot of claim 1, wherein the controller is further configured to select one of the following as the projection area when the type information indicates that the image is a video call: a projectable area of the space positioned closest to the user, and a projectable area of the space positioned closest to the robot.",
    "5. The robot of claim 4, wherein the second information includes at least one of the following: position information of the user, a face direction of the user, and position information of one or more objects adjacent to the user, wherein the position information of the user includes a relative position of the user in the space, wherein the face direction of the user is a direction of the user's face relative to the robot, and wherein the controller is further configured to determine a position of the projection area based on a least one of the position information of the user and the position information of the one or more objects, and to control the projector to adjust a screen direction of the image based on the face direction of the user.",
    "6. The robot of claim 5, wherein the controller is further configured to search for one or more projectable areas adjacent to the user based on at least one of the following: the position information of the user and the position information of the one or more objects, wherein the controller is further configured to select one of the one or more projectable areas positioned in a same direction as the face direction of the user, as the projection area, and wherein the controller is further configured to select, as the projection area, the projectable area positioned to a side of the user's face when there is no projectable area among the one or more projectable areas positioned in the same direction as the face direction of the user face, and there is a projectable area among the one or more projectable areas positioned to the side of the user's face.",
    "7. The robot of claim 6, wherein the controller is further configured to select the projection area further based on third information related to a physical feature of the one or more projectable areas, and wherein the physical feature includes at least one of the following: a size of the one or more projectable areas, a material of the one or more projectable areas, a color of the one or more projectable areas and a pattern of the one or more projectable areas.",
    "8. The robot of claim 1, wherein the controller is further configured to determine a change in position of the projection area based on an action performed by the user, and to control the motor assembly to move the robot to resize the image according to the changed position of the projection area.",
    "9. The robot of claim 8, wherein the controller is further configured to increase a size of the projected image corresponding to an increased distance between two fingers of the user or between two arms of the user when the action performed by the user is an increase in distance between the two fingers of the user or is an increase in distance between the two arms of the user, and wherein the controller is further configured to decrease the size of the projected image corresponding to a decreased distance between the two fingers of the user or between the two arms of the user when the action performed by the user is a decrease in distance between the two fingers of the user, or is a decrease in distance between the two arms of the user.",
    "10. The robot of claim 1, further comprising an image sensor, wherein the controller is further configured to: detect an action by the user; and change a screen orientation of the image based on the action.",
    "11. The robot of claim 10, wherein the controller is configured to rotate the screen orientation of the image by 90 degrees in the first direction when the user rotates a hand of the user in a first direction.",
    "12. The robot of claim 1, wherein the type information indicates that the image is a video, and wherein the controller is further configured to: based on view history information of the user included in the second information, determine a subspace in the space and to select a projectable area in the determined subspace as the projection area, or based on view rating information set for the video, determine a subspace in the space to select a projectable area in the determined subspace as the projection area.",
    "13. A robot, comprising: a body assembly; a motor assembly configured to move the body assembly in a space; a projector configured to project an image and to be rotatable and angle-adjustable; and a controller configured to: select a projection area in the space based on the following: first information including type information of the image to be projected, second information related to a user to view the image, and third information related to a physical feature of one or more projectable areas in the space.",
    "14. The robot of claim 13, further comprising an illuminance sensor, wherein the illuminance sensor of the robot is configured to detect illuminance of each of the one or more projectable areas, and wherein the controller is further configured to select the projection area as one of the one or more projectable areas having a lowest illuminance.",
    "15. The robot of claim 13, further comprising an image sensor, wherein the controller is configured to: detect an action by the user; and change a screen orientation of the projected image based on the action.",
    "16. The robot of claim 13, wherein the type information indicates that the image is a video, and wherein the controller is further configured to: based on view history information of the user included in the second information, determine a subspace in the space and select a projectable area in the determined subspace as the projection area, or based on view rating information set for the video, determine a subspace in the space and select a projectable area in the determined subspace as the projection area.",
    "17. The robot of claim 13, wherein the second information includes at least one of the following: position information of the user, a face direction of the user, and position information of one or more objects adjacent to the user, wherein the position information of the user includes a relative position of the user in the space, wherein the face direction of the user is a face direction of the user's face relative to the robot, and wherein the controller is further configured to: determine a position of the projection area based on a least one of the position information and the position information of the one or more objects; and control the projector to adjust a screen direction of the image based on the face direction of the user.",
    "18. A method of projecting an image using a robot, the robot including a controller, a projector and a motor assembly, the method comprising: selecting, by the controller of the robot, a projection area in a space based on first information including type information of an image to be projected and second information related to a user to view the image; determining, by the controller, a first position of the robot for projecting the image to the projection area; controlling, by the controller, the motor assembly of the robot to move the robot to the first position; and controlling, by the controller, the projector to project the image.",
    "19. The method of claim 18, wherein the robot further comprises an image sensor, and wherein method further comprises: detecting, by the controller, an action by the user; and changing a screen orientation of the image based on the action.",
    "20. The method of claim 18, wherein the second information includes at least one of the following: position information of the user, face direction information of the user, and position information of one or more objects adjacent to the user, wherein the position information of the user includes a relative position of the user in the space, wherein the face direction information of the user includes a face direction of the user's face relative to the robot, and wherein the method further comprises: determining, by the controller, a position of the projection area based on a least one of the position information of the user and the position information of the one or more objects; and controlling, by the controller, the projector to adjust a screen direction of the image based on the face direction of the user."
  ],
  "description_excerpt": "1. Field of the Invention The present disclosure relates to methods for projecting images and robots implementing the same. 2. Description of Related Art Home robots are recently coming on the market, which are equipped with a display and a projector to provide an imaging service to users. Projector-equipped robots project and display images on a screen, wall, or ceiling. This enables implementing a home theater. Meanwhile, an image projection area and an image screen size needs to be optimized according to the type of images and/or the ambient environment of the space where images are projected. However, conventional projector-equipped robots project images to a preset screen or wall or ceiling closest thereto, thus failing to provide an optimal imaging service.\n\nAn object of the present disclosure is to provide a method of image projection using a robot, which allows the robot to project content under optimal conditions according to the type of the content, and a robot implementing the same. Another object of the present disclosure is to provide a method of image projection, which may immediately project an image to an area adjacent to the user to thereby provide an image providing service in a convenient way, and a robot implementing the same. The present disclosure is not limited to the foregoing objectives, but other objects and advantages will be readily appreciated and apparent from the following detailed description of embodiments of the present disclosure.",
  "cpc": [
    "H04N 9/3173",
    "B25J 13/003",
    "B25J 9/0009",
    "B25J 9/1664",
    "B25J 9/1679",
    "H04N 7/141",
    "H04N 9/3141",
    "H04N 9/3155",
    "H04N 9/3185",
    "H04N 9/3188",
    "H04N 9/3194"
  ],
  "ipc": [
    "H04N 9/31"
  ],
  "assignees": [
    "LG ELECTRONICS INC"
  ],
  "inventors": [
    "CHOI HYUNGJIN",
    "KIM BYUNGJOON",
    "KIM SUL RAN",
    "YOON Jongook"
  ],
  "filing_date": "2020-01-15",
  "publication_date": "2021-01-12",
  "grant_date": "2021-01-12",
  "priority_date": "2019-06-20",
  "application_number": "US-202016743683-A",
  "family_id": "74039503",
  "citations": [
    "JP2007229855A",
    "KR20090072038A",
    "KR20100082559A",
    "KR20180003269A",
    "KR20180062130A",
    "KR20190043749A",
    "US2015148960A1",
    "US2018005397A1",
    "US2019099681A1",
    "US2019124294A1"
  ]
}