Information processing apparatus and information processing method

{
  "publication_number": "US11989892B2",
  "country": "US",
  "kind": "B2",
  "title": "Information processing apparatus and information processing method",
  "abstract": "The present disclosure relates to an information processing apparatus, an information processing method, and a program that enable more efficient acquisition of high-quality textures. A motion generation unit generates, on the basis of a state of acquisition of textures that constitute a 3D model of a user, a motion for imaging an area where the textures have not been acquired. Then, a navigation execution unit provides a navigation for making the user execute an action in accordance with the motion generated by the motion generation unit. The present technology can be applied to, for example, an information processing apparatus that performs 3D model generation processing.",
  "claims": [
    "1. An information processing apparatus, comprising: circuitry configured to: detect an unacquired area of where a texture of a 3D model of a user is not acquired; generate a motion for imaging the unacquired area; generate a navigation map visualizing the unacquired area; and control a display device to display the motion and the navigation map.",
    "2. The information processing apparatus according to claim 1, wherein the circuitry is further configured to: estimate an attribute and a movement proficiency level of the user, and generate the motion by referring to the attribute and the movement proficiency level of the user.",
    "3. The information processing apparatus according to claim 1, wherein the circuitry is further configured to: determine whether each polygon of a mesh of the 3D model includes the unacquired area.",
    "4. The information processing apparatus according to claim 1, wherein the circuitry is further configured to visualize, on the navigation map, each factor that has caused the unacquired area.",
    "5. The information processing apparatus according to claim 3, wherein the circuitry is configured to detect the unacquired area on a basis of an angle between a principal axis of an imaging device and a normal of a part of the user corresponding to a polygon of the mesh.",
    "6. The information processing apparatus according to claim 3, wherein the circuitry is configured to detect the unacquired area on a basis of a time during which a part of the user corresponding to a polygon of the mesh has been exposed in front of an imaging device.",
    "7. The information processing apparatus according to claim 3, wherein the circuitry is configured to detect the unacquired area on a basis of a distance between an imaging device and a part of the user corresponding to a polygon of the mesh.",
    "8. An information processing method, comprising, by an information processing apparatus that performs 3D model generation processing: detecting an unacquired area of where a texture of a 3D model of a user is not acquired; generating a motion for imaging the unacquired area; generating a navigation map visualizing the unacquired area; and controlling a display device to display the motion and the navigation map.",
    "9. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer of an information processing apparatus that performs 3D model generation processing, cause the computer to execute operations, the operations comprising: detecting an unacquired area of where a texture of a 3D model of a user is not acquired; generating a motion for imaging the unacquired area; generating a navigation map visualizing the unacquired area; and controlling a display device to display the motion and the navigation map."
  ],
  "description_excerpt": "The present disclosure relates to an information processing apparatus, an information processing method, and a program, and more particularly to an information processing apparatus, an information processing method, and a program that enable more efficient acquisition of high-quality textures.\n\nIn recent years, a variety of technologies for scanning a three-dimensional shape of a person and generating a 3D model of that person have been proposed and put into practical use. For example, a 3D model is constituted by a mesh that represents a three-dimensional shape as a set of polygons such as triangles and quadrangles, and textures constituted by an image that represents a color of the surface of the three-dimensional shape.\n\nConventionally, as a technique for acquiring textures, a system for acquiring textures has been used in which 100 or more imaging devices are installed so as to surround a person, and the imaging devices are synchronized to image the person. However, such a system is costly.\n\nFurthermore, a system for acquiring textures has been used in which a person who is rotating on a turntable is imaged with one imaging device. However, such a system requires a person to remain stationary for several minutes.\n\nFor example, Patent Document 1 discloses a technology of generating a high-density avatar mesh by multi-view stereo and applying multi-view texture composition to generate a texture image associated with a 3D face model.",
  "cpc": [
    "G06T 7/251",
    "G06T 13/40",
    "G06T 17/00",
    "G06T 7/40",
    "G06T 7/70"
  ],
  "ipc": [
    "G06T 13/40",
    "G06T 7/246",
    "G06T 7/40",
    "G06T 7/70"
  ],
  "assignees": [
    "Sony Corp"
  ],
  "inventors": [
    "Ryohei Okada"
  ],
  "filing_date": "2019-07-26",
  "publication_date": "2024-05-21",
  "grant_date": "2024-05-21",
  "priority_date": "2018-08-10",
  "application_number": "US-201917250577-A",
  "family_id": "69414123",
  "cited_by_count": 1,
  "citations": [
    "US20120056800A1",
    "JP2014525108A",
    "CN103679797A",
    "CN103226843A",
    "US20140347470A1",
    "DE15864375T1",
    "KR20170091730A",
    "KR20180057734A",
    "CA2969762A1",
    "JP2018504663A",
    "AU2015358289A1",
    "WO2016086266A1",
    "SG11201703993RA",
    "CN106999107A",
    "ES2647340T1",
    "CN110223272A",
    "KR20190007535A",
    "US20170273639A1",
    "EP3226763A1",
    "US20180189550A1",
    "KR20170038722A",
    "JP2017080201A",
    "CN106650217A",
    "JP2017107503A",
    "CN108780580A",
    "JP2017162119A",
    "US20190026932A1",
    "WO2017154894A1",
    "US20200368616A1"
  ]
}