MLchartDataset catalogue

Patent · US10679586B2 · B2 · US

Information processing device, communication system, and information processing method

(11) Publication number
US10679586B2
(21) Application number
16/298,087
(22) Filing date
2019-03-11
(30) Priority date
2012-11-12
(43) Publication date
2020-06-09
(45) Date of grant
2020-06-09
(51) IPC
G06F 3/01; G06F 3/038; G06F 3/041; G06F 3/0488; G06F 3/14; G09G 5/12; G09G 5/14; H04M 1/72412; G06F 3/0484
(52) CPC
  • G06F Electric digital data processing: 3/038, 2203/0383, 3/017, 3/0414, 3/0488, 3/1423
  • G09G Arrangements or circuits for control of indicating devices using static means to present variable information: 2340/02, 2340/12, 2354/00, 2370/16, 5/12, 5/14
  • H04M Telephonic communication: 1/72412, 1/7253, 2250/22
(73) Assignee
Sony Corp
(72) Inventors
Yoshihiko Ikenaga; Yasushi Katayama; Sho Amano; Tomoya Yamaura
(54) Title
Information processing device, communication system, and information processing method
(57) Abstract

There is provided an information processing device including an operation acceptance unit configured to accept a user operation related to an image based on image data received from another information processing device using short-range wireless communication when the image is displayed on a display unit, and a controller configured to perform control in a manner that notification information for issuing a notification that the user operation is accepted is output when the user operation is accepted, and control data corresponding to the user operation is transmitted to the other information processing device.

Full text
View on Google Patents

Claims (11)

  1. A first information processing device, comprising: circuitry configured to: execute a capability exchange process with a second information processing device for transmission of first image data to the second information processing device, wherein the capability exchange process includes exchange of codec information and support data format information by Real Time Streaming Protocol (RTSP) packet; transmit the first image data to the second information processing device via a wireless connection; wherein the second information processing device: displays a first image based on the first image data on a display of the second information processing device, accepts a user operation on the first image, and superimposes additional information on the first image to indicate acceptance of the user operation; receive control data, corresponding to the user operation, from the second information processing device; execute a process based on the control data; and transmit second image data that reflects the executed process to the second information processing device, wherein the second information processing device erases the additional information after a threshold time.
  2. The first information processing device according to claim 1, wherein the process comprises: generate a sequence number corresponding to the first image data, based on the control data, and transmit the sequence number to the second information processing device.
  3. The first information processing device according to claim 2, wherein the transmitted sequence number indicates that the control data is received.
  4. The first information processing device according to claim 1, wherein the second information processing device accepts the user operation based on the first image data.
  5. The first information processing device according to claim 1, wherein the additional information indicates that the user operation is accepted at the second information processing device.
  6. The first information processing device according to claim 1, further comprising: a display unit configured to display a second image which is identical to the first image.
  7. The first information processing device according to claim 1, wherein the first image data is transmitted to the second information processing device on Real-Time Transport Protocol via a Wi-Fi Direct connection.
  8. The first information processing device according to claim 1, wherein the control data is received via a User Interface Back Channel.
  9. The first information processing device according to claim 1, further comprising: an input unit configured to detect user input, wherein the input unit comprises at least one of a gyro sensor, an electronic compass, or an acceleration sensor, and data from the input unit is utilized to generate a sequence number.
  10. The first information processing device according to claim 1, wherein the threshold time corresponds to a delay time that occurs in short-range wireless communication between the first information processing device and the second information processing device.
  11. An information processing method, comprising: in a first information processing device: executing a capability exchange process with a second information processing device for transmission of first image data to the second information processing device, wherein the capability exchange process includes exchange of codec information and support data format information by Real Time Streaming Protocol (RTSP) packet; transmitting the first image data to the second information processing device via a wireless connection; wherein the second information processing device: displays a first image based on the first image data on a display of the second information processing device, accepts a user operation on the first image, and superimposes additional information on the first image to indicate acceptance of the user operation; receiving control data, corresponding to the user operation, from the second information processing device; and executing a process based on the control data; and transmitting second image data that reflects the executed process to the second information processing device, wherein the second information processing device erases the additional information after a threshold time.

Description

The present technology relates to an information processing device, and more particularly to an information processing device, communication system, and information processing method in which various types of information are exchanged using wireless communication.

In related art, wireless communication techniques in which various types of data are exchanged using wireless communication have been known. For example, there has been proposed an information exchange device in which various types of data are exchanged between two wireless communication devices via short-range wireless communication (for example, refer to Japanese Unexamined Patent Application Publication No. 2008-278388).

According to the above-described technique in related art, various types of data can be exchanged between two wireless communication devices via short-range wireless communication without using a wire line. However, when various types of data are exchanged between two wireless communication devices in this way, there may be a delay due to short-range wireless communication.

In this context, as an example, in a reception-side information processing device that displays an image based on image data transmitted from a transmission-side information processing device on a display unit, it is assumed that the user performs an operation input for performing an operation related to the image. In this case, it is assumed that a time until an image based on image data reflecting the operation input is displayed on a display unit is delayed by the amount of delay.

Citations (23)

  • JPH08227341A
  • US20060017692A1
  • US20020132609A1
  • US20040145660A1
  • JP2007525775A
  • JP2007173952A
  • JP2008278388A
  • US20100214465A1
  • US20090303199A1
  • US20100002122A1
  • US20100271390A1
  • JP2011118595A
  • US20110199386A1
  • CN102591561A
  • US20120127196A1
  • US20120326994A1
  • US20130063489A1
  • US20130082953A1
  • US20130135352A1
  • US20130239056A1
  • US20140018053A1
  • US20140059139A1
  • US20150110090A1
Record as JSON
{
  "publication_number": "US10679586B2",
  "country": "US",
  "kind": "B2",
  "title": "Information processing device, communication system, and information processing method",
  "abstract": "There is provided an information processing device including an operation acceptance unit configured to accept a user operation related to an image based on image data received from another information processing device using short-range wireless communication when the image is displayed on a display unit, and a controller configured to perform control in a manner that notification information for issuing a notification that the user operation is accepted is output when the user operation is accepted, and control data corresponding to the user operation is transmitted to the other information processing device.",
  "claims": [
    "1. A first information processing device, comprising: circuitry configured to: execute a capability exchange process with a second information processing device for transmission of first image data to the second information processing device, wherein the capability exchange process includes exchange of codec information and support data format information by Real Time Streaming Protocol (RTSP) packet; transmit the first image data to the second information processing device via a wireless connection; wherein the second information processing device: displays a first image based on the first image data on a display of the second information processing device, accepts a user operation on the first image, and superimposes additional information on the first image to indicate acceptance of the user operation; receive control data, corresponding to the user operation, from the second information processing device; execute a process based on the control data; and transmit second image data that reflects the executed process to the second information processing device, wherein the second information processing device erases the additional information after a threshold time.",
    "2. The first information processing device according to claim 1, wherein the process comprises: generate a sequence number corresponding to the first image data, based on the control data, and transmit the sequence number to the second information processing device.",
    "3. The first information processing device according to claim 2, wherein the transmitted sequence number indicates that the control data is received.",
    "4. The first information processing device according to claim 1, wherein the second information processing device accepts the user operation based on the first image data.",
    "5. The first information processing device according to claim 1, wherein the additional information indicates that the user operation is accepted at the second information processing device.",
    "6. The first information processing device according to claim 1, further comprising: a display unit configured to display a second image which is identical to the first image.",
    "7. The first information processing device according to claim 1, wherein the first image data is transmitted to the second information processing device on Real-Time Transport Protocol via a Wi-Fi Direct connection.",
    "8. The first information processing device according to claim 1, wherein the control data is received via a User Interface Back Channel.",
    "9. The first information processing device according to claim 1, further comprising: an input unit configured to detect user input, wherein the input unit comprises at least one of a gyro sensor, an electronic compass, or an acceleration sensor, and data from the input unit is utilized to generate a sequence number.",
    "10. The first information processing device according to claim 1, wherein the threshold time corresponds to a delay time that occurs in short-range wireless communication between the first information processing device and the second information processing device.",
    "11. An information processing method, comprising: in a first information processing device: executing a capability exchange process with a second information processing device for transmission of first image data to the second information processing device, wherein the capability exchange process includes exchange of codec information and support data format information by Real Time Streaming Protocol (RTSP) packet; transmitting the first image data to the second information processing device via a wireless connection; wherein the second information processing device: displays a first image based on the first image data on a display of the second information processing device, accepts a user operation on the first image, and superimposes additional information on the first image to indicate acceptance of the user operation; receiving control data, corresponding to the user operation, from the second information processing device; and executing a process based on the control data; and transmitting second image data that reflects the executed process to the second information processing device, wherein the second information processing device erases the additional information after a threshold time."
  ],
  "description_excerpt": "The present technology relates to an information processing device, and more particularly to an information processing device, communication system, and information processing method in which various types of information are exchanged using wireless communication.\n\nIn related art, wireless communication techniques in which various types of data are exchanged using wireless communication have been known. For example, there has been proposed an information exchange device in which various types of data are exchanged between two wireless communication devices via short-range wireless communication (for example, refer to Japanese Unexamined Patent Application Publication No. 2008-278388).\n\nAccording to the above-described technique in related art, various types of data can be exchanged between two wireless communication devices via short-range wireless communication without using a wire line. However, when various types of data are exchanged between two wireless communication devices in this way, there may be a delay due to short-range wireless communication.\n\nIn this context, as an example, in a reception-side information processing device that displays an image based on image data transmitted from a transmission-side information processing device on a display unit, it is assumed that the user performs an operation input for performing an operation related to the image. In this case, it is assumed that a time until an image based on image data reflecting the operation input is displayed on a display unit is delayed by the amount of delay.",
  "cpc": [
    "G06F 3/038",
    "G06F 2203/0383",
    "G06F 3/017",
    "G06F 3/0414",
    "G06F 3/0488",
    "G06F 3/1423",
    "G09G 2340/02",
    "G09G 2340/12",
    "G09G 2354/00",
    "G09G 2370/16",
    "G09G 5/12",
    "G09G 5/14",
    "H04M 1/72412",
    "H04M 1/7253",
    "H04M 2250/22"
  ],
  "ipc": [
    "G06F 3/01",
    "G06F 3/038",
    "G06F 3/041",
    "G06F 3/0488",
    "G06F 3/14",
    "G09G 5/12",
    "G09G 5/14",
    "H04M 1/72412",
    "G06F 3/0484"
  ],
  "assignees": [
    "Sony Corp"
  ],
  "inventors": [
    "Yoshihiko Ikenaga",
    "Yasushi Katayama",
    "Sho Amano",
    "Tomoya Yamaura"
  ],
  "filing_date": "2019-03-11",
  "publication_date": "2020-06-09",
  "grant_date": "2020-06-09",
  "priority_date": "2012-11-12",
  "application_number": "US-201916298087-A",
  "family_id": "50681228",
  "cited_by_count": 18,
  "citations": [
    "JPH08227341A",
    "US20060017692A1",
    "US20020132609A1",
    "US20040145660A1",
    "JP2007525775A",
    "JP2007173952A",
    "JP2008278388A",
    "US20100214465A1",
    "US20090303199A1",
    "US20100002122A1",
    "US20100271390A1",
    "JP2011118595A",
    "US20110199386A1",
    "CN102591561A",
    "US20120127196A1",
    "US20120326994A1",
    "US20130063489A1",
    "US20130082953A1",
    "US20130135352A1",
    "US20130239056A1",
    "US20140018053A1",
    "US20140059139A1",
    "US20150110090A1"
  ]
}

Record 2,125 of 8,000 in Patents full text (MLC-0201). Request the full dataset.