Determining a boundary associated with image data

{
  "publication_number": "US10019639B2",
  "country": "US",
  "kind": "B2",
  "title": "Determining a boundary associated with image data",
  "abstract": "A method and device for determining a boundary associated with image data captured by an electronic device is provided. The electronic device may include a camera. In one aspect, a method includes: capturing the image data using the camera; based on the captured image data, detecting a boundary marker displayed by a display device, the boundary marker is periodically displayed to be undetectable by a human eye that is viewing the display device; and modifying, based on the boundary marker, image data captured by the camera.",
  "claims": [
    "1. A method of capturing an image displayed on an external display device and detected by an electronic device, the method comprising: generating image data associated with the detected image using the electronic device; detecting, by the electronic device, a first group of boundary markers displayed by the external display device, the first group of boundary markers being periodically displayed to be undetectable by a human eye that is viewing the external display device; in response to detecting the first group of boundary markers, determining image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and modifying, regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region.",
    "2. The method of claim 1, further comprising: capturing a plurality of image frames, wherein the image frames are displayed by the external display device at a first frequency, wherein the first group of boundary markers is displayed by the display device at a second frequency, and wherein the first frequency is greater than the second frequency.",
    "3. The method of claim 1, wherein detecting the first group of boundary markers comprises: identifying a first boundary marker in a first image frame; and identifying a second boundary marker in a second image frame, and wherein modifying the regional image data comprises: generating, based on a plurality of image frames, a watermarked image including the plurality of boundary markers.",
    "4. The method of claim 1, further comprising: determining that each boundary marker of the first group of boundary markers is located along a peripheral edge of the detected image; and in response to that determination, determining that an entirety of the detected image is within the first group of boundary markers.",
    "5. The method of claim 1, wherein the first group of boundary markers is a coded pattern including encoded information, the encoded information including at least one of external display device dimensions, boundary marker location on the external display device, and boundary location on the external display device, the method further comprising: decoding the coded pattern; and determining, based on the decoded pattern, a location of the first image region in the detected image.",
    "6. The method of claim 1, wherein regional image data associated with the second image region includes regional image data for a portion of the detected image located exterior to the first image region circumscribed by the first group of boundary markers.",
    "7. The method of claim 1, further comprising: detecting, by the electronic device, a second group of boundary markers displayed by the external display device; in response to detecting the second group of boundary markers, determining a third image region being circumscribed by the second group of boundary markers; and modifying regional image data associated with the third image region to contrast with regional image data associated with the first image region and the second image region.",
    "8. The method of claim 1, wherein modifying regional image data includes decreasing view-ability of the regional image data associated with a respective determined image region.",
    "9. The method of claim 8, wherein decreasing the view-ability of the regional image data includes applying a blurring effect for providing a bokeh effect in the detected image.",
    "10. The method of claim 1, wherein modifying regional image data includes increasing view-ability of the regional image data associated with a respective determined image region.",
    "11. An electronic device comprising: a camera; a memory device; and a processor coupled to the camera and the memory device, the processor being configured to: generate image data associated with a detected image using the camera; detect a first group of boundary markers displayed by an external display device, the first group of boundary markers being periodically displayed to be undetectable by a human eye that is viewing the external display device; in response to detecting the first group of boundary markers, determine image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and modify regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region.",
    "12. The electronic device of claim 11, wherein the processor is further configured to: capture a plurality of image frames, wherein the image frames are displayed by the external display device at a first frequency, wherein the first group of boundary markers is displayed by the display device at a second frequency, and wherein the first frequency is greater than the second frequency.",
    "13. The electronic device of claim 11, wherein detect the first group of boundary markers, the processor is configured to: identify a first boundary marker in a first image frame; and identify a second boundary marker in a second image frame, and wherein modify the regional image data, the processor is configured to: generate, based on a plurality of image frames, a watermarked image including the plurality of boundary markers.",
    "14. The electronic device of claim 11, wherein the processor is further configured to: determine that each boundary marker of the first group of boundary markers is located along a peripheral edge of the detected image; and in response to that determination, determine that an entirety of the detected image is within the first group of boundary markers.",
    "15. The electronic device of claim 11, wherein the first group of boundary markers is a coded pattern including encoded information, the encoded information including at least one of external display device dimensions, boundary marker location on the external display device, and boundary location on the external display device, the processor is further configured to: decode the coded pattern; and determine, based on the decoded pattern, a location of the first image region in the detected image.",
    "16. The electronic device of claim 11, wherein regional image data associated with the second image region includes regional image data for a portion of the detected image located exterior to the first image region circumscribed by the first group of boundary markers.",
    "17. A non-transitory computer-readable storage medium comprising processor-executable instructions which, when executed by a processor of an electronic device, causes the electronic device to: generate image data associated with a detected image using the electronic device; detect a first group of boundary markers displayed by an external display device, the first group of boundary markers is-being periodically displayed to be undetectable by a human eye that is viewing the external display device; in response to detecting the first group of boundary markers, determine image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and modify regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region."
  ],
  "description_excerpt": "The present disclosure relates generally to electronic devices having cameras and, more particularly, to methods and devices for capturing image data using the electronic device.\n\nElectronic devices having cameras are often equipped with at least one image sensor. The electronic device may capture image data by detecting light incident on an image sensor and converting the detected light into electrical signals. Generally, the frame rate of an image sensor is a measure of how many times a full pixel array of an image sensor may be read in a given amount of time. A captured image frame may include image data representing light incident on a full pixel array on an image sensor. However, a single image frame may not include additional information for subsequent handling of the captured image data.\n\nReference will now be made, by way of example, to the accompanying drawings which show example embodiments of the present application, and in which:\n\nFIG. 1 is a schematic illustration of an electronic device capturing image data in accordance with example embodiments of the present disclosure;\n\nFIG. 2 is a block diagram illustrating an example electronic device in accordance with example embodiments of the present disclosure;\n\nFIG. 3 is an illustration of a sequence diagram for providing media content and a boundary marker by a display device in accordance with example embodiments of the present disclosure;\n\nFIGS. 4A, 4B, 4C, and 4D are illustrations of captured images based on fields of view as viewed by an electronic device in accordance with example embodiments of the present disclosure;",
  "cpc": [
    "G06T 1/0085",
    "G06K 19/06028",
    "G06K 9/3216",
    "G06K 9/3233",
    "G06T 1/0021",
    "H04N 1/32277",
    "H04N 1/32352",
    "H04N 23/635",
    "H04N 23/69",
    "H04N 5/23293",
    "H04N 5/23296"
  ],
  "ipc": [
    "G06K 19/06",
    "G06K 9/32",
    "G06T 1/00",
    "H04N 1/32",
    "H04N 5/232",
    "G06K 9/00"
  ],
  "assignees": [
    "BlackBerry Ltd"
  ],
  "inventors": [
    "Sean VANDEWEERD",
    "Sanjay Nathwani",
    "Kian MARANDI"
  ],
  "filing_date": "2016-04-19",
  "publication_date": "2018-07-10",
  "grant_date": "2018-07-10",
  "priority_date": "2016-04-19",
  "application_number": "US-201615132572-A",
  "family_id": "58464152",
  "cited_by_count": 5,
  "citations": [
    "JPH07121293A",
    "US7222235B1",
    "US20010012019A1",
    "US7346185B2",
    "US20020031246A1",
    "EP1253555A2",
    "US20030223614A1",
    "US20040184612A1",
    "US20060086796A1",
    "US20060239503A1",
    "US20080089552A1",
    "US20100067692A1",
    "US20090226101A1",
    "US20100228632A1",
    "US20110128384A1",
    "US20110216207A1",
    "US9607131B2",
    "US20120072731A1",
    "US20120260307A1",
    "US20140003653A1",
    "US20150023669A1",
    "US9022292B1",
    "US20160104408A1",
    "US20160357947A1",
    "US20160253508A1"
  ]
}