Method and apparatus for producing dynamic imagery in a visual medium

{
  "publication_number": "US6769771B2",
  "country": "US",
  "kind": "B2",
  "title": "Method and apparatus for producing dynamic imagery in a visual medium",
  "abstract": "A method and apparatus for producing motion pictures using real time composites of computer generated virtual backgrounds and live foreground images recorded on a sound stage includes camera motion tracking, automated lighting control, on-line editing, and production and asset management to accelerate the pace and reduce the cost of motion picture production.",
  "claims": [
    "1. A recording apparatus and display and associate suppor system comprising: a base engaged with a movable dolly; a boom arm pivotally mounted to the base; a jib arm pivotally mounted to a distal end of the boom arm; a recording apparatus mounting flange pivotally mounted to a distal end of the jib arm; a counterweight system for counterbalancing the boom arm and jib arm; a recording apparatus mounted to the recording apparatus mounting flange, the recording apparatus recording live character and set component images; and a display disposed proximate to the recording apparatus, the display presenting substantially real time generated initial composite images indicative of the live character and set component images and computer generated images.",
    "2. The recording apparatus support system of claim 1 comprising a motion tracking system for generating recording apparatus position signals indicative of the position of the recording apparatus, wherein the recording apparatus position signals are used to generate initial composite image signals indicative of the initial composite images.",
    "3. The recording apparatus support system of claim 2 wherein the initial composite image signals are generated from a method comprising: generating a database of computer generated image element signals indicative of computer generated images, each image having a plurality of computer image elements, with a pre-established geometric position relative to one another; generating a database of computer image element position signals correlating the position of each of the image elements in a stage geometry; recording character and set image element signals indicative of the live character and set component images within the stage geometry, each image having a plurality of character and set image elements; recording, simultaneously with the live character and set image element signals, character and set position signals which associate a character or set component position with a corresponding position in the stage geometry, generating the recording apparatus position signals indicative of the position of a recording apparatus in the stage geometry and optical field signals indicative of the optical field of view of the recording apparatus for the live character and set component images; generating optical parameter signals corresponding to the optical parameters of the recording apparatus; modifying the computer image element position signals in dependence on values of the recording apparatus position signals, optical parameter signals and optical field signals; identifying select ones of the character and set image element signals to be replaced by select ones of the computer generated image element signals in dependence on the computer image element position signals and the character and set position signals; substituting the identified character and set image element signals with corresponding ones of the computer generated image element signals to form the initial composite image signals.",
    "4. The recording apparatus support system of claim 1 wherein the counterweight system and the counterbalanced boom and jib arms provide substantially weightless movement of the recording apparatus and display for an operator.",
    "5. The recording apparatus support system of claim 4 comprising: a position control system for controlling position of the boom arm and jib arm relative to position of the counterweight system; a boom cylinder for supporting the boom arm and operatively connected between the body and the boom, the boom cylinder responsive to boom arm position signals generated from the position control system; and a jib cylinder for supporting the jib arm and operatively connected between the boom arm and the jib arm, the jib cylinder responsive to jib arm position signals generated from the position control system; wherein the boom arm position signals and the jib arm position signals enable the counterweight system and the counterbalanced boom and jib arms to provide substantially weightless movement of the recording apparatus and display for an operator.",
    "6. The recording apparatus support system of claim 5 wherein the counterweight system comprises: a counterweight boom arm for counter balancing the boom arm, pivotally mounted on an opposing side of the body relative to the boom arm, and a counterweight jib arm for counter balancing the jib arm, pivotally mounted to a distal end of the counterweight boom arm.",
    "7. A recording apparatus and display and associated support system comprising: a base engaged with a movable dolly; a boom arm pivotally mounted to the base; a jib arm pivotally mounted to a distal end of the boom arm; a recording apparatus mounting flange pivotally mounted to a distal end of the jib arm; a counterweight system for counterbalancing the boom arm and jib arm; a recording apparatus mounted to the recording apparatus mounting flange, the recording apparatus recording live character and set component images; and a display disposed proximate to the recording apparatus, the display presenting substantially real time generated initial composite images indicative of the live character and set component images and computer generated images; wherein the initial composite image signals are generated from a method comprising the steps of: generating a database of computer generated image element signals indicative of computer generated images, each image having a plurality of computer image elements, with a pre-established geometric position relative to one another; generating a database of computer image element position signals correlating the position of each of the image elements in a stage geometry; recording character and set image element signals indicative of the live character and set component images within the stage geometry, each image having a plurality of character and set image elements; recording, simultaneously with the live character and set image element signals, character and set position signals which associate a character or set component position with a corresponding position in the stage geometry, generating the recording apparatus position signals indicative of the position of a recording apparatus in the stage geometry and optical field signals indicative of the optical field of view of the recording apparatus for the live character and set component images; generating optical parameter signals corresponding to the optical parameters of the recording apparatus; modifying the computer image element position signals in dependence on values of the recording apparatus position signals, optical parameter signals and optical field signals; identifying select ones of the character and set image element signals to be replaced by select ones of the computer generated image element signals in dependence on the computer image element position signals and the character and set position signals; substituting the identified character and set image element signals with corresponding ones of the computer generated image element signals to form the initial composite image signals.",
    "8. A recording apparatus and display and associated support system comprising: a base engaged with a movable platform; a boom arm pivotally mounted to the base, said boom arm having a distal end; a recording apparatus mounting flange mounted to said distal end of said boom arm; a recording apparatus mounted to the recording apparatus mounting flange, said recording apparatus recording live character images; and a composite display mounted to said distal end of said boom arm, said composite display presenting substantially real time generated initial composite images indicative of said live character images and computer generated images."
  ],
  "description_excerpt": "The present invention relates to motion picture production in general and to motion pictures that utilize virtual sets in particular.\n\nThe cost of producing today's motion pictures, particularly action adventure, science fiction and fantasy films that utilize substantial digital visual effects, is increasing astronomically. Large scale productions, such as the movie Titanic, are high risk ventures, with escalating costs increasingly difficult to contain. Studios have responded to these economic realities by cutting the number of films they produce, canceling projects and moving production out of the country.\n\nDigital technologies, and in particular computer generated imaging and Chromakey techniques to create special visual effects, have undoubtedly enhanced the creative potential of motion picture production. Digital visual effects, however, have generally been used in conjunction with conventional large scale production methods that involve major stars, large crews, exotic location shooting, lengthy shooting schedules and spectacular physical sets, and have tended to increase rather than decrease the cost of motion picture production.",
  "cpc": [
    "G06F 3/011",
    "G06T 13/00",
    "G11B 27/022",
    "G11B 27/034",
    "G11B 27/34",
    "H04N 5/222",
    "H04N 5/2224",
    "H04N 9/75"
  ],
  "ipc": [
    "G06F 3/00",
    "G06F 3/01",
    "G06T 15/70",
    "G11B 27/022",
    "G11B 27/034",
    "G11B 27/34",
    "H04N 5/222"
  ],
  "assignees": [
    "Entertainment Design Workshop LLC"
  ],
  "inventors": [
    "Douglas Trumbull"
  ],
  "filing_date": "2002-03-14",
  "publication_date": "2004-08-03",
  "grant_date": "2004-08-03",
  "priority_date": "2002-03-14",
  "application_number": "US-9966202-A",
  "family_id": "28039652",
  "cited_by_count": 119,
  "citations": [
    "US4283766A",
    "US4899097A",
    "US5033705A",
    "US5177516A",
    "US5454042A",
    "US5566251A",
    "US5923791A",
    "US5696892A",
    "US5856862A",
    "US6122013A",
    "US5531412A",
    "US5644377A",
    "US5892554A",
    "US6084590A",
    "US5853153A"
  ]
}