Three-dimensional computer-aided-design system user interface

{
  "publication_number": "US10048769B2",
  "country": "US",
  "kind": "B2",
  "title": "Three-dimensional computer-aided-design system user interface",
  "abstract": "A three-dimensional (3D) computer aided design (CAD) user interface (UI) is described that maps both two-handed and one-handed free hand gestures and poses to map to actions in the 3D CAD UI environment. Free hands may be used to directly both constrain and organically modify an object. Intuitive analogs to physical tools are used, with gradual changes to visibility. Parts are automatically modified to meet object-specific and rule-based constraints. Multiple copies of a physical analog element, with known dimensions, may be continually created by a free hand and automatically assembled into an appropriate, organized and contiguous structure containing integral visible fiducials based on the dimensions of the element. Temporary layers of an object are used to permit organic modifications of portions of an object. Use of a fastener creates and then fastens to a mating part. Visible physical analogs provide perspective. Non-linear magnification permits rapid, wide dynamic range object modification.",
  "claims": [
    "1. Electronic hardware comprising: a three-dimensional (3D) Computer Aided Design (CAD) environment; wherein the electronic hardware is adapted to: (a) accept a two-handed coordinated gesture by a user; (b) transmit responsively to (a) a first action uniquely identified by a predetermined two-handed-gesture-operation map and the two-handed coordinated gesture; (c) accept a first one-handed gesture by a first hand of the user and accept a second, different, one-handed gesture by a second hand of the user; (d) transmit responsively to (c) one or more second actions uniquely identified by a predetermined one-handed-gesture-operation map and the first one-handed gesture and the second one-handed gesture; wherein the two-handed coordinated gesture is performed by the user's two free hands; wherein the first one-handed gesture and the second one-handed gesture are each performed by a first free hand and a second free hand respectively of the user; wherein any “free hand” performing a gesture is free of fingertips touching any of: {mouse, keyboard, trackball, tablet, or screen}.",
    "2. The electronic hardware of claim 1: wherein at least one of the gestures, a “selecting gesture(s),” selects a fastener; wherein at least one following, different, gesture, a “placing gesture(s),” places a portion of the selected faster proximal to a first location on an object; wherein the electronic hardware is adapted further to: (e) place, responsive to the selecting and placing gestures, an associated mating element of the fastener at the first location on the object; wherein the fastener and the associated mating element, during placing, are automatically appropriate for a material and a thickness of the object at the first location.",
    "3. The electronic hardware of claim 2 is adapted further to: (f) mate, responsive to (e), the selected fastener with the associated mating element in the object.",
    "4. The electronic hardware of claim 1 is adapted further to: (g) generate, responsive to at least one generating gesture, a plurality of identical elements, each element comprising predetermined dimensions in at least two axes; (h) assemble automatically, responsive to (g), the plurality of identical elements on at least a portion of an object, such that the assembling arranges the plurality of identical elements in a uniform and contiguous pattern appropriate to the identical elements; wherein the generating of the identical objects is continual until the generating gesture stops.",
    "5. The electronic hardware of claim 4 is adapted further to: (i) modify a first subset of the plurality of assembled identical elements such that at least one attribute value is different than an original attribute value of the elements in (g) and (h); wherein (i) occurs after (h).",
    "6. The electronic hardware of claim 4 is adapted further to: (j) re-assign each of the assembled plurality of elements into a second subset or not into the second subset; wherein the re-assigning in (j) is continual while steps (g) and (h) are being repeated; wherein at least one attribute value of the elements in the second subset is different than the attribute value of elements not in the second subset; and wherein the second subset comprises elements more recently assembled in step (h) than elements not in the second subset, comprising elements less recently assembled in (h).",
    "7. The electronic hardware of claim 4 is adapted further to: (k) show, responsive to (g) and (h), borders between adjacent, assembled elements in the plurality of identical elements.",
    "8. The electronic hardware of claim 4: wherein the each elements in the plurality of identical elements are three-dimensional elements; and wherein the each elements comprise at least one predetermined analogous physical attribute.",
    "9. The electronic hardware of claim 8: wherein the each elements in the plurality of identical elements are three-dimensional structural elements; and wherein the at least one predetermined analogous physical attribute comprises a structural strength.",
    "10. The electronic hardware of claim 9 is adapted further to: (I) alter automatically a structural parameter of at least a subset of the plurality of assembled structural elements responsive to a constrain of changing properties of the object; wherein (I) is performed after (h); and wherein the changing properties of the object is after (h).",
    "11. The electronic hardware of claim 1: wherein at least one of the second actions comprises at least one constraint on the motion of an object; and the first one-handed gesture is performed by the fist hand of the user; and wherein at least one different second action comprises at least alteration of the object; and the second one-handed gesture is performed by the second hand of the user.",
    "12. The electronic hardware of claim 1 is adapted further to: (m) accept a third one-handed gesture, different than the first one-handed gesture, by the first hand of the user; wherein the first one-handed gesture comprises picking up a first kitchen tool; wherein the third one-handed gesture comprises using the first kitchen tool to alter an object; and wherein the object is other than food.",
    "13. The electronic hardware of claim 1 is adapted further to: (n) accept a third one-handed gesture, different than the first one-handed gesture, by the first hand of the user; wherein the first one-handed gesture comprises picking up a pair of glasses; wherein the third one-handed gesture comprises putting on the pair of glasses; (o) transmit a temporary change to a view point of an object responsive to a first attribute of the pair of glasses; wherein the temporary change remains in effect until a gesture is received comprising taking of the pair of glasses.",
    "14. The electronic hardware of claim 1 is adapted further to: (p) alter a transparency of a visible tool responsive to at least one speed of one or more gestures.",
    "15. The electronic hardware of claim 1 is adapted further to: (q) display an object from a first viewpoint; (r) display at least a portion of an analogous physical object responsive to the first viewpoint; wherein (q) and (r) may be in any order with respect to any other step.",
    "16. The electronic hardware of claim 1 is adapted further to: (s) display an object from a first viewpoint; (t) accept a location of the first hand of the user; (u) modify the transparency of the displayed object responsive to a distance between the location of the first hand and the object.",
    "17. The electronic hardware of claim 1 is adapted further to: (v) display an object from a first viewpoint; (w) constrain the object compliant with a predetermined first set of constraints; wherein the constraining limits modifications to the object that are responsive to the executing in (b) and (d).",
    "18. The electronic hardware of claim 1 is adapted further to: (x) display an object from a first viewpoint; (y) partition the object into first outside portion and a second inside portion; (z) alter at least one attribute value of outside portion to be different than the attribute value of the inside portion.",
    "19. The electronic hardware of claim 1 is adapted further to: (aa) display an object from a first viewpoint; (bb) accept a gesture from the user; (cc) distort the display of the object such that at least one portion of the object, as seen from the first viewpoint, is enlarged relative to a remainder of the object, responsive to the gesture accepted in (bb).",
    "20. A computer implementing a three-dimensional (3D) Computer Aided Design (CAD) environment, adapted to: (a) accept a two-handed coordinated gesture by a user; (b) execute responsively (a) a first action uniquely identified by a predetermined two-handed-gesture-operation map and the two-handed coordinated gesture; (c) accept a first one-handed gesture by a first hand of the user and accept a second, different, one-handed gesture by a second hand of the user; (d) execute responsively to (c) one or more second actions uniquely identified by a predetermined one-handed-gesture-operation map and the first one-handed gesture and the second one-handed gesture; wherein the two-handed coordinated gesture is performed by the user's two free hands; wherein the first one-handed gesture and the second one-handed gesture are each performed by a first free hand and a second free hand respectively of the user; wherein any “free hand” performing a gesture is free of fingertips touching any of: {mouse, keyboard, trackball, tablet, or screen}."
  ],
  "description_excerpt": "The problem to be solved is, “how to make a three-dimensional (3D) computer aided design (CAD) system more effective.” The field is 3D CAD systems. The field is more particularly the user interface (UI) of a 3D CAD system.\n\nA 3D CAD system includes design or viewing capabilities, or both. Prior art in 3D CAD UI includes keyboards, touch pads, touchscreens, mice, trackballs, and tablets. Actions of the 3D CAD system responsive to these sensors include changing the dimensions of an object; changing a viewpoint of the object; moving one portion of an object with respect to another portion of an object; selecting a component from a library; drawing a portion of an object; altering the material or texture of an object; performing administrative functions such as loading, saving, transmitting or printing object data; and the like. By “object,” we mean any part, portion, attribute or entirety of an object or set of associated objects. “Object” may be the traditionally named, “workpiece;” however its use herein has wider scope, including one or more objects, elements, and tools.\n\nAn object is a visual, and optionally haptic or audio, representation of physical object, such as a physical coffee cup; or an object that remains virtual, such as a character in a movie, game, virtual reality environment or an operator environment, such as the driver of an automobile or any other conveyance or sports equipment. Such a virtual object may be, for example, a deer in a heads-up display for a driver.",
  "cpc": [
    "G06F 3/017",
    "G06F 17/50",
    "G06F 2111/04",
    "G06F 2111/18",
    "G06F 3/04815",
    "G06F 3/04842",
    "G06F 30/00",
    "G06F 30/12"
  ],
  "ipc": [
    "G06F 3/01",
    "G06F 3/0481",
    "G06F 3/0484",
    "G06F 3/048"
  ],
  "inventors": [
    "Ted Selker",
    "Kim Rubin"
  ],
  "filing_date": "2016-11-16",
  "publication_date": "2018-08-14",
  "grant_date": "2018-08-14",
  "priority_date": "2015-11-18",
  "application_number": "US-201615353171-A",
  "family_id": "58691857",
  "cited_by_count": 112,
  "citations": [
    "US20060182346A1",
    "US9696808B2",
    "US20090103780A1",
    "US20080231926A1",
    "US20120280927A1",
    "US8854433B1",
    "US9383895B1",
    "US20140168084A1",
    "US9720507B2",
    "US20150227214A1",
    "US9870061B2",
    "US20160180701A1",
    "US20170060254A1"
  ]
}