Machine learning based content delivery

{
  "publication_number": "US10311371B1",
  "country": "US",
  "kind": "B1",
  "title": "Machine learning based content delivery",
  "abstract": "Systems and methods for managing content delivery functionalities based on machine learning models are provided. In one aspect, content requests are routed in accordance with clusters of historical content requests to optimize cache performance. In another aspect, content delivery strategies for responding to content requests are determined based on a model trained on data related to historical content requests. The model may also be used to determine above-the-fold configurations for rendering responses to content requests. In some embodiments, portions of the model can be executed on client computing devices.",
  "claims": [
    "1. A computer-implemented method for facilitating content delivery, the computer-implemented method comprising: under control of a hardware computing device configured with specific computer executable instructions, obtaining first data characterizing individual requests of a plurality of content requests over a specified period of time; obtaining second data characterizing content delivery strategy in response to individual requests of the plurality of content requests; obtaining third data characterizing content delivery performance in response to individual requests of the plurality of content requests; training a machine learning model that predicts content delivery performance, wherein the machine learning model is trained, at least in part, on the first, second and third data, and wherein the machine learning model is structured such that a portion of the machine learning model can be executed by one or more user computing devices; obtaining an incoming content request from a first user computing device; determining a predicted content delivery performance for configuring a requested content page in a first above-the-fold (ATF) configuration in response to the incoming content request based, at least in part, on the machine learning model; and in response to a determination that the predicted content delivery performance satisfies a predetermined condition: configuring the requested content page in the first ATF configuration for display in a user interface; generating a response to the first content request in accordance with configuring the requested content page in the first ATF configuration, wherein the generated response indicates a priority for retrieving network resources to be displayed in an ATF portion of the requested content page; and transmitting the generated response to the user computing device, wherein reception of the generated response causes the user computing device to retrieve the network resources in accordance with the priority indicated in the generated response.",
    "2. The computer-implemented method of claim 1, wherein the first data includes at least one of a type of requested resource, request timing information, associated network condition or topology, characteristics of requesting devices, or associated location information.",
    "3. The computer-implemented method of claim 1, wherein the second data includes at least one of inclusion or exclusion of features, lazy-loading or prefetching of resources, in-lining or external calls for resources, low quality or high quality data formats, associated dependency graphs, above-the-fold information, or request routing information.",
    "4. The computer-implemented method of claim 1, wherein the third data includes at least one of a total time to load a content page or individual network resources, number of times the content page or individual network resources was retrieved, bandwidth utilization, network latency, number of hops between client and server, processor utilization, memory utilization, cache hit or miss ratio, or load time per cache miss.",
    "5. The computer-implemented method of claim 1, wherein the predicted content delivery performance includes a predicted valuation of a user associated with the incoming content request.",
    "6. A computer-implemented method comprising: under control of a hardware computing device configured with specific computer executable instructions, obtaining a machine learning model trained to predict content delivery performance based on information related to content requests and content delivery strategies; generating a prediction of content delivery performance by providing the obtained machine learning model with at least one attribute of a first content request or at least one portion of a first content delivery strategy for configuring a content page corresponding to the first content request in a first above-the-fold (ATF) configuration for display in a user interface; and in response to a determination that the prediction of content delivery performance satisfies a predetermined condition, configuring the content page in the first ATF configuration and indicating a priority for retrieving network resources to be displayed in an ATF portion of the content page.",
    "7. The computer-implemented method of claim 6, wherein the first content delivery strategy further includes at least one of inclusion or exclusion of a feature, lazy-loading or prefetching of a resource, in-lining or external call for a resource, data format, dependency graph, or routing of a request.",
    "8. The computer-implemented method of claim 6, wherein the at least one attribute of the first content request corresponds to information related to a user associated with the first content request.",
    "9. The computer-implemented method of claim 8, wherein the information related to the user includes at least one of user demographics, cultural preferences, geographic location, occupation, income, spending levels, content interests, hobbies, preferences, settings, purchase histories, Web browsing histories, search histories, session tracking histories, user interaction data, ownership or rental lists, or user reviews.",
    "10. The computer-implemented method of claim 6 further comprising obtaining content delivery performance data that corresponds to the implementation of the first content delivery strategy in response to the first content request.",
    "11. The computer-implemented method of claim 10 further comprising causing updating of the machine learning model based, at least in part, on the obtained content delivery performance data.",
    "12. A system comprising: a data store configured to at least store computer-executable instructions; and a hardware processor in communication with the data store, the hardware processor configured to execute the computer-executable instructions to at least: obtain a machine learning model trained to predict content delivery performance based on information related to content requests and content delivery strategies; generate a first prediction of content delivery performance by providing the obtained machine learning model with at least one attribute of a first content request or at least one portion of a first content delivery strategy for configuring a content page corresponding to the first content request in a first above-the-fold (ATF) configuration for display in a user interface; and in response to a determination that the first prediction of content delivery performance satisfies a predetermined condition, configure the content page in the first ATF configuration and indicating a priority for retrieving network resources to be displayed in an ATF portion of the content page.",
    "13. The system of claim 12, wherein the machine learning model is trained on historical data regarding content requests over a specified period of time.",
    "14. The system of claim 13, wherein the hardware process is further configured to at least determine the first content delivery strategy based, at least in part, on a correlation between content requests and content delivery strategies derived from the historical data.",
    "15. The system of claim 12, wherein the hardware processor is further configured to at least generate a second prediction of content delivery performance by providing the obtained machine learning model with at least one portion of a second content delivery strategy.",
    "16. The system of claim 15, wherein the predetermined condition includes a comparison between the first and second predictions.",
    "17. A non-transitory computer readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising: obtaining a machine learning model trained to predict content delivery performance based on information related to content requests and content delivery strategies; generating a prediction of content delivery performance by providing the obtained machine learning model with at least one attribute of a first content request or at least one portion of a first content delivery strategy for configuring a content page corresponding to the first content request in a first above-the-fold (ATF) configuration for display in a user interface; and in response to a determination that the prediction of content delivery performance satisfies a predetermined condition, configuring the content page in the first ATF configuration and indicating a priority for retrieving network resources to be displayed in an ATF portion of the content page.",
    "18. The non-transitory computer-readable storage medium of claim 17, wherein the machine learning model corresponds to a decision tree model or an artificial neural network model.",
    "19. The non-transitory computer-readable storage medium of claim 17, wherein implementing the first content delivery strategy further comprises at least one of identifying a pre-generated response, dynamically generating HTML documents, or routing the first content request to a corresponding content serving device, in accordance with the first content delivery strategy.",
    "20. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise obtaining an updated machine learning model, wherein the updated machine learning model is trained on at least a portion of content delivery performance data corresponding to the implementation of the first content delivery strategy in response to the first content request.",
    "21. The non-transitory computer-readable storage medium of claim 20, wherein the operations further comprise implementing a second content delivery strategy in response to a second content request based, at least in part, on the updated machine learning model."
  ],
  "description_excerpt": "Generally described, computing devices and communication networks can be utilized to exchange information. In a common application, a computing device can request content from another computing device via the communication network. For example, a user at a personal computing device can utilize a software browser application to request a Web page from a server device via the Internet. In such embodiments, the user computing device can be referred to as a client computing device and the server device can be referred to as a content provider.\n\nWith reference to an illustrative example, a user of a client computing device may search for or navigate to a desired content item. The user may utilize an application to submit requests, search queries and other interactions to one or more content providers. The application may be a purpose-built application for requesting and interacting with such content items or the application may be a general purpose browser application. The requested content may be identified by one or more embedded resource identifiers, such as uniform resource locators (“URLs”). In turn, software on the client devices typically processes embedded resource identifiers to generate requests for the resources. Often, the resource identifiers reference a computing device associated with the content provider such that the client device would transmit the request for the resource to the referenced content provider computing device.\n\nSome content providers attempt to facilitate the delivery of requested content through the utilization of a content delivery network (“CDN”) service provider.",
  "cpc": [
    "H04L 67/02",
    "G06F 18/23",
    "G06F 18/24",
    "G06N 20/00",
    "G06N 3/0499",
    "G06N 3/08",
    "G06N 3/09",
    "G06N 3/092",
    "G06N 5/01",
    "G06N 5/02",
    "H04L 67/1097",
    "H04L 67/568",
    "H04L 67/5681"
  ],
  "ipc": [
    "G06N 20/00",
    "G06N 5/02",
    "H04L 29/08"
  ],
  "assignees": [
    "Amazon Technologies Inc"
  ],
  "inventors": [
    "Blair Livingstone Hotchkies",
    "Bradley Scott Bowman",
    "Paul Christopher Cerda",
    "Min Chong",
    "Anthony T. Chor",
    "Leo Parker Dirac",
    "Kevin Andrew Granade",
    "Udip Pant",
    "Sean Michael Scott",
    "Aman Agarwal"
  ],
  "filing_date": "2014-12-19",
  "publication_date": "2019-06-04",
  "grant_date": "2019-06-04",
  "priority_date": "2014-12-19",
  "application_number": "US-201414578050-A",
  "family_id": "66673614",
  "cited_by_count": 126,
  "citations": [
    "US5649185A",
    "US5664106A",
    "US5819033A",
    "US5832517A",
    "US20080086559A1",
    "US6714975B1",
    "US6173322B1",
    "US20040039820A1",
    "US5999636A",
    "US8468245B2",
    "US20080215755A1",
    "US6185598B1",
    "US6438592B1",
    "US6243761B1",
    "US20020120666A1",
    "US20020150276A1",
    "US6529910B1",
    "US6182125B1",
    "US6473804B1",
    "US20020135611A1",
    "US7373599B2",
    "US6978418B1",
    "US20120042277A1",
    "US7096193B1",
    "US20060179080A1",
    "US7120871B1",
    "US6662233B1",
    "US6377257B1",
    "US7523181B2",
    "US7707071B2",
    "US20010034771A1",
    "US7748005B2",
    "US20050055420A1",
    "US6553419B1",
    "US6820133B1",
    "US20040039794A1",
    "US7650376B1",
    "US20050021862A1",
    "US6697805B1",
    "US20070250560A1",
    "US20080065745A1",
    "US7555542B1",
    "US20030182413A1",
    "US7346676B1",
    "US20020062372A1",
    "US20020016802A1",
    "US6920498B1",
    "US20020116491A1",
    "US6698013B1",
    "US7756032B2",
    "US20060069808A1",
    "US7009943B2",
    "US20020099829A1",
    "US20020073235A1",
    "US20020112049A1",
    "US20020107913A1",
    "US20020165912A1",
    "US8069231B2",
    "US20020138443A1",
    "US7085825B1",
    "US20040059796A1",
    "US20020161911A1",
    "US20030118249A1",
    "US20020156884A1",
    "US20030009488A1",
    "US20020194382A1",
    "US20020198963A1",
    "US7343399B2",
    "US20030005111A1",
    "US20040199603A1",
    "US6633324B2",
    "US20030037108A1",
    "US7185084B2",
    "US20030065784A1",
    "US20030131106A1",
    "US20030128233A1",
    "US20030130982A1",
    "US20060209701A1",
    "US7065496B2",
    "US20080065724A1",
    "US20030182305A1",
    "US20030236836A1",
    "US20040049579A1",
    "US7114160B2",
    "US20040194085A1",
    "US7269657B1",
    "US20050076111A1",
    "US20030217144A1",
    "US20030221000A1",
    "US7676570B2",
    "US7860736B2",
    "US20040049541A1",
    "US7961736B2",
    "US20040064558A1",
    "US20040064293A1",
    "US20090055542A1",
    "US20040128538A1",
    "US20040221034A1",
    "US7752301B1",
    "US7581224B2",
    "US20070016736A1",
    "US20050076339A1",
    "US20050086645A1",
    "US20050091612A1",
    "US20050102683A1",
    "US20060265497A1",
    "US7107273B2",
    "US20080172488A1",
    "US20050182826A1",
    "US20050198571A1",
    "US20070214454A1",
    "US20050223091A1",
    "US20050223092A1",
    "US7685273B1",
    "US20050229119A1",
    "US20050273507A1",
    "US20070299869A1",
    "US20060015865A1",
    "US20060020714A1",
    "US20060026275A1",
    "US20060059246A1",
    "US20070271375A1",
    "US20060085536A1",
    "US7933988B2",
    "US20060218304A1",
    "US7698418B2",
    "US7685270B1",
    "US20060235961A1",
    "US20060251339A1",
    "US20100318508A1",
    "US20090119388A1",
    "US20060282758A1",
    "US20070021998A1",
    "US7707173B2",
    "US20070050703A1",
    "US20070088805A1",
    "US20070094325A1",
    "US20070118640A1",
    "US7725658B2",
    "US20070300152A1",
    "US7904875B2",
    "US20070136469A1",
    "US20070143672A1",
    "US7873065B1",
    "US20090083228A1",
    "US20070245299A1",
    "US20070198982A1",
    "US7596150B2",
    "US20070219795A1",
    "US20070226058A1",
    "US20070245010A1",
    "US20080183721A1",
    "US20070250611A1",
    "US20070266151A1",
    "US7623460B2",
    "US20070299965A1",
    "US20080037432A1",
    "US20080050021A1",
    "US20080228574A1",
    "US20080098310A1",
    "US20080114875A1",
    "US7765295B2",
    "US20080104502A1",
    "US20080183672A1",
    "US20080208961A1",
    "US20080215583A1",
    "US20080250327A1",
    "US20090122714A1",
    "US20080289029A1",
    "US20070239610A1",
    "US20110096987A1",
    "US20090037517A1",
    "US20100211459A1",
    "US20090063690A1",
    "US20090089448A1",
    "US7653725B2",
    "US20090187575A1",
    "US7937456B2",
    "US20090248852A1",
    "US20140143320A1",
    "US20090248786A1",
    "US20090248893A1",
    "US20090319636A1",
    "US20090327914A1",
    "US20090327460A1",
    "US7925782B2",
    "US20090327517A1",
    "US20100005403A1",
    "US8165915B1",
    "US20140250051A1",
    "US20100034470A1",
    "US8489737B2",
    "US20140129707A1",
    "US8051166B1",
    "US10104009B2",
    "US8117306B1",
    "US7930393B1",
    "US8122124B1",
    "US20150326491A1",
    "US20180054371A1",
    "US8286176B1",
    "US8296429B2",
    "US8316124B1",
    "US20130007273A1",
    "US9825831B2",
    "US20150263927A1",
    "US7865594B1",
    "US9794188B2",
    "US20170187591A1",
    "US9660890B2",
    "US9210099B2",
    "US9628403B2",
    "US9160641B2",
    "US20170070446A1",
    "US9118543B2",
    "US8762526B2",
    "US20170054621A1",
    "US20150358250A1",
    "US9088460B2",
    "US8843625B2",
    "US20140304406A1",
    "US9491073B2",
    "US20150012649A1",
    "US9071502B2",
    "US20160020972A1",
    "US20140257891A1",
    "US20100195908A1",
    "US9367929B2",
    "US20160267354A1",
    "US8667127B2",
    "US8463877B1",
    "US20100325615A1",
    "US20110055627A1",
    "US20100332650A1",
    "US20110145715A1",
    "US20120164621A1",
    "US20110264511A1",
    "US20140113600A1",
    "US20130191450A1",
    "US20130031040A1",
    "US20160188181A1",
    "US20130198298A1",
    "US20150220990A1",
    "US20150242379A1",
    "US20140135105A1",
    "US20140219279A1",
    "US20140372511A1",
    "US20150032801A1",
    "US20150088968A1",
    "US20150156280A1",
    "US20150288593A1",
    "US20150333997A1",
    "US9769248B1",
    "US20180007121A1",
    "US10027739B1"
  ]
}