Weinan Zhang
Jun Wang
ABSTRACT
Real-Time Bidding (RTB) is revolutionising display advertising by facilitating per-impression auctions to buy ad impressions as they are being generated. Being able to use impression-level data, such as user cookies, encourages user behaviour targeting, and hence has significantly improved the effectiveness of ad campaigns. However, a fundamental drawback of RTB is its instability because the bid decision is made per impression and there are enormous fluctuations in campaigns' key performance indicators (KPIs). As such, advertisers face great difficulty in controlling their campaign performance against the associated costs. In this paper, we propose a feedback control mechanism for RTB which helps advertisers dynamically adjust the bids to effectively control the KPIs, e.g., the auction winning ratio and the effective cost per click. We further formulate an optimisation framework to show that the proposed feedback control mechanism also has the ability of optimising campaign performance. By settling the effective cost per click at an optimal reference value, the number of campaign's ad clicks can be maximised with the budget constraint. Our empirical study based on real-world data verifies the effectiveness and robustness of our RTB control system in various situations. The proposed feedback control mechanism has also been deployed on a commercial RTB platform and the online test has shown its success in generating controllable advertising performance.
- K. Amin, M. Kearns, P. Key, and A. Schwaighofer. Budget optimization for sponsored search: Censored learning in mdps. UAI, 2012.Google Scholar
- K. J. Åström and P. Kumar. Control: A perspective. Automatica, 50(1):3--43, 2014. Google ScholarDigital Library
- K. J. Åström and R. M. Murray. Feedback systems: an introduction for scientists and engineers. Princeton university press, 2010. Google ScholarCross Ref
- S. Balseiro, O. Besbes, and G. Y. Weintraub. Repeated auctions with budgets in ad exchanges: Approximations and design. Columbia Business School Research Paper, (12/55), 2014.Google Scholar
- R. Battiti. First-and second-order methods for learning: between steepest descent and newton's method. Neural computation, 4(2):141--166, 1992. Google ScholarDigital Library
- S. Bennett. Development of the pid controller. Control Systems, 13(6):58--62, 1993.Google ScholarCross Ref
- S. P. Bhattacharyya, H. Chapellat, and L. H. Keel. Robust control. The Parametric Approach, by Prentice Hall PTR, 1995. Google ScholarDigital Library
- Y. Chen, P. Berkhin, B. Anderson, and N. R. Devanur. Real-time bidding algorithms for performance-based display ad allocation. KDD, 2011. Google ScholarDigital Library
- Y. Cui, R. Zhang, W. Li, and J. Mao. Bid landscape forecasting in online ad exchange marketplace. In KDD, pages 265--273. ACM, 2011. Google ScholarDigital Library
- B. W. Dezotell. Water level controller, June 9 1936. US Patent 2,043,530.Google Scholar
- R. Gomer, E. M. Rodrigues, N. Milic-Frayling, and M. Schraefel. Network analysis of third party tracking: User exposure to tracking cookies through search. In WI, 2013. Google ScholarDigital Library
- Google. The arrival of real-time bidding. Technical report, 2011.Google Scholar
- Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In ICDM, 2008. Google ScholarDigital Library
- T. Jambor, J. Wang, and N. Lathia. Using control theory for stable and efficient recommender systems. In WWW, 2012. Google ScholarDigital Library
- N. Karlsson and J. Zhang. Applications of feedback control in online advertising. In American Control Conference, 2013.Google ScholarCross Ref
- K. J. Lang, B. Moseley, and S. Vassilvitskii. Handling forecast errors while bidding for display advertising. In WWW, 2012. Google ScholarDigital Library
- K.-C. Lee, A. Jalali, and A. Dasdan. Real time bid optimization with smooth budget delivery in online advertising. In ADKDD, 2013. Google ScholarDigital Library
- K.-C. Lee, B. Orten, A. Dasdan, and W. Li. Estimating conversion rate in display advertising from past performance data. In KDD, 2012. Google ScholarDigital Library
- H. Liao, L. Peng, Z. Liu, and X. Shen. ipinyou global rtb bidding algorithm competition dataset. In ADKDD, 2014. Google ScholarDigital Library
- R. McGill, J. W. Tukey, and W. A. Larsen. Variations of box plots. The American Statistician, 32(1):12--16, 1978.Google Scholar
- K. Meng, Y. Wang, X. Zhang, X.-c. Xiao, et al. Control theory based rating recommendation for reputation systems. In ICNSC, 2006.Google Scholar
- S. Muthukrishnan. Ad exchanges: Research issues. In Internet and network economics, pages 1--12. Springer, 2009. Google ScholarDigital Library
- R. C. Nelson. Flight stability and automatic control, volume 2. WCB/McGraw Hill, 1998.Google Scholar
- R. J. Oentaryo, E. P. Lim, D. J. W. Low, D. Lo, and M. Finegold. Predicting response in mobile advertising with hierarchical importance-aware factorization machine. In WSDM, 2014. Google ScholarDigital Library
- C. Perlich, B. Dalessandro, R. Hook, O. Stitelman, T. Raeder, and F. Provost. Bid optimizing and inventory scoring in targeted online advertising. In KDD, pages 804--812, 2012. Google ScholarDigital Library
- G. Peterson and D. J. Cook. Decision-theoretic layered robotic control architecture. In AAAI/IAAI, page 976, 1999. Google ScholarDigital Library
- M. Richardson, E. Dominowska, and R. Ragno. Predicting clicks: estimating the click-through rate for new ads. In WWW, pages 521--530. ACM, 2007. Google ScholarDigital Library
- D. E. Rivera, M. Morari, and S. Skogestad. Internal model control: Pid controller design. Industrial & engineering chemistry process design and development, 25(1), 1986.Google Scholar
- J. Xu, C. Chen, G. Xu, H. Li, and E. R. T. Abib. Improving quality of training data for learning to rank using click-through data. In WSDM, 2010. Google ScholarDigital Library
- S. Yuan, B. Chen, J. Wang, P. Mason, and S. Seljan. An Empirical Study of Reserve Price Optimisation in Real-Time Bidding. In KDD, 2014. Google ScholarDigital Library
- S. Yuan, J. Wang, and X. Zhao. Real-time bidding for online advertising: measurement and analysis. In ADKDD, 2013. Google ScholarDigital Library
- V. Zanardi and L. Capra. Dynamic updating of online recommender systems via feed-forward controllers. In SEAMS, 2011. Google ScholarDigital Library
- W. Zhang, S. Yuan, and J. Wang. Optimal real-time bidding for display advertising. In KDD, 2014. Google ScholarDigital Library
- W. Zhang, S. Yuan, J. Wang, and X. Shen. Real-time bidding benchmarking with ipinyou dataset. arXiv, 2014.Google Scholar
- W. Zhang, Y. Zhang, B. Gao, Y. Yu, X. Yuan, and T.-Y. Liu. Joint optimization of bid and budget allocation in sponsored search. In KDD, 2012. Google ScholarDigital Library
Index Terms
- Feedback Control of Real-Time Display Advertising
Recommendations
Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge ManagementReal-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only need to estimate the relevance ...
Bid Optimization by Multivariable Control in Display Advertising
KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningReal-Time Bidding (RTB) is an important paradigm in display advertising, where advertisers utilize extended information and algorithms served by Demand Side Platforms (DSPs) to improve advertising performance. A common problem for DSPs is to help ...
Optimal real-time bidding for display advertising
KDD '14: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data miningIn this paper we study bid optimisation for real-time bidding (RTB) based display advertising. RTB allows advertisers to bid on a display ad impression in real time when it is being generated. It goes beyond contextual advertising by motivating the ...
Comments