Robust tree-based causal inference for complex ad effectiveness analysis

Pengyuan Wang, Wei Sun, Dawei Yin, Jian Yang, Yi Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Scopus citations


As the online advertising industry has evolved into an age of diverse ad formats and delivery channels, users are exposed to complex ad treatments involving various ad characteristics. The diversity and generality of ad treatments call for accurate and causal measurement of ad effectiveness, i.e., how the ad treatment causes the changes in outcomes without the confounding effect by user characteristics. Various causal inference approaches have been proposed to measure the causal effect of ad treatments. However, most existing causal inference methods focus on univariate and binary treatment and are not well suited for complex ad treatments. Moreover, to be practical in the data-rich online environment, the measurement needs to be highly general and efficient, which is not addressed in conventional causal inference approaches. In this paper we propose a novel causal inference framework for assessing the impact of general advertising treatments. Our new framework enables analysis on uni- or multi-dimensional ad treatments, where each dimension (ad treatment factor) could be discrete or continuous. We prove that our approach is able to provide an unbiased estimation of the ad effectiveness by controlling the confounding effect of user characteristics. The framework is computationally efficient by employing a tree structure that specifies the relationship between user characteristics and the corresponding ad treatment. This tree-based framework is robust to model misspecification and highly flexible with minimal manual tuning. To demonstrate the efficacy of our approach, we apply it to two advertising campaigns. In the first campaign we evaluate the impact of different ad frequencies, and in the second one we consider the synthetic ad effectiveness across TV and online platforms. Our framework successfully provides the causal impact of ads with different frequencies in both campaigns. Moreover, it shows that the ad frequency usually has a treatment effect cap, which is usually over-estimated by naive estimation.

Original languageEnglish (US)
Title of host publicationWSDM 2015 - Proceedings of the 8th ACM International Conference on Web Search and Data Mining
PublisherAssociation for Computing Machinery, Inc
Number of pages10
ISBN (Electronic)9781450333177
StatePublished - Jan 1 2015
Externally publishedYes
Event8th ACM International Conference on Web Search and Data Mining, WSDM 2015 - Shanghai, China
Duration: Jan 31 2015Feb 6 2015


Other8th ACM International Conference on Web Search and Data Mining, WSDM 2015


  • Advertising
  • Causal inference
  • Online strategy measurement

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Robust tree-based causal inference for complex ad effectiveness analysis'. Together they form a unique fingerprint.

Cite this