What is advertising effectiveness measurement? A 5-step guide, including media-specific metrics and tool selection.

"Advertising effectiveness measurement" is essential for accurately understanding the results of advertising and using that information to inform future strategies. Which advertisements are contributing to sales? Which channels should we increase investment in? Effectiveness measurement provides the foundation for answering these questions.

However, in today's world, we live in a time where all kinds of channels coexist, including mass advertising such as TV commercials and transit advertising, web advertising, and social media promotions. If you make a mistake in the measurement method, you risk making wrong decisions and failing to optimize your advertising investment.

This article systematically explains everything from the basic concepts of measuring advertising effectiveness, key metrics for each media type, the practical aspects of brand lift surveys to measure psychological effects, why effectiveness measurement is said to be difficult, how to choose tools, and practical points for achieving results.

What is advertising effectiveness measurement?

Advertising effectiveness measurement refers to the measurement of online and offline advertising.A process of visualizing and evaluating the degree of effectiveness using numerical values ​​and indicators.This is the point. To achieve maximum results within a limited advertising budget, it is essential to rely on objective data-based analysis rather than intuition or experience.

The role of measuring advertising effectiveness is not limited to simply confirming whether an advertisement was effective or not. For successful patterns, it's about understanding "why it was effective," and for unsuccessful patterns, it's about understanding "why it wasn't effective."Indicators for analyzing causal relationshipsWorks as well.

Companies that thoroughly implement a rapid PDCA cycle for their advertising campaigns are the ones that consistently achieve results through advertising.

Why is measuring advertising effectiveness important?: 4 benefits

The biggest advantage of measuring advertising effectiveness is,Limited advertising budgets can be reallocated to "proven effective measures."This is the point. Continuing to run ads without measuring their effectiveness is equivalent to continuing to invest your budget in ads that aren't producing results. Here, we'll outline four specific benefits of measuring ad effectiveness.

1. Advertising budget allocation can be determined using data.

Knowing which channels and creatives are contributing to results, based on data rather than intuition, allows for data-driven decisions on budget allocation, such as "Should we allocate our budget to TV commercials or web advertising?" In today's diverse media landscape, differences in the accuracy of these decisions directly translate into differences in cost-effectiveness.

2. It allows for the identification of areas for improvement and the acceleration of the PDCA cycle.

Effectiveness measurement goes beyond simply confirming whether an action was effective or not; it serves as a starting point for analyzing "why it was effective/not effective." By pinpointing where the issues lie—whether in creative work, targeting, or timing—the cycle to the next action can be accelerated.

3. It allows for accountability within the company and makes it easier to secure the budget.

You'll be able to answer management's question, "How much revenue did this advertising investment generate?" with quantitative evidence. Marketing teams that can visualize the effectiveness of their advertising will find it easier to secure the next fiscal year's budget and make investment decisions for new initiatives.

4. It allows us to break away from relying on the experience and intuition of the person in charge.

As data on effectiveness measurement accumulates, insights into "what worked, under what conditions, and to what extent" become an asset for the organization. The ability to continue reproducible advertising operations even when personnel change is the foundation of long-term marketing strength.

Three effects that can be measured by advertising effectiveness (contact, psychology, and sales)

The effectiveness of advertising is multifaceted, and simply judging whether it "led to sales" doesn't capture the whole picture. Evaluating from the following three perspectives makes it easier to determine the intrinsic value of each initiative.

1. Contact effect (reach and visibility)

These are metrics that show how many people an advertisement reached and how many people saw it. For TV commercials, this would include GRP and reach rate, while for web advertisements, it would include impressions and viewability.

2. Psychological effects (changes in attitude and cognition)

This measures how viewers' awareness, interest, and favorability change as a result of exposure to advertising. This includes brand recall, ad awareness, and changes in purchase intent. While often overlooked because it doesn't directly impact sales, it's essential for evaluating brand campaigns and awareness-building strategies. As a method for quantitatively measuring psychological effects,Brand lift surveyThis is widely used (details will be explained in the next section).

3. Sales impact (actions and results)

This evaluates how many actual actions, such as purchases or sign-ups, were triggered by advertising. This is visualized using metrics such as CPA (Cost Per Acquisition) and ROAS (Return on Advertising Spend).

The basics of measuring advertising effectiveness: The concept of "relative evaluation"

The basics of measuring advertising effectiveness areRelative evaluationTherefore, we clearly define what we want to achieve through advertising beforehand, and measure its effectiveness by comparing the changes in metrics before and after the campaign launch.

The important thing is not to be satisfied with the fact that "the numbers have improved",Focus on whether you achieved your goal.Therefore, when comparing results before and after advertising, it is necessary to keep conditions such as the period, target users, and channels as consistent as possible.

Furthermore, the effectiveness of advertising is also influenced by overall market trends and competition. Therefore, it is essential to establish assumptions based on the external environment in order to correctly interpret the measurement results.

How to measure advertising effectiveness: 5 steps

Measuring advertising effectiveness is based on a relative evaluation that compares results before and after the campaign. Here, we will explain how to implement this concept in practice, broken down into five steps.

STEP 1: Set advertising objectives and KPIs.

First, clearly define "what you want to achieve with this advertisement." If the goal is to gain awareness, you should focus on exposure and psychological effects (reach, brand recognition rate, etc.); if the goal is to acquire purchases or sign-ups, you should focus on sales effects (CVR, CPA, etc.). The metrics you should look at will vary depending on your objective. For example, if you evaluate a TV commercial aimed at raising awareness of a new product using CPA, you risk mistakenly concluding that it was "ineffective."Objective → Scope of effect to measure → KPIThe starting point is to implement it in that order.

STEP 2: Record the baseline before launching the ad.

The basis of measuring advertising effectiveness is "relative evaluation," which involves comparing results before and after the campaign. Always record pre-campaign figures corresponding to your set KPIs, such as website traffic, branded searches, brand awareness, and sales. Without a baseline, it's impossible to determine whether the post-campaign figures reflect the "effectiveness of the advertising" or are simply the "original level."

STEP 3: Prepare the measurement environment and tools.

For web advertising, this includes setting up conversions in GA4 and installing tracking tags. For brand lift studies, it includes designing the study for exposed and unexposed groups. Before launching an ad campaign, we set up the measurement system. Some data cannot be obtained once the ad campaign starts (such as awareness rates before the campaign), so skipping this step will be irreversible later.

STEP 4: Collect data after the ad is published and compare the before and after results.

After the ad is launched, we compare the changes in KPIs to the baseline. At this time, it is important to standardize the comparison conditions as much as possible, such as the period, target users, and channels. We also interpret the changes while taking into account external factors such as seasonality, competitor activity, and market trends. It's not just about the fact that "the numbers have changed," but rather...Whether the pre-set goals were achievedWe will focus on that.

STEP 5: Translate the results into improvement actions.

Based on the measurement results, we identify "what is working well and what needs improvement," leading to concrete actions such as replacing creatives, adjusting targeting, and reviewing budget allocation. By repeating this cycle, the accuracy of measurements and the quality of advertising operations will continuously improve (see "Four Practical Points for Turning Advertising Effectiveness Measurement into Results" below for details).

Effectiveness measurement indicators for mass advertising (TV commercials, newspapers, radio)

Mass advertising is an advertising method that delivers information to a large, unspecified audience simultaneously, such as television commercials, newspaper ads, magazine ads, and radio commercials. While it has broad reach and can promote awareness among many people in a short period,It is difficult to quantitatively assess the effects.This presents a challenge.

GRP (gross viewing rating)

GRP (Gross Rating Point)) is a representative effectiveness measurement metric used in television commercials.The total viewership rate of TV commercials aired during a certain periodThis represents the average viewership rating of a television program multiplied by the number of commercials aired during the program.

[ 例：平均視聴率10%の番組でCMを3本放送した場合 → 10 × 3 ＝ 30GRP ]

A higher GRP indicates that the ad reached a larger audience, but it doesn't tell us whether people actually watched the ad. It only shows how many people the ad was seen by.displayedThis is an indicator that shows that.

GAP (Total Gaze Volume)

GAP (Gross Attention Point) was proposed in 2015 by Ryuji Yokoyama and others at Digital Intelligence Co., Ltd. as an indicator to supplement the shortcomings of GRP."Commercials that reach you, commercials that don't" Shoeisha Publishing). Using facial recognition with a sensor camera,How much attention viewers paid to TV commercialsThis is measured in units of seconds (e.g., 5 seconds of gaze = 5 GAP).

By combining GRP and GAP, it's possible to determine whether the target audience actually saw the commercial. GAP is still an evolving metric, but it has the potential to become the mainstream alternative to GRP in the future.

Advertisement equivalent

Through public relations and PR activities, we aim to highlight the value of our products and services when they are featured in news programs, newspapers, magazines, and online media.Metrics to understand by converting them into advertising costs.In recent years, it has become important to set advertising equivalent value targets in advance and strategically advance PR activities.

Increase in number of name searches

This method measures changes in the number of searches for specific company or product names on Google, Yahoo!, and other search engines. An increase in branded searches after a TV commercial airs suggests a certain level of advertising effectiveness. However, interpretation must take into account other factors such as seasonality and trends.

Increase in site access

Changes in website traffic, such as page views (PV) and unique users (UU), are also important metrics for measuring the effectiveness of offline advertising. Even if branded searches haven't increased, an increase in site traffic suggests there may have been a potential branding effect.

Metrics for newspaper and radio advertising

Effectiveness measurement metrics for outdoor advertising and transit advertising (OOH)

OOH (Out of Home) advertising is an advertising method that reaches consumers along their daily routines, such as in train stations, on trains, and on outdoor billboards. Unlike mass advertising, it does not have a broad reach.Repeated contact with people moving through specific areas or along certain routes.It has strengths in this area, and requires evaluation from a different perspective than mass advertising and web advertising.

Advertisement equivalent

This metric evaluates the exposure generated by OOH (Out-of-Home) advertising by converting it into advertising costs. The concept is similar to mass advertising, but for OOH, it is calculated by multiplying it with area-specific data such as the number of passengers getting on and off trains and traffic volume.

Increase in number of name searches

This metric measures how much the number of searches for a company name and product name increased after the start of out-of-home (OOH) advertising. For OOH advertising, which is concentrated in specific areas such as train stations and commercial facilities, tracking changes in search volume in the surrounding areas makes it easier to understand the impact of exposure on behavior.

pedestrian flow data and customer visit measurement.

This method uses GPS data and store visit measurement tools to analyze the correlation between the placement of OOH (Out-of-Home) advertisements and store visit behavior. Among offline advertisements, OOH is characterized by its relative ease of linking with behavioral data.

Metrics specific to DOOH (Digital Out-of-Home Advertising)

With digital signage advertising, you can use some metrics similar to those for web advertising, such as the number of impressions and visibility by time of day. Unlike traditional billboards, a key feature is the flexibility to change the content and timing of the advertisements.

Web advertising effectiveness measurement index

Web advertising (digital advertising) is advertising placed on websites, social media, video streaming platforms, etc. It allows for detailed targeting, and user behavior is recorded numerically.Tracking the entire process from ad display → click → purchase.Available

The effectiveness of web advertising is measured at the following three stages of the funnel:

Impressions (awareness and reach)

Traffic (Inflow)

A higher CTR indicates that the ad creative resonated with the target audience. However, it's important to evaluate ad effectiveness not solely based on CTR and CPC, but in combination with other metrics.

Conversion (results)

A high CPA doesn't necessarily mean low advertising effectiveness. If the repeat purchase rate is high or the LTV (Lifetime Value), which will be discussed later, is large, then even with a high CPA, the advertising can be considered effective.

Brand lift survey: A representative method for quantifying psychological effects.

A brand lift study compares a group that was exposed to advertising (exposure group) with a group that was not exposed (non-exposure group/control group).A survey-type measurement method that quantifies how much an advertisement influences "attitudes" such as awareness, favorability, and purchase intent.This method statistically extracts psychological effects that cannot be captured by click counts or conversion rates, defining them as "changes in awareness = lift."

The main metrics that can be measured in a brand lift study are as follows:

There are three main ways to implement this.

① Brand lift function of advertising platform(Google Ads Brand Effectiveness MeasurementMeta, YouTube, etc. (Low cost and easy to link with advertising data)② Panel survey conducted by an external research company(For example, Intage and Macromill. They can design campaigns that include offline measures as well as TV commercials, and have high statistical reliability.)③ Comparison of before and after advertising based on our own surveys(While there is a high degree of freedom in the survey design, designing the control group is difficult.)

It's important to note that brand lift surveys only measure "changes in awareness" and do not prove a direct contribution to sales. By interpreting them in combination with business performance indicators such as ROAS and ROI, or integrated evaluations using MMM (Marketing Mix Modeling), it becomes possible to bridge the gap between psychological effects and sales effects.

Four reasons why measuring advertising effectiveness is considered "difficult"

Simply understanding the metrics is not enough. Understanding why measuring advertising effectiveness is difficult will significantly improve the accuracy of your measurements and the quality of your interpretations.

1. You can’t visualize the effectiveness of offline advertising

Offline advertising, such as TV commercials and newspaper/magazine ads, relies on limited metrics like GRP, making it impossible to precisely measure CTR and CPA like online advertising. This leaves a fundamental problem: "It's difficult to visualize the effectiveness."

This challenge is even more pronounced in OOH (out-of-home advertising and transit advertising). Because there is no industry-standardized viewership data like that for television commercials, it is impossible to properly evaluate the effectiveness of multiple campaigns unless the characteristics of each display area, such as the number of passengers getting on and off trains and the surrounding commercial facilities, are standardized before comparison.

2. The effect continues even after the ad ends

The effects of advertising continue even after it has finished being published or broadcast. Ripple effects, residual effects, and brand accumulation effects are believed to exist in all advertisements, and accurate evaluation is impossible without incorporating these long-term effects into the measurement.

(*) This score was created from statistically processed analytical data (249 cases) held by XICA, and therefore does not apply to all cases.
(**) In this study, "long term" is defined as a period of 3 to 5 years.

3. User touchpoints are becoming more diverse

Online advertising has become increasingly fragmented, encompassing search engines, display ads, social media, video streaming, and e-commerce. This makes it difficult to accurately track which ads customers encounter at which point in the purchasing process and through what channels they ultimately convert.

4. We tend to ignore indirect effects

We tend to only evaluate the "final ad" that contributed to the final conversion. However, we must not overlook the contributions of TV commercials and other advertisements that nurtured user interest before that. Indirect effects are difficult to visualize and are therefore often underestimated, which is a major factor that makes measuring effectiveness difficult.

Metrics for measuring business performance: ROAS, ROI, LTV

We will outline three key metrics for evaluating advertising effectiveness and ultimately linking it to "business results."

ROAS (Return on Advertising Spend)

ROAS (Return on Advertising Spend) isHow much revenue was generated relative to the advertising expenses incurred?This is an indicator that shows:

[ ROAS（%）＝（広告による売上 ÷ 広告費）× 100 ]

A ROAS exceeding 100% does not necessarily mean profitability. This is because it does not take into account expenses such as cost of goods sold and personnel expenses. Also, the figure will change depending on whether you define it as "new sales during the advertising period" or "sales from online inquiries," so it is important to set the appropriate criteria for each company.

ROI (Return on Investment)

ROI (Return on Investment)It is,How much profit was gained from the investment in advertising costs?This is an indicator that shows the rate of return on investment, and is also called the rate of return on investment or investment return rate.

[ ROI（%）＝（広告による売上 － 売上原価）÷ 広告費 × 100 ]

While ROAS is an indicator that measures "sales," ROI is an indicator that measures "profit." Since ROI tends to be low in the initial stages of advertising, it is important to avoid judging solely on short-term figures and to evaluate it based on medium- to long-term trends.

Calculate LTV (Customer Lifetime Value) for each advertisement.

LTV (Life Time Value) isThe cumulative profit that one customer (or company) brings to a company.This is a numerical representation of that.

[ BtoCのLTV ＝ 購入単価 × 購入回数 × 継続期間 ]

[ BtoBのLTV ＝ 年間取引額 × 利益率 × 継続年数 ]

[ サブスクのLTV ＝ 平均継続期間（1÷解約率）× ユーザー平均単価（ARPU） ]

In modern approaches to measuring advertising effectiveness, LTV is used.Calculated "per advertisement"This is important because even with two ads that have the same CTR and CPA, the LTV (Lifetime Value) of customers acquired through each ad often differs. By using LTV as a criterion, it becomes possible to make investment decisions that take into account not only the cost-effectiveness in the short term, but also future profits.

Types of advertising effectiveness measurement tools and how to choose the right one

When choosing an advertising effectiveness measurement tool, you should work backward from "what you want to measure." If you choose based solely on the number of features or the number of successful implementations, you'll end up continuing to operate without being able to measure the effects your company truly wants to know.

The tools can be broadly divided into five categories, each with measurable effects and effects that are inherently difficult to measure. Understanding these categories is the starting point for selection.

Category ①: Access analysis and tag tracking tools

Access analytics and tag tracking tools are a category that visualizes user behavior after they arrive at your website. They allow you to track which traffic sources users come from and which pages they navigate before converting. Many are free to use and serve as a standard starting point for measuring the effectiveness of web advertising.

limitThis only allows you to measure behavior within your own website. It cannot capture the impact of advertising exposure to users who did not reach the site, or the effects of offline measures such as TV commercials and transit advertising. Furthermore, restrictions on third-party cookies have reduced the accuracy of cross-domain user tracking.

Category ②: Advertising management platform (management screen for each media platform)

The management screens provided by each media outlet are the most accurate source of information for understanding delivery performance within that platform. Primary data such as impressions, clicks, conversions, and spending can be obtained without additional cost.

limitEach media outlet reports only the results for its own platform. If you advertise on multiple media outlets, duplicate conversions will occur where the same user is counted across multiple outlets, and simply adding up the conversion counts on each media outlet's management screen will exceed the actual results. In principle, it is not possible to allocate contributions across media outlets at this level.

Category 3: Attribution Analysis Tools / App Ad Effectiveness Measurement Tools

This category comprises tools for allocating contribution across multiple touchpoints leading to a conversion. It allows for the quantification of the role of awareness-stage ads, which are often overlooked in last-click evaluation, which only considers the last clicked ad. For app ads, it tracks in-app behavior after installation.

limit: Routes can only be reconstructed within the range of measurement tags and identifiers. Due to stricter privacy regulations and restrictions on third-party cookies, the coverage area is shrinking. Linking the same person across different devices and incorporating offline touchpoints remains difficult. Also, the rules for distributing contributions (equal distribution, decay distribution, etc.) are chosen by the analyst, and the conclusions will vary depending on the choice.

Category ④: Brand Lift Survey Tools

Brand lift survey tools are a category that quantifies the psychological changes brought about by advertising exposure. They compare groups that were exposed to the advertisement with those that were not, measuring the differences in awareness, favorability, and purchase intent. Major digital advertising platforms offer this functionality for campaigns that meet a certain delivery volume.

limitThis only measures changes in attitude, and cannot show how much those changes contributed to actual sales. Furthermore, because it is survey-based, it is affected by respondent memory and response bias. In the case of platform-provided services, the effects are limited to those within the company's own media, so a comprehensive evaluation including TV commercials and OOH requires separate external research design.

Category 5: MMM (Marketing Mix Modeling)

MMM (Marketing Magazine Modeling) is a method for estimating the sales contribution of each initiative by constructing a statistical model with performance indicators such as sales as the dependent variable and the amount invested in each initiative as the independent variable. Because it uses aggregated data rather than individual tracking, it does not rely on cookies or user identifiers and can evaluate TV commercials, OOH (Out-of-Home) advertising, and web advertising on the same criteria. A key feature is that it provides output that can be directly used for budget allocation decision-making.

limitThe following constraints must be confirmed before implementation.

• The data requirements are heavy.Time-series data for a certain period is required, and it is a prerequisite to have a record of the implementation history of the measures, the amount invested, and external factors (seasonality, competitive trends, price fluctuations, etc.). Accuracy cannot be ensured if the data is not complete.
• The analytical granularity is coarse.This tool is suitable for evaluating strategies at the category or media level, but it cannot be used for daily assessments of individual creatives or keywords. Short-term operational improvements are the domain of other categories.
• Building and updating the system incurs costs.A model isn't something you create once and forget about; it needs to be restructured in response to changes in the market environment and the structure of your strategies. Without factoring in operational costs, it will become a mere formality.
• The hurdles to in-house production are high.Because it requires expertise in statistical modeling, it is easy to rely on external vendors, and if the design does not leave any internal knowledge, the basis for decision-making will be lost when the contract ends.
• Interpreting the results requires prior knowledge.The output is an estimate, and sharing only the numerical values ​​within the company without understanding the confidence intervals or the assumptions of the model can lead to incorrect decision-making.

MMM is not a panacea; it's a method designed to address the specific question of medium- to long-term budget allocation. Implementing it with the goal of improving daily operations will likely lead to disappointment.

For information on how to implement MMM and how to do it properly, please see this article:A Marketer's Guide to Modern MMM

Selection flow: Problem → Data maturity → Budget

When selecting a tool, narrowing down your options in the following order will reduce the likelihood of making a wrong decision: identify the problem → confirm your company's data maturity → budget. If you proceed in the reverse order (searching for a tool based on budget), you may end up completing the implementation without being able to measure the effects you wanted to measure.

STEP 1: Narrow down the problem to one.

Even if multiple conditions apply,First, narrow it down to one.Trying to solve everything at once will result in each category being left unfinished.

STEP 2: Check data maturity

STEP 3: Confirm budget and organizational structure

The more advanced the methodology, the more operational effort becomes dominant over tool costs. When estimating costs, simultaneously confirm whether you can secure personnel to interpret the analysis results and incorporate them into decision-making after implementation. A tool implemented without anyone to interpret the results will simply continue to generate reports without providing any real support.

Understanding Costs: Separately Consider "Contract Type" and "Incentive Structure"

When considering costs, be sure to distinguish between what your company will be paying for (contract type) and how the service provider will generate revenue (incentive structure). Confusing these two can lead to overlooking the fact that the proposed solution is optimized for the service provider's revenue structure rather than addressing your company's challenges.

Particular caution is needed when the same company handles both advertising operations and performance measurement. Because the company evaluates its own operational results, the independence of the evaluation cannot be guaranteed. If this structure is adopted, it is necessary to confirm in advance the scope of disclosure of the evaluation logic.

Six questions to ask during a business negotiation

The accuracy of tool selection depends on what questions you ask during business negotiations. The following are valid points to check regardless of the category. The quality of the answers themselves will serve as a basis for judging the business's attitude.

The third point, "Can the analytical logic be verified?", is particularly important. Analysis that cannot be verified cannot be used as the basis for internal decision-making. When asked to explain the results to management, figures for which the basis of calculation cannot be shown will not be adopted.

Three common mistakes

1. Decide on the tools before addressing the problem.
The implementation becomes the goal itself, and the intended effects are never measured, leaving only the operation to be carried out. Please return to STEP 1 of the selection flow.

2. Introduce higher-level categories without a foundation.
Even if you introduce advanced analytical methods without properly implementing tracking tags or defining conversions, the quality of the input data will determine the upper limit of the output. You cannot skip any steps.

3. Do not assign a person to read the output.
Without a role in translating analysis results into decision-making, the tool becomes nothing more than a report generator. Ensure you have internal readers ready to read the reports at the same time as you decide to implement the tool.

Four practical points to translate advertising effectiveness measurement into results

Measuring effectiveness is meaningless if it only involves collecting data. To use it for marketing decision-making, it is essential to clearly define "what to measure, why, and how to measure it."

1. Set metrics according to the type and purpose of the advertisement.

The metrics to track differ fundamentally between video ads aimed at brand awareness and search ads aimed at purchases. Measuring multiple ads as a single unit makes it difficult to see the contribution of each individual campaign. Setting KPIs for each campaign and measuring and analyzing them individually leads to better decision-making.

2. Evaluate the process with attribution analysis

Many conversions occur after exposure to multiple advertisements. Even if the last clicked ad is the deciding factor, the contributions of the preceding ads that nurtured the user's interest should not be overlooked.

Attribution analysis allows you to visualize the role of each measure in a series of touchpoints. Analysis that focuses only on online advertising tends to overlook the contributions of offline measures such as TV commercials and OOH."Integrated Attribution"Let's consider using it.

3. Regularly repeat the measurement of effectiveness.

Advertising effectiveness fluctuates depending on competitor actions, market changes, and seasonal factors. Even strategies that were successful in the past may become ineffective over time. Regularly measuring effectiveness and adjusting advertising content and channel allocation accordingly is key to sustained results.

·Related article:Three major changes in measuring advertising effectiveness

4. Don't stop at measurement; translate it into improvement actions.

The purpose of measuring advertising effectiveness is to identify "what is working well and what needs improvement" and to derive the next course of action. By continuously implementing the PDCA cycle, you can improve the quality of your advertising operations.

1. Set clear goals(Examples: improve CVR by 10%, increase cognitive lift by 15%)
2. Measure and analyze the effectiveness of each ad
3. Develop and test improvement measures to address the problem.
4. Check the cost-effectiveness again and verify the effectiveness of the improvements

In fact, Toridoll Holdings, which operates Marugame Seimen, is working to create a system that consistently handles everything from setting KPIs and optimizing budget allocation to visualizing advertising effectiveness and verifying cost-effectiveness.Details).

Summary

It's not enough to simply run an advertising campaign; it's crucial to measure its effectiveness and continuously maximize its return on investment.

The essence of measuring advertising effectiveness lies in correctly understanding the different metrics used for each medium, grasping the true nature of the "difficulty" of measurement, and then implementing a practical cycle that leads to results.

By combining web analytics, attribution, brand lift surveys, and MMM (Marketing Management Model) according to their respective purposes, measurement tools enable a more comprehensive evaluation.

·Related article:The four pillars of measuring the effectiveness of marketing investments: tracking, experimentation, research, and modeling.

By correctly understanding the reasons why measuring advertising effectiveness is said to be difficult—such as the invisibility of offline effects, their persistence, the diversification of touchpoints, and the neglect of indirect effects—and adopting an integrated approach, measurement accuracy can be significantly improved.

In an increasingly complex advertising environment, XICA uses the power of data science to support companies struggling with the challenge of "measuring the advertising effectiveness of their entire marketing activities and maximizing their ROI."

Frequently Asked Questions (FAQ) about measuring advertising effectiveness

Q1. When should we start measuring the effectiveness of our advertising?

Ideally, advertising effectiveness measurement should be prepared before the campaign even launches. Before launching, you need to define KPIs and record baseline figures such as website traffic, brand awareness, and sales. Without this, it's impossible to distinguish whether changes in figures after launch are due to the advertising or simply the original levels.

Q2. Is it possible to measure advertising effectiveness even with a small budget?

Yes, you can. GA4 (Google Analytics 4) and the management screens of each advertising platform are free to use, and for web advertising, basic metrics such as clicks, conversion rates (CVR), and cost per acquisition (CPA) can be measured immediately. While brand lift surveys and the use of external research companies incur certain costs, the priority is to first establish a habit of measurement using free tools. Regardless of budget size, the basic approach of "setting goals and comparing results before and after advertising" remains the same.

Q3. Can the effectiveness of TV commercials be compared using the same criteria as web advertisements?

This is difficult with conventional measurement tools. Television commercials measure exposure effectiveness using GRP and GAP, while web advertising measures behavioral effectiveness using CTR and CVR, so the types of metrics are fundamentally different. To evaluate both side-by-side using a common criterion of "contribution to sales," it is effective to use MMM (Marketing Mix Modeling). By using MMM, the sales contribution of all measures, regardless of whether they are offline or online, can be compared using a unified metric, and this can be used to optimize budget allocation.

Q4. If the conversion rate (CVR) and return on advertising spend (ROAS) are high, can we say that the advertising was effective?

That's not always the case. While CVR and ROAS are metrics that measure behavioral and sales effects, advertising effectiveness also includes exposure effects (reach) and psychological effects (changes in awareness and favorability). For example, if you evaluate TV commercials or social media video ads aimed at gaining awareness using CVR, there is a risk of misjudging them as "ineffective" because the objective and the metric are mismatched. Using metrics that are appropriate to the advertising objective is a prerequisite for correct evaluation.

Q5. Can anyone conduct a brand lift survey?

Advertising platforms like Google and Meta offer free brand lift surveys for campaigns that meet a certain delivery volume (number of impressions). Therefore, it is relatively easy for companies that operate digital advertising on a certain scale to conduct these surveys. On the other hand, for integrated surveys that include offline measures such as TV commercials and OOH, it is necessary to commission an external research company.

Q6. How will advertising effectiveness measurement change in a cookie-less environment?

Attribution analysis (MTA/Multi-Touch Attribution, which falls under category ③ above) and some retargeting measurements that heavily rely on third-party cookies will inevitably suffer from reduced accuracy. On the other hand, MMM (Marketing Mix Modeling), which uses aggregated data,Cookie-independentTherefore, the effectiveness of all channels can be evaluated without being affected even in a cookie-less environment. The same applies to brand lift surveys, as they are also survey-based. In the future, it is expected that there will be a shift from "individual tracking" to "aggregate and statistical" measurement methods.

Q7. How often should advertising effectiveness be measured?

For digital advertising, daily and weekly monitoring is standard practice. However, overreacting to short-term fluctuations in numbers and drastically changing strategies can make it impossible to verify their effectiveness. Strategic decisions (such as reviewing budget allocation or changing channels) should be made on a monthly or quarterly basis, while daily and weekly monitoring should be limited to detecting anomalies and making small improvements. Strategies that yield results over the medium to long term, such as TV commercials and OOH (out-of-home) advertising, require evaluation over a longer period.

Author information

XICA Co., Ltd. Marketing Team