What is advertising effectiveness measurement? A thorough explanation of metrics, methods, and tools for each purpose and medium, along with four key points for achieving results.

"Advertising effectiveness measurement" is essential to correctly understand the results of advertising and use them in your next move. How much of the budget you invested in advertising has been effective? By clarifying the causal relationship, you can increase the repeatability of successful measures and accurately identify areas that need improvement.

Especially in today's world where various channels are mixed together, such as mass advertising such as TV commercials and transportation advertising, web advertising, and social media promotions, if the method of measuring effectiveness is incorrect, the risk of making incorrect decisions and not being able to optimize investment allocation increases.

This article will first organize the three areas of advertising effectiveness (contact, psychology, and sales) and measurement indicators for each medium (mass advertising, OOH, web, and social media), and then explain brand lift surveys as a method for quantifying psychological effects, cost-effectiveness indicators such as ROAS, LTV, and ROI, how to choose tools to support effectiveness measurement, and four key points for achieving results in practice.

Free download of case study

Gain knowledge of "statistics" and accelerate your marketing
- Introducing the basics and "MMM," ​​a statistical analysis method that has recently been gaining attention again -

Download Now

What is advertising effectiveness measurement?

Advertising effectiveness measurement is the process of visualizing and evaluating the extent to which advertising measures are successful using numbers and indicators. In order to achieve maximum results within a limited advertising budget, it is essential to verify based on objective data, rather than relying on intuition or experience.

Three areas of advertising effectiveness: contact, psychology, and sales.

The effectiveness of advertising is multifaceted and cannot be measured simply by whether it led to sales. Understanding the effectiveness from the following three perspectives makes it easier to determine the intrinsic value of advertising measures.

① Contact effect(Reach/Visibility)

It is an index that shows how many people an advertisement reached and was viewed. For television commercials, this would be GRP or reach rate, and for web advertisements, this would be impressions or viewability.

② psychological effect(Attitude and perception changes)

It measures how the viewer's awareness, interest, favorability, etc. have changed as a result of exposure to an advertisement, including changes in brand recall, ad recognition, and purchasing intent.

③ Sales effect(Actions and Results)

It evaluates how much advertising actually induces actions such as purchases and applications, and is visualized using indicators such as CPO (cost per acquisition) and ROAS (return on advertising spend).

Basic concepts and steps for measuring advertising effectiveness

The basis of advertising effectiveness measurement is "relative evaluation." You set clear goals in advance about what you want to achieve through advertising, and measure the effectiveness by comparing the changes in numbers before and after advertising.

The important thing is not to be satisfied with just "the numbers have improved," but to focus on "whether or not we achieved our goals." To do this, it is necessary to make the conditions such as period, target users, and channels as consistent as possible when comparing before and after advertising.

In addition, the effectiveness of advertising is not determined solely by your company, but is also affected by trends in the overall market and competition. For example, if demand is declining across the industry, this will also affect advertising performance. In order to correctly interpret the measurement results, it is essential to organize assumptions based on the external environment.

Furthermore, the indicators you should use will vary depending on the type and purpose of the ad. Next, we will explain the characteristics of mass advertising and web advertising, as well as the main indicators for measuring effectiveness.

TV commercials, newspapers, radio, OOH: Effectiveness measurement indicators for mass advertising and outdoor advertising.

Mass advertising is used when you want to deliver information to a wider audience. It is easily recognizable to a wide range of generations and can reach many people in a short amount of time.

Here we will explain the effectiveness measurement indicators for mass advertising.

Characteristics and types of mass advertising

Mass advertising is an advertising method that delivers information to an unspecified number of people at once, such as television commercials, newspaper ads, magazine ads, radio commercials, etc. It has a wide reach and is suitable for raising awareness among many people in a short period of time.

In addition to promoting products and services, it is also expected to have an effect on corporate branding and improving image. However, due to its broad appeal, it is difficult to quantitatively grasp the effects.

For example, even if viewership ratings are high, it doesn't necessarily mean that viewers actually saw the advertisement. Also, the impression left by an advertisement can influence purchasing behavior with a time lag, so short-term measurements may not fully capture its effectiveness.

In recent years, Out-of-Home (OOH) advertising, such as transit advertising in train stations and on trains, outdoor billboards, and digital signage, has also been attracting attention as a target for evaluating these offline measures. Like television and newspapers, OOH advertising does not allow for the direct acquisition of click and conversion data, making measurement difficult—a challenge common to all mass advertising.

Mass advertising effectiveness measurement indicators

The typical advertising effectiveness measurement indicators used in each media are as follows.

GRP, used to measure the effectiveness of television commercials, stands for "total viewer rating" and GAP stands for "total number of gazes."

GRP is the total household viewer rating for each minute of a commercial, and indicates how well the commercial is reaching the viewer. For example, the GRP for two commercials aired during a time slot with a 15% household viewer rating per minute is as follows:

15% x 2 = 30GRP

This number is used as an indicator when deciding what time and how often to run advertisements.

However, GRP alone does not tell us whether the viewer was actually watching the commercial. Therefore, GAP is measured using a sensor camera, including who is watching the screen and how long. GAP is measured in units of every second, so for example, if a viewer stares at the screen for 5 seconds, it will be 5GAP.

By measuring GAP along with GRP, the facial recognition function of the sensor camera can be used to confirm whether the target audience of the commercial was actually watching it.

CPR and CPO, which are used to measure the advertising effectiveness of newspaper advertisements, calculate the cost of advertising effectiveness.

CPR is calculated as "cost ÷ number of responses" and is the unit price per response (application or inquiry). CPO is calculated as "cost ÷ number of orders" and represents the unit price per order. For example, if the advertising cost was 1 yen and the number of orders was 1, the CPO would be as follows:

10 yen ÷ 20 = 5,000 yen

Like television, radio uses GRP as an advertising metric. However, while television measures viewer ratings at the household level, radio measures at the individual level, known as "listener ratings."

In measuring the effectiveness of OOH and transit advertising, direct behavioral data such as clicks and viewership ratings cannot be obtained, so a combination of contact estimation and attitude change surveys is the basic approach. A representative metric is OTS, which estimates the number of people who may have seen the advertisement. It is calculated based on pedestrian traffic and passenger traffic data at the advertising location and is used to understand the scale of reach.

To measure psychological effects, brand lift surveys comparing awareness and purchase intent in areas where advertisements are displayed versus areas where they are not are effective. Furthermore, by incorporating QR codes or dedicated URLs into creative materials, it's possible to measure the number of visitors driven from OOH (Out-of-Home) advertising to the web. Combining these methods allows for a more accurate evaluation of the effectiveness of OOH advertising, which has traditionally been difficult to quantify.

How to measure and interpret the effectiveness metrics of web and social media advertising.

Web advertising is an advertisement that is easy to be recognized by a specific target. Here, we will explain the advertising effectiveness measurement index for web advertising.

Characteristics and types of web advertising

Web advertising (digital advertising) is advertising placed on websites, social media, YouTube, email newsletters, etc., and allows for detailed targeting. Advertisements can be delivered to specific users based on data such as age, gender, and interests, and can be operated at a relatively low cost.

Another feature is that it is easy to visualize the effectiveness of advertising. Because web advertising records user behavior as numerical values, the entire process, from displaying an ad → clicking → purchasing, can be tracked.

However, because there are a wide variety of measurement indicators, it requires the ability to select appropriate indicators according to purpose and interpret them correctly.

Web advertising effectiveness measurement index

The effectiveness of web advertising is measured in three stages:

• Impressions:How many times the ad was displayed
• traffic:How many people were led from the ad to the desired website?
• conversion:How many people purchased products or services on the website they were directed to

The type of web advertising used varies depending on the situation and purpose, and measurement using different indicators is required for each advertising effect to be targeted. The main effectiveness measurement indicators for web advertising are as follows:

Impressions: A metric used to measure the reach of an advertisement (Imp, CPM, Reach)

The difference between Imp and Reach is that Imp is the number of times an ad was displayed on the web, while Reach measures how many people saw it. For example, if a person moves from site A to site B and the same ad is displayed on both sites, Imp is 2 and Reach is 1.

Advertisements that target impressions include "banner ads (pure ads)" that are displayed fixedly or in rotation in ad slots on websites, etc. If you display them on sites with a high number of views, you can reach a wider range of users.

Traffic: Metrics used to measure clicks and website traffic (CTR, CPC, number of clicks)

An example of an ad that targets traffic is a listing ad (search-linked ad) that is displayed to users who search for a specific keyword. For example, by targeting keywords such as "housework time saving," you can approach a relatively narrowed-down user demographic, such as people who are looking for ways to save time or people who are interested in time-saving items.

Conversion: Metrics directly related to results (CVR, CPA)

If you want to increase conversions, place ads that can reach users who are more likely to purchase. For example, even with listing ads, it is a good idea to use keywords that people who are specifically considering a purchase would search for, such as "compact dishwasher, latest," rather than "saving time on housework."

The main goal of advertising is conversion. To increase conversions, you first need to increase impressions and then optimize your ad content to increase traffic. It is then important to measure and verify the cost per conversion and aim for cost-effective advertising.

Metrics for measuring the effectiveness of social media advertising

Social media advertising (X, Instagram, Facebook, TikTok, LINE, etc.) uses metrics common to web advertising (impressions, CTR, CVR, etc.), but it is essential to evaluate them using metrics specific to each social media platform. This is because social media users' behavior is more about "discovering content on their timelines" rather than "searching and visiting," so their primary role is often to cultivate awareness, interest, and empathy rather than directly stimulating purchase intent.

Since social media advertising often contributes more to long-term brand building than to short-term conversions, using only CVR and CPA as performance indicators can easily lead to underestimating the effectiveness of the campaign. It is important to evaluate other metrics that show attitude change, such as engagement rate and brand lift, in addition to social media advertising.

Brand lift survey: A method for quantifying psychological effects.

The brand lift survey mentioned above in the evaluation of SNS ads and OOH ads is a method that uses questionnaires to measure the difference in attitudes between a group that was exposed to the ad (exposed group) and a group that was not exposed (unexposed group), and calculates the pure effect of the attitude change brought about by the ad.

Its greatest feature is its ability to quantify "how people felt and how their perceptions changed after seeing the ad," which cannot be captured by click counts or conversion rates.

Main measurement items

Brand lift studies are particularly effective in evaluating strategies that do not directly generate clicks or conversions, such as TV commercials, out-of-home (OOH) advertising, and social media video ads. Judging these strategies solely on CVR (conversion rate) or ROAS (return on advertising spend) carries the risk of misjudging them as "ineffective," but combining them with brand lift studies allows for a more accurate assessment of the true contribution of these strategies.

Advertising platforms like Google and Meta offer brand lift survey features for campaigns that meet a certain delivery volume. For more accurate measurements and integrated research that includes offline measures, you can also utilize external research companies.

Once you've grasped the changes in psychological effects through a brand lift survey, the next thing to check is "how much of that advertising investment is ultimately being recovered in terms of sales." Below, we'll explain ROAS, LTV, and ROI, which are key indicators for judging cost-effectiveness.

Key metrics for measuring cost-effectiveness: ROAS, LTV, ROI

Analyzing cost-effectiveness is essential when placing advertisements. Here, we will explain the meaning and usage of "ROAS," "LTV," and "ROI," which are representative indicators of advertising effectiveness, in an easy-to-understand manner.

ROAS (Return on Advertising Spend): Calculation and Interpretation of the Sales Recovery Rate

ROAS (Return on Advertising Spend) is an indicator that shows how much sales were generated for the advertising costs invested. It is calculated using the following formula:

ROAS = (revenue from advertising ÷ advertising costs) x 100%

Advertising revenue can be roughly estimated using the formula: "Average price of product/service × Number of conversions." Therefore, ROAS can be calculated relatively easily.

For example, if your ROAS is 150%, it means that you are earning 1 yen in sales from 1.5 yen of advertising expenses. However,ROAS is merely an indicator of "sales" and does not reflect profits.It is important to note that because costs of sales, labor costs, and operational costs are not taken into account, even if the ROAS is over 100%, it does not necessarily mean that the business is in the black.

*Difference from ROI: ROI is an indicator of "profit," while ROAS is an indicator of "sales."

LTV (Customer Lifetime Value): A criterion for long-term advertising investment decisions.

LTV (Life Time Value) is an indicator that represents the cumulative profit a single customer brings to a company. For example, the LTV of a customer who has continued a monthly subscription of 1 yen for 1,000 months is:1,000 yen x 24 months = 24,000 yen.

The general formula is as follows:

LTV = average purchase price x purchase frequency x duration of continued purchase

When calculating the upper limit of advertising costs based on LTV,LTV × gross profit marginIf you estimate based on the gross profit of a single item, advertising expenses tend to be too low, but if you base it on LTV, you can make strategic investment decisions that take future profits into account.

Utilizing LTV makes it easier to determine whether your current advertising expenses are too low or too high, which can also lead to a long-term customer acquisition strategy.

ROI (Return on Investment): Measuring the true value of advertising in terms of profit.

ROI (Return on Investment) is an indicator that shows how much profit you have made from your investment in advertising. Advertising ROI is calculated using the following formula:

ROI = (Revenue from advertising – Cost of sales) ÷ Advertising expenses x 100%

For example, if your advertising expenses are 10 yen, your sales are 20 yen, and your cost of sales is 12 yen, your ROI will be 80% (= (20 - 12) ÷ 10 x 100%).

By using ROI, you can specifically determine whether or not an advertising campaign has generated profits.ROI is likely to be low in the early stages of advertisingTherefore, it is important to avoid judging ROI based solely on short-term figures. It is important to track ROI trends from a medium- to long-term perspective and continually evaluate it.

For more information about ROI, see the related article "Key metrics to maximize your marketing ROI (MROI)."

Free download of case study

In this rapidly changing era, how can you optimize your advertising investment to maximize business results?

The environment surrounding marketing is changing dramatically these days. We will introduce "MMM", a method of optimizing advertising investment to maximize business results even in situations where past experience and common sense no longer apply.

Download Now

Four key points to translate advertising effectiveness measurement into results

Measuring advertising effectiveness is not just about collecting data. To make use of it in marketing decision-making, it is essential to clarify "what to measure, for what purpose, and how." Here are four perspectives to make effective effectiveness measurement.

1. Measure according to ad type and objective

If you measure multiple ads together, it becomes difficult to see how much each measure contributed. For example, the metrics you should look at for video ads aimed at gaining awareness and for listing ads aimed at purchases are different in the first place.

Setting KPIs for each campaign and measuring and analyzing the results of each campaign individually will lead to correct decisions. Be sure to look at data appropriate to your purpose, such as the number of contacts and engagement rate, rather than just the number of conversions.

2. Evaluate the process with attribution analysis

Many conversions are the result of contact with multiple ads. Even if the last ad clicked was decisive, the contribution of the ads that nurtured the user's interest in the previous stages cannot be overlooked.

Attribution analysis makes it possible to visualize the role of each measure in this series of contact paths. It is particularly important to properly evaluate "advertising that did not directly lead to sales but encouraged purchases."

Consider using "integrated attribution," which also includes offline measures such as TV commercials and OOH, which are often overlooked in "online attribution," which only targets online advertising.

For more information on the importance of attribution analysis and specific methods, please see the following explanatory article.

What is attribution analysis? A simple explanation of the overview, typical analysis models, and analysis methods

3. Don’t just measure results once

Advertising effectiveness fluctuates daily depending on competitors' movements, market changes, and seasonal factors. Even measures that were successful at one time may become ineffective over time.

Regularly measuring effectiveness and responding to changing trends is the key to keeping your marketing fresh. By watching the changes in the numbers and adjusting the content of your ads and channel allocation accordingly, you can achieve sustainable results.

4. Don't just measure, take action to improve

The purpose of measuring advertising effectiveness is to clarify "what is working well and what needs improvement" and derive the next action. It is important to go beyond just looking at the numbers and then plan and implement improvement measures, then measure the effectiveness again - this cycle should be repeated.

The basic flow is as follows:

1. Set clear goals(Example: Improve CVR by 10%, increase awareness lift by 15%, etc.)
2. Measure and analyze the effectiveness of each ad
3. Develop and test solutions to problems
4. Check the cost-effectiveness again and verify the effectiveness of the improvements

By implementing the PDCA cycle in this way, you can continuously improve the quality of your advertising operations.

How to choose tools to support advertising effectiveness measurement

To continuously measure the effectiveness of advertising, it is essential to have tools that allow for centralized data management and decision-making regarding strategies. Here, we will organize tools according to their purpose and use.

Website and advertising traffic analysis: GA4 (Google Analytics 4)

Google Analytics 4 (GA4) is a free tool that tracks website and app access data on an event basis. It allows you to see in detail what actions users who arrived from ads took on your site and whether they ultimately converted. Integration with Google Ads enables performance analysis at the campaign, ad group, and keyword levels.

However, it's important to note that GA4 can only measure online behavioral data. Analyzing the impact of offline measures such as TV commercials and transit advertising requires combining it with other methods.

Management screens for each advertising platform

Each platform, including Google Ads, Meta Ads Manager, and X Ads management screen, offers its own unique performance measurement features. You can view real-time data such as impressions, clicks, and conversion rates, and use this information to make daily and weekly tactical improvements, such as optimizing bids and adjusting budgets.

On the other hand, since data from multiple platforms is scattered across each management screen, a separate data integration process is required to grasp the overall picture.

Data integration across multiple sources: BI tools and dashboards

By utilizing BI tools such as Google Looker Studio and Tableau, you can consolidate multiple data sources, including GA4, various advertising platforms, and CRMs, onto a single screen. This is ideal for gaining a real-time overview of the overall picture necessary for decision-making, such as comparing ROAS and CPA across different media and visualizing trends over time.

Integrated offline and online analysis: MMM (Marketing Mix Modeling)

The tools mentioned above are primarily used for measuring digital initiatives. To evaluate the sales contribution of all channels, including offline initiatives such as TV commercials, newspaper ads, and OOH advertising, using a unified metric, and to optimize budget allocation,MMM (Marketing Mix Modeling)It is effective to utilize this.

Each tool has its strengths and weaknesses, and it's not realistic to cover all aspects of advertising effectiveness measurement with a single tool. The standard approach in practice is to use digital tools for short-term tactical improvements and MMM (Marketing Management) for medium- to long-term budget allocation decisions.

And for practical use of MMM, we recommend the one offered by XICA.Integrated marketing analysis service "MAGELLAN".

MAGELLAN comprehensively analyzes multiple factors that affect sales (TV commercials, web ads, SNS measures, seasonal fluctuations, etc.), and can evaluate how each measure contributes to sales with a single standard. For example, a major feature is that measures with different objectives, such as "cognitive effect," "psychological effect," and "sales effect," can be compared and optimized in parallel based on the final result (sales, number of purchases, etc.).

MAGELLAN is a service that not only provides analysis, but also suggests improvements based on the results. In advertising effectiveness measurement, which requires continuous measurement and improvement, highly specialized analysis and complex data processing that are difficult to perform with in-house resources alone can be efficiently carried out with the help of tools and support systems.

For marketing departments aiming to maximize cost-effectiveness, MMM is not just a reporting tool, but a decision-making support tool that guides you on "what to do next." If you want to optimize your overall marketing investments, please consider using MMM.

Summary: Understand the basics of measuring advertising effectiveness and take the next steps.

There are different metrics and methods for measuring advertising effectiveness depending on the type of media. Mass advertising such as TV commercials, newspapers, and OOH measures contact effectiveness based on GRP and OTS, while web and social media advertising tracks behavioral data using CTR, CVR, and engagement rates. Brand lift surveys are effective for capturing changes in psychological effects that cannot be captured by clicks or conversions. By interpreting these measurement results from the perspective of cost-effectiveness (ROAS, LTV, ROI) and continuously managing them with appropriate tools such as GA4, BI tools, and MMM, the accuracy of advertising investment decisions can be greatly improved.

The key is not to stop at a single measurement, but to continuously run an improvement cycle as an organization. Aim for advertising operations that lead to results by properly collecting and utilizing data.

Frequently Asked Questions: Measuring the Effectiveness of Advertisements

Q1. When should we start measuring the effectiveness of our advertising?

Ideally, you should start preparing before you even launch your ads. Recording baseline metrics (such as website traffic, brand awareness, and sales) before launching your ads allows for comparison with post-launch data. If you wait until after launch to measure, you'll lack a basis for comparison and won't be able to accurately evaluate your campaign. It's also crucial to complete the setting of key performance indicators (KPIs) before launching your ads.

Q2. Is it possible to measure advertising effectiveness even with a small budget?

Yes, you can. GA4 (Google Analytics 4) and the management screens of each advertising platform are free to use, and for web advertising, basic metrics such as clicks, conversion rates (CVR), and cost per acquisition (CPA) can be measured immediately. While brand lift surveys and the use of external research companies incur certain costs, the priority is to first establish a habit of measurement using free tools. Regardless of budget size, the basic approach of "setting goals and comparing results before and after advertising" remains the same.

Q3. Can the effectiveness of TV commercials be compared using the same criteria as web advertisements?

This is difficult with conventional measurement tools. Television commercials measure exposure effectiveness using GRP and GAP, while web advertising measures behavioral effectiveness using CTR and CVR, so the types of metrics are fundamentally different. To evaluate both side-by-side using a common criterion of "contribution to sales," it is effective to use MMM (Marketing Mix Modeling). By using MMM, the sales contribution of all measures, regardless of whether they are offline or online, can be compared using a unified metric, and this can be used to optimize budget allocation.

Q4. If the conversion rate (CVR) and return on advertising spend (ROAS) are high, can we say that the advertising was effective?

That's not always the case. While CVR and ROAS are metrics that measure behavioral and sales effects, advertising effectiveness also includes exposure effects (reach) and psychological effects (changes in awareness and favorability). For example, if you evaluate TV commercials or social media video ads aimed at gaining awareness using CVR, there is a risk of misjudging them as "ineffective" because the objective and the metric are mismatched. Using metrics that are appropriate to the advertising objective is a prerequisite for correct evaluation.

Q5. Can anyone conduct a brand lift survey?

Advertising platforms like Google and Meta offer free brand lift surveys for campaigns that meet a certain delivery volume (number of impressions). Therefore, it is relatively easy for companies that operate digital advertising on a certain scale to conduct these surveys. On the other hand, for integrated surveys that include offline measures such as TV commercials and OOH, it is necessary to commission an external research company.

Q6. How will advertising effectiveness measurement change in a cookie-less environment?

Multi-touch attribution (MTA) and some retargeting measurement methods, which heavily rely on third-party cookies, will inevitably see a decrease in accuracy. On the other hand, marketing mix modeling (MMM), which uses aggregated data, does not rely on cookies and can evaluate the effectiveness of all channels without being affected by a cookie-less environment. Brand lift surveys are also survey-based and therefore fall into the same category. It is expected that there will be a shift from "individual tracking" to "aggregate and statistical" measurement methods in the future.

Q7. How often should advertising effectiveness be measured?

For digital advertising, daily and weekly monitoring is standard practice. However, overreacting to short-term fluctuations in numbers and drastically changing strategies can make it impossible to verify their effectiveness. Strategic decisions (such as reviewing budget allocation or changing channels) should be made on a monthly or quarterly basis, while daily and weekly monitoring should be limited to detecting anomalies and making small improvements. Strategies that yield results over the medium to long term, such as TV commercials and OOH (out-of-home) advertising, require evaluation over a longer period.

Author information

XICA Co., Ltd. Marketing Team