Vanity Metrics

Technical Explanation

Vanity metrics are numbers that look impressive but don't correlate with business outcomes or drive actionable decisions. They feel good to report but provide no guidance on what to do next.

Characteristics of Vanity Metrics

Trait	Description
Easy to inflate	Can be gamed without real value
No clear action threshold	No "too high" or "too low"
Lagging indicators	Measure past, don't predict future
Not customer-focused	Track company, not customer value

Red Flags

• "Total users ever registered"
• "Page views / impressions"
• "Followers / likes"
• "App downloads"
• "Hours spent on platform" (when not tied to outcomes)

---

Code Examples

Using the CatCafe dataset:

-- VANITY METRIC: Total registrations (easy to inflate)
SELECT
    COUNT(*) as total_registrations  -- Vanity: everyone counts, even if churned
FROM customers;

-- ACTIONABLE: Active customers (actually engaged)
SELECT
    COUNT(DISTINCT customer_id) as active_30d  -- Real engagement
FROM orders
WHERE order_date >= CURRENT_DATE - INTERVAL '30 days';

-- VANITY: Total page views
SELECT
    SUM(page_views) as total_page_views  -- Vanity: 1M views but $0 revenue?
FROM daily_stats;

-- ACTIONABLE: Conversion rate from views to purchase
SELECT
    COUNT(DISTINCT user_id) FILTER (WHERE event = 'purchase') * 100.0
        / NULLIF(COUNT(DISTINCT user_id) FILTER (WHERE event = 'page_view'), 0)
    as conversion_rate  -- Actionable: tells you if traffic is valuable
FROM events;

-- VANITY: Total followers on social
SELECT
    follower_count  -- Vanity: but do followers buy?
FROM social_metrics;

-- ACTIONABLE: Followers who became customers
SELECT
    COUNT(DISTINCT c.id) as customers_from_social
FROM customers c
JOIN social_followers sf ON c.email = sf.email  -- Connected to revenue
WHERE sf.follow_date >= CURRENT_DATE - INTERVAL '90 days';

-- VANITY: App downloads
SELECT
    SUM(downloads) as total_downloads  -- Vanity: many never open again
FROM app_metrics;

-- ACTIONABLE: Day 7 retention from downloads
WITH app_users AS (
    SELECT
        user_id,
        MIN(event_date) as install_date
    FROM app_events
    WHERE event_type = 'app_open'
    GROUP BY user_id
),
retention AS (
    SELECT
        au.user_id,
        CASE WHEN MAX(e.event_date) >= au.install_date + INTERVAL '7 days'
            THEN 1 ELSE 0 END as retained_d7
    FROM app_users au
    LEFT JOIN app_events e ON au.user_id = e.user_id AND e.event_type = 'app_open'
    GROUP BY au.user_id
)
SELECT
    COUNT(*) as total_installs,
    SUM(retained_d7) as d7_retained,
    SUM(retained_d7) * 100.0 / COUNT(*) as d7_retention_rate
FROM retention;

---

The Cat Analogy

Think of vanity metrics like cat show ribbons:

Vanity: "Whiskers touched 500 people at the cat show!"

• Sounds impressive
• But: Were they potential adopters? Did any buy?
• No threshold for "good" — 500 is neither good nor bad

Actionable: "Whiskers was pet by 50 people, 10 asked about adoption, 3 scheduled visits, 1 completed adoption"

• Clear funnel: pet → interest → visit → conversion
• Each step is measurable
• Know exactly where to improve

Why vanity metrics exist: They're easy to count and make reports look good. But they don't help you decide what to do next.

---

Questions to Test for Vanity

-- Test 1: "So what?"
-- If metric goes up 10%, what specifically would you do differently?
-- If it goes down 10%, what would you change?

-- Test 2: Can you tie it to revenue?
-- Total signups → How many become paying customers?
-- Total page views → How many convert?

-- Test 3: Is there a target?
-- "5000 followers" — is that good?
-- "5% conversion rate" — industry standard is 2%, so 5% is good

---

Exercises

Exercise 1

For each metric, identify if it's vanity or actionable:

• Total email subscribers
• Email open rate
• Total revenue
• Number of cats available
• Average time on site

Exercise 2

Write a query to transform a vanity metric ("total signups") into an actionable metric.

Exercise 3

Why might a marketing team prefer vanity metrics over actionable ones?

Exercise 4

Write a query that shows the conversion path from vanity metric to actionable metric.

Exercise 5

What is the most dangerous vanity metric in your current business?

---

Key Takeaways

• Vanity metrics look good but don't drive decisions
• Actionable metrics have clear "so what?" — if X changes, we do Y
• Test: Can you tie it to revenue? Is there a target? Does it predict outcomes?
• Vanity metrics often measure activity, not value
• Always ask: "If this metric changes, what would I do differently?"