How to Evaluate a Short-Video Agency's Performance: A Practical KPI Framework
Bottom line: don't evaluate an agency partnership using vanity metrics like view count or follower count alone. Set different core metrics based on what stage the account is in — content approval rate and account weight during cold start, completion rate and follower growth efficiency during scaling, and conversion rate and acquisition cost once mature. Applying one fixed set of metrics across every stage is the most common evaluation mistake.
Why "Just Looking at Views" Leads to the Wrong Conclusion
A high view count doesn't mean an account is healthy, or that the business is genuinely growing. A single video can go viral by chance from hitting the platform's traffic algorithm, but if completion rate, engagement rate, and conversion path haven't kept pace, that kind of surface-level success is hard to sustain and doesn't say much about whether the agency's methodology is repeatable. Conversely, an account with modest view counts that reaches its target audience precisely and converts consistently can carry far more real business value than a higher-view account with an imprecise audience.
The first step in evaluating agency performance is identifying what stage the account is currently in, then choosing the right metrics for that stage — not applying one standard from start to finish.
A Stage-Based KPI Framework
Cold start (account just launched, typically months 0-3)
The core goal at this stage is earning the platform's initial trust. Key metrics:
- Content approval rate / throttling incidents — frequent throttling signals a problem with account weight or content compliance;
- Basic account weight indicators (whether the platform has flagged the account as low-quality, whether category focus is clear);
- Breadth of content testing — cold start should involve testing different topic directions, not narrowing prematurely to a single content type.
We don't recommend over-focusing on absolute view or follower numbers at this stage — validating account weight and content direction matters more than short-term figures.
Scaling (account has passed cold start, typically months 3-9)
The core goal shifts to scaled growth. Key metrics:
- Completion rate — the core indicator of whether content quality and pacing are working;
- Follower growth efficiency (new followers per piece of content published, not just total follower count);
- Engagement rate (comments, shares, saves), especially whether the comments section shows genuine audience discussion rather than just likes.
The key question at this stage is whether growth is stable and sustainable — not whether a viral video occasionally shows up. An account that only performs when one video happens to hit big hasn't yet built a repeatable content methodology.
Maturity (account has a stable follower base, entering monetization)
The core goal shifts to conversion and business value. Key metrics:
- Conversion rate (actual orders from traffic driven to a DTC site or TikTok Shop);
- Customer acquisition cost (calculated holistically across content investment and ad spend, per new customer acquired);
- Return-visit / repeat-purchase indicators — whether the traffic an account drives is one-time or accumulates into customers with lasting value.
If an agency at this stage still emphasizes views and follower count while avoiding conversion and acquisition cost data, it usually signals that business-level output hasn't kept pace.
Two More Things to Look For When Evaluating an Agency
Whether a review cadence exists: a responsible agency should have a consistent data review rhythm and be able to clearly explain "what performed well last week/month, why, and how we're adjusting" — not just deliver content and dashboards with no analysis or strategic iteration.
Whether there's a repeatable methodology, rather than reliance on occasional hits: if account growth depends heavily on one or two lucky viral videos, growth likely won't hold up once the partnership ends. A more trustworthy agency should be able to clearly articulate which topic types and script structures reliably perform — meaning the growth logic is repeatable and sustainable.
Frequently Asked Questions
How long before you can tell if an agency partnership is working? Cold start typically needs at least 1-2 months before meaningful data accumulates — judging too early (concluding after two weeks, for example) risks a misleading read. We recommend observing at least one full cold-start cycle before evaluating.
If views and followers are both growing but there are no actual orders, what does that indicate? It likely means the account is reaching broad but imprecise traffic rather than the target audience, or there's a break in the conversion path (driving traffic to the DTC site or shop). Worth specifically checking whether the audience the content reaches matches the target customer profile, and whether the path from content to conversion is smooth.
Final Thoughts
The key to evaluating agency performance is matching metrics to the account's actual stage, not applying one fixed standard throughout. If you're evaluating an existing agency partnership, or want to know how to set reasonable stage-based KPIs for your account, reach out to Dameng Global — we can offer specific evaluation guidance based on your account's current status.