Team Building

Agency performance reviews: Rubrics, calibration and pay

Run agency performance reviews with role-specific rubrics for creatives, strategists, AMs, producers and engineers, plus calibration and raise tables.

Bilal Azhar
Bilal Azhar
Updated
14 min read
#performance reviews#team building#agency operations#manager training#feedback

Agency performance reviews fail in a specific way. The annual review form asks generic questions ("met expectations / exceeded expectations") that flatten the difference between a strategist who landed a major renewal, a designer whose work won an industry award, an account manager who saved a churning client, and a producer who shipped every project on time. All four might score "exceeds expectations" on the same form, and none of them gets a useful conversation.

The fix is structural: role-specific rubrics, separate measures for utilization and outcomes, calibration sessions across managers, and ratings tied to documented raise ranges. This guide is a practical framework for performance reviews in agency teams, with rubrics for creatives, strategists, account managers, producers, and engineers.

Key Takeaways:

  • Generic review forms do not work; agencies need role-specific rubrics for creatives, strategists, account managers, and producers.
  • Utilization-based and outcome-based reviews answer different questions; use both, not one.
  • Calibration sessions across managers prevent rating drift and make ratings comparable between teams.
  • Compensation should be tied transparently to ratings, with documented raise ranges by role and tier.
  • The review document is the artifact; the conversation is the work. Train managers explicitly on the conversation.

This guide covers cadence, role-specific rubrics, calibration, utilization versus outcome reviews, raise tables tied to ratings, and the manager training that makes the whole thing function.

Why agency reviews fail

Most agency reviews fail for one or more of these structural reasons:

  • The same form for every role. A designer, an engineer, a strategist, and an account manager have wildly different success criteria. A single 5-question form cannot evaluate all of them honestly.
  • Manager bias. Some managers rate 4s and 5s liberally. Others rate strictly. Across the team, the ratings are not comparable, and promotion decisions become unfair.
  • No connection to compensation. Employees do the review, get a rating, and then a raise number lands with no visible relationship to the rating. The review becomes theatrical.
  • Annual only. A single annual conversation cannot drive behavior change. People hear feedback once a year and have to wait twelve months to apply it.
  • Surprises in the room. The first time an employee hears that they have been underperforming is in the review itself. That is a manager failure, not an employee failure.

Each of these is a design problem, not a people problem. The rest of this guide covers the fixes: role-specific rubrics, a layered cadence, calibration, transparent comp tables, and trained managers.

A layered review cadence

A four-layer cadence works for most agencies:

LayerCadenceTimePurpose
1:1sWeekly or biweekly30 to 45 minContinuous feedback, blocker removal, real-time recognition
Project retrosPer project45 minProject-level learning, individual contribution surfaced
Quarterly check-inQuarterly60 minGoal progress, rubric preview, course corrections
Formal reviewBiannually or annually90 minRubric scoring, calibration, compensation, growth path

The combination prevents annual surprises and keeps feedback in the system. The formal review becomes a summary of conversations that already happened, not a single high-stakes event.

The quarterly check-in is the most underused layer. It is short, structured, and prevents the annual review from becoming a fire drill. It also gives the employee a chance to act on direction with three months of runway before the formal review.

Role-specific rubrics

The most important change you can make to your review process is to write a role-specific rubric for each major function. Below are rubrics for the five most common agency roles. Each dimension is scored on a 1 to 5 scale, where 3 is "meeting expectations for current level" and 5 indicates promotion readiness.

Creative (designer, art director, copywriter, creative director)

DimensionWhat to evaluateWhat a 5 looks like
Craft qualityOutput quality against agency standard, awards, portfolio strengthWork consistently selected for the agency reel, recognized by industry awards
Conceptual rangeBreadth of solutions, willingness to take creative riskPitches multiple distinct concepts, pushes beyond first idea
Client presenceAbility to present and defend work, take directionOwns presentations to senior client stakeholders, recovers from hard feedback
CollaborationEffectiveness with cross-functional partnersStrategists and producers ask to be staffed with this person
MentorshipDevelopment of junior creativesAt least one junior visibly developed under their guidance
VelocityOutput relative to project demandsMaintains craft standards under tight timelines

Strategist (strategy, planning, research)

DimensionWhat to evaluateWhat a 5 looks like
Strategic insightDepth and originality of recommendationsInsights regularly referenced by client leadership, used in their internal decks
Research rigorQuality of supporting evidence, methodologyBuilds repeatable research approaches the agency adopts as standard
Client influenceAbility to move client decisionsClient cites this person's recommendations when defending choices internally
Written craftClarity and persuasion of written workDecks read like a senior partner's, not a junior analyst's
Cross-discipline fluencyUnderstanding of creative, media, technologyTranslates strategy across discipline boundaries effectively
Business acumenConnection of work to client commercial outcomesStrategy linked to revenue, retention, or category share

Account manager (account lead, account director)

DimensionWhat to evaluateWhat a 5 looks like
Client relationship healthTenure, NPS, account expansionClient renews above contract value, refers other clients
Revenue ownershipAccount revenue growth, gross marginAccount revenue growth above 20 percent year over year, margin maintained
Internal team managementProject health on owned accountsProducers and creatives consistently want to work on this person's accounts
Commercial judgmentScope conversations, pricing decisionsCatches scope creep early, negotiates expansion confidently
Strategic partnershipQuality of strategic advice to clientClient treats this person as a senior counselor, not just a vendor liaison
Crisis managementHandling of client escalationsHas owned a major client crisis to successful resolution

Producer / project manager

DimensionWhat to evaluateWhat a 5 looks like
Delivery reliabilityOn-time, on-budget project completion95+ percent of projects ship on time and within 5 percent of budget
Scope disciplineCatching and managing scope changesScope creep flagged within 48 hours, change orders signed routinely
Resource judgmentStaffing and capacity decisionsCalls capacity risks 2 to 4 weeks before they materialize
Cross-functional leadershipAligning creative, strategy, engineeringDiscipline leads describe this PM as a force multiplier
Client confidenceClient trust in deliveryClient copies this PM into strategic decisions, not just status emails
Process improvementContribution to SOPs, templates, toolingHas shipped at least one durable process improvement per cycle

Engineering / development

DimensionWhat to evaluateWhat a 5 looks like
Technical craftCode quality, architectural decisionsTheir code is referenced as the standard for the agency
VelocityThroughput against estimatesEstimates land within 15 percent on 80 percent of projects
Cross-discipline collaborationWork with design, strategy, PMDesigners describe this engineer as a creative partner
Client-facing communicationTranslation of technical work for non-engineersCan run a client technical review without a translator
MentorshipJunior engineer developmentVisible upgrade in one or more juniors per cycle
Risk managementIdentification and mitigation of technical riskCatches architectural and security risks before they become incidents

These rubrics are starting points. Tailor the dimensions to your agency's specific work and standards. The key principle is role specificity, not one-size-fits-all.

Utilization-based versus outcome-based reviews

A specific failure mode in agency reviews: confusing utilization (hours billed) with outcomes (work delivered). These are different questions and they need to be separated in the rubric.

MeasureWhat it tells youWhat it does not tell you
UtilizationWhether the person is working on billable client workWhether the work is good, whether the client is happy, whether scope was managed
Project marginWhether the engagement is profitableWhether the individual contributed positively to that margin
Client NPSWhether the client values the teamWhether this specific person drove the NPS
Peer reviewWhether colleagues find this person effectiveWhether colleagues are seeing the full scope of work
Manager assessmentA senior-level judgmentLimited by what the manager personally observes

The right pattern is to use all five, weighted differently by role. A producer should be weighted more on margin and delivery reliability; a creative more on craft and peer review; an account manager more on client NPS and revenue.

A utilization-only review tells designers to grind hours. An outcome-only review without utilization context misses that the team is overworked. Both, together, in different weights per role, is the answer.

Calibration sessions across managers

Calibration is the practice that makes ratings fair. Without it, manager bias makes ratings non-comparable and promotions feel unfair. The gap is common: Gallup (2017) found only 29% of employees strongly agree their performance reviews are fair, and 26% that they are accurate.

A practical calibration structure:

StepWhat happensTime
Manager drafts ratingsEach manager writes ratings for their team using the rubric1 to 2 hours per direct report
Pre-calibration submissionRatings submitted to HR or COO before sessionAsynchronous
Calibration sessionAll managers for a function plus senior leader review ratings2 to 4 hours
Discussion of outliersHigh ratings, low ratings, and inconsistencies discussed openlyWithin session
Final ratingsAdjustments made; final ratings documentedEnd of session
Conversation with direct reportsEach manager delivers final rating in the formal review1 to 2 weeks post-calibration

Putting your ratings on the table in front of peers prevents drift. A manager who rates everyone a 4 has to defend each 4 with rubric evidence, in front of managers who rated similar work a 3.

Useful calibration norms:

  • Pre-share ratings before the session so managers come prepared.
  • Use the rubric language, not adjectives, when defending a rating.
  • Distribute final ratings across the rubric. If 80 percent of your team scores 4 or 5, the rubric is broken or the managers are lenient.
  • Track manager-level bias over time. Some consistently rate high; some consistently rate low. Note it for management development.

Tying ratings to compensation transparently

The biggest credibility killer in performance reviews is opaque compensation. In Gallup's 2019 research on performance reviews, only 22% of employees strongly agreed that their pay and incentives motivate them to do what is best for their organization. The fix is a public raise table tied to the rating system.

An example raise table for an agency (set your own ranges from your budget and market data):

RatingDescriptionAnnual raise rangePromotion eligibility
1Below expectations, on PIP0 percentNo
2Inconsistent, development plan required0 to 2 percentNo
3Meeting expectations for level3 to 5 percentAfter 12 to 24 months at level
4Exceeding expectations5 to 8 percentEligible at next promotion cycle
5Outstanding, promotion-ready6 to 10 percentPromote at next cycle, market-adjustment possible

The table is public, so every employee knows what their rating maps to and there are no surprises when the number lands.

Some practical refinements:

  • Add a separate market-adjustment budget for employees whose market value has moved faster than their level. Without this, top performers leave for competitors.
  • Promotions trigger a larger raise (often 10 to 15 percent) plus a title and responsibility change.
  • Equity, profit-sharing, and bonus structures sit on top of the base raise table and follow their own rules.

Compensation ranges by role

The ranges below are rough planning ranges for US-based agency roles, not survey results. Before you set pay bands, check them against current data for your market, such as the Robert Half Salary Guide and the BLS Occupational Employment and Wage Statistics.

RoleJuniorMidSeniorDirector
Designer$58,000 to $75,000$80,000 to $105,000$110,000 to $145,000$150,000 to $210,000
Copywriter$55,000 to $72,000$75,000 to $100,000$105,000 to $135,000$140,000 to $190,000
Strategist$65,000 to $85,000$90,000 to $120,000$125,000 to $165,000$170,000 to $240,000
Account Manager$55,000 to $70,000$75,000 to $110,000$120,000 to $160,000$165,000 to $230,000
Producer / PM$58,000 to $75,000$78,000 to $105,000$110,000 to $145,000$150,000 to $200,000
Engineer$80,000 to $110,000$115,000 to $150,000$155,000 to $200,000$210,000 to $290,000

Adjust for geography (New York, San Francisco and Los Angeles pay above these ranges; smaller markets pay below) and for agency size (large holding-company agencies often pay more than small independents). Benchmark against your specific market every year.

The review conversation

The review document is the artifact. The conversation is the work. Most managers are bad at the conversation and need training.

A useful conversation structure for a 90-minute formal review:

SegmentTimeManager's jobEmployee's job
Opening5 minFrame the conversation, name the ratingListen, prepare to engage
Employee reaction15 minListen, ask clarifying questionsShare reactions, push back where appropriate
Rubric walkthrough30 minDiscuss each dimension with specific examplesConfirm or contest specifics
Growth and development15 minDiscuss next-level criteria, gaps to closeShare career aspirations
Compensation10 minShare the rating-to-raise mapping, the actual numberAsk questions
Goals for next cycle10 minSet 3 to 5 specific goalsConfirm and commit
Close5 minAcknowledge contribution, be humanN/A

Three patterns that distinguish good review conversations from bad ones:

  • No surprises. Every concern raised in the review has been raised at least once before in a 1:1.
  • Specific examples. Adjectives ("good," "needs improvement") are forbidden. Behaviors and outcomes are required.
  • Two-way. The employee leaves with their own questions answered, not just having received feedback.

Performance improvement plans

When an employee is consistently below expectations, a PIP is the right next step. PIPs are sometimes treated as a cover for planned termination; the better use is as a genuine attempt to help the employee succeed.

A working PIP structure:

ElementDetail
Specific performance gapWhat is missing, with examples from the rubric
Measurable improvement goals3 to 5 goals with clear success criteria
TimeframeTypically 30, 60, or 90 days
Support providedCoaching, training, peer mentorship, reduced load
Check-in cadenceWeekly during the PIP period
Outcomes if metReturn to standing, possible plan to address compensation
Outcomes if not metSpecific next steps, including possible termination
DocumentationWritten plan, written check-in notes, written outcome

SHRM publishes guidance on PIPs and progressive discipline, and its templates are a reasonable starting point. The most important PIP discipline is documentation, both for the employee's clarity and because employment rules vary by location (check with an employment lawyer or HR advisor before terminating anyone).

Manager training that works

Many agency managers were promoted from individual contributor roles without training, which shows up as inconsistent review quality. Training managers on the review conversation is one of the cheapest ways to improve it.

A practical manager training curriculum for review cycles:

ModuleDurationFormat
Rubric calibration2 hoursWorkshop with examples and group exercises
Writing assessments2 hoursWorkshop with peer review of draft assessments
Delivering hard feedback3 hoursRole-play with senior coach
Compensation conversations1 hourWorkshop with scripts and Q&A
Goal-setting1 hourWorkshop on outcome-based goals
Handling emotional reactions2 hoursRole-play with senior coach
Following up post-review1 hourWorkshop on 30-day check-ins and goal tracking

Run the training before every review cycle, especially in the first two years of a new system. New managers attend the full curriculum; experienced managers do a refresher.

Reviewing specific situations

Remote employees

Remote employees can fall out of mind, especially in reviews. Compensate by tracking measurable outputs more carefully, scheduling more frequent 1:1s, and ensuring their work is visible across the team. The rubric is the same; the inputs require more deliberate effort.

Contractors and freelancers

Apply lighter versions of the same framework. Quarterly check-ins with clear scope and quality criteria work well for ongoing contractor relationships. Annual reviews are usually overkill.

Cross-functional partners

For senior roles, structured input from 3 to 5 peers adds essential perspective. Use anonymized written input synthesized by the manager. Avoid 360 reviews for junior roles where the political weight outweighs the data quality.

Departing employees

Skip the formal review and conduct a thorough exit interview instead. Document the patterns; share them in aggregate with leadership.

Measuring review effectiveness

Track these metrics across review cycles. The targets are rules of thumb to adjust for your team:

MetricWhat it tells youRule-of-thumb target
Manager completion rate by deadlineWhether the process is operational95+ percent on time
Direct report satisfactionWhether reviews feel useful4.0 or higher on 5-point scale
Goal achievement in subsequent cycleWhether reviews drive behavior70+ percent of goals achieved
Promotion rate by ratingWhether ratings correlate with promotion4s and 5s should drive most promotions
Voluntary departure by ratingWhether ratings predict retentionFew departures among 4s and 5s (regretted losses)
Calibration adjustment rateWhether managers are calibratedAdjustments under 15 percent of ratings

Patterns over time tell you whether the review system is improving manager quality and team development or just generating paperwork.

Example: a calibration rollout

Here is how a rollout might look at a hypothetical 60-person digital agency after three cycles of inconsistent reviews. The symptoms before the change:

  • Most ratings were 4 or 5, so the rating told nobody anything.
  • Employees could not explain how their rating affected their raise.
  • Promotion decisions were widely seen as political.
  • Regretted turnover was rising.

The interventions:

  • Five role-specific rubrics (creative, strategy, accounts, production, engineering).
  • Calibration sessions across all managers before each formal review.
  • The rating-to-raise table published on the internal wiki.
  • Review-conversation training for every manager.
  • A quarterly check-in layer between formal reviews.

What to measure over the next two cycles (about 12 months):

  • Rating distribution: a spread across 2 to 5 rather than a cluster at 4 and 5.
  • Employee understanding of the rating-to-pay link, from an internal survey.
  • Regretted turnover, compared with the prior year.
  • Perceived fairness of promotion decisions, from the same survey.

Most of the cost is manager time and training. The changes are structural and process-based rather than budget-driven.

Sources and further reading

Frequently asked questions

Should we do annual or quarterly performance reviews?

Use a layered cadence: weekly or biweekly 1:1s, project retros, quarterly check-ins, and an annual or biannual formal review. Annual alone is too sparse to drive behavior. Quarterly formal reviews are usually overkill. The quarterly check-in plus continuous 1:1s plus annual formal is the right balance for most agencies.

How do we prevent rating bias across managers?

Run calibration sessions with all managers for a function plus a senior leader before final ratings are shared. Walk through ratings with specific examples, discuss outliers at both ends, and adjust where the discussion reveals inconsistencies. Then track each manager's average rating over time so persistent leniency or strictness gets addressed in management coaching.

Should reviews be tied to compensation transparently?

Yes. Publish the rating-to-raise table on your internal wiki. Define raise ranges by rating. Communicate the framework so employees understand exactly how reviews translate to compensation. When the link between rating and raise is hidden, employees stop trusting the rating.

What should we do when an employee is consistently underperforming?

Move to a documented performance improvement plan with clear goals, defined support, weekly check-ins, and a specific timeframe (30, 60, or 90 days). Document everything. A PIP should be a genuine attempt to help the employee succeed, not a procedural cover for a termination you have already decided on.

How do we handle review conversations for remote employees?

Track measurable outputs carefully, schedule more frequent 1:1s, and ensure their work is visible across the team. Use the same role-specific rubric and the same calibration process. The structure of the review conversation is the same as for in-office employees, but the inputs require more deliberate effort to gather.


Want review conversations grounded in real delivery data? AgencyPro keeps projects and client requests in one place. Time tracking, capacity management and client ratings are on the Pro plan, and team performance and profitability reports are on Plus. Book a demo to see the data your managers would work from.

About the author

Bilal Azhar
Bilal Azhar•Co-Founder & CEO

Co-Founder & CEO at AgencyPro. Former agency owner writing about the operational lessons learned from running and scaling service businesses.

Continue reading

Ready to transform your agency?

Join thousands of agencies already using AgencyPro to streamline their operations and delight their clients.