Metrics and Evaluation
This chapter defines a lightweight measurement framework for the Cultural Bridge Track. Metrics are used to prove the program is:
- real (not symbolic),
- safe (not coercive),
- non-propagandistic (guardrails work),
- and beneficial (cultural access + diaspora employment).
Metrics should be aggregate by default to protect privacy.
Principles
- Measure outputs (what was delivered) and outcomes (what changed).
- Avoid politicized “sentiment scoring.”
- Protect participants (especially teachers) from exposure and harassment.
- Use simple indicators that can be audited.
Program 1: Russian Literature Dignity Program (Library/School Pillar)
Output Metrics
- Participating institutions (count)
- Titles acquired (count) and by category (classics/poetry/science/diaspora/dissident)
- Translation coverage (% of titles available in host-country languages)
- Funds disbursed by grant tier
- Events delivered (count) if events are part of the program
Usage Metrics
- Circulation/borrow rates (aggregate)
- Reading program participation (aggregate)
- Event attendance (aggregate)
Integrity Metrics (Anti-Propaganda)
- Percentage of acquisitions that pass the exclusion criteria review
- Number of flagged titles removed (and reason codes)
- Governance transparency: meetings held, criteria published, conflicts disclosed
- Red-team findings (count; severity categories)
Program 2: Ukrainian Language Worldwide Program
Access and Reach
- Enrollments by track (starter/intermediate/advanced/heritage/professional)
- Completion rates by track
- Geographic spread (countries/cities/online cohorts)
- Cost per learner (where relevant)
Learning Outcomes
Choose one of:
- CEFR-like bands (A1–C1) where feasible, or
- Standardized internal checkpoints (Beginner 1/2, Intermediate 1/2, Advanced)
Metrics:
- Pre/post assessment distributions (aggregate)
- Learner self-efficacy surveys (optional)
Diaspora Employment Outcomes
- Number of Ukrainian instructors employed
- Paid teaching hours delivered
- Total instructor payouts
- Instructor retention rate
- Instructor satisfaction / wellbeing (optional, anonymized)
Safety and Safeguarding Metrics
- Harassment incidents reported (count; severity categories)
- Response timeliness (median time to action)
- Repeat offender rate (where applicable)
- Privacy incidents (count; severity)
Cross-Cutting Metrics (Whole Track)
Public Trust and Legitimacy Proxies (Non-Political)
- Institution renewal rate (partners continuing next cycle)
- Donor renewal rate (if philanthropic funding used)
- Complaint rate and resolution timeliness (participants/partners)
Equity and Accessibility
- Participation from underserved communities (where measurable and privacy-safe)
- Scholarship usage (if applicable)
Evaluation Cadence
- Monthly operational dashboard (internal)
- Quarterly summary (partners/funders)
- Annual public report (privacy-redacted)
Reporting Outputs (Recommended)
Annual public report should include:
- What was funded and where
- High-level acquisitions categories (not necessarily full granular lists if sensitive)
- Language program reach and completion
- Diaspora employment totals
- Integrity and safeguard reporting (high level)
Links
