Please note: The Together in Purpose Open Call is intentionally broad and assumes that groups are organizing themselves and their efforts in a lot of different ways. The Applications might demonstrate efforts undertaken through a focused program within a broader organization, through a shared effort described in the Application with resources stewarded by a lead Applicant, or through an established collaboration set up as fiscally sponsored project, just to name a few approaches. As a result, reviewers should consider in their evaluation the current and proposed work of the lead Applicant and its collaborators (“Applicant Team”) as described in the Application; the lead Applicant’s contributions and capabilities; and contributions and capabilities of named Collaborators in the Application.
Consider how community members are represented and shape priorities, make decisions, and guide or lead implementation.
Assess the evidence provided, recognizing that community representation and accountability can be informal or formal.
1: Minimal or no demonstration: Community members have little or no involvement in designing the work, making decisions, or leading implementation.
2: Limited demonstration: Community members provide input into the design of the work, serve primarily in advisory roles in decision-making, and have limited opportunities to lead implementation.
3: Moderate demonstration: Community members help design the work, share responsibility for some decisions, and lead aspects of implementation, although their roles and authority are uneven or not fully established.
4: Strong demonstration: Community members play central roles in designing the work, hold meaningful decision-making authority, and lead implementation. Their roles and authority are established and consistently reflected in how the work operates.
5: Exceptional demonstration: Community members hold sustained leadership in designing the work, exercise decision-making authority as priorities evolve, and lead and adapt implementation.
Consider how the Applicant Team coordinates roles and responsibilities, builds working relationships and trust, and shares networks, information, and resources toward clear outcomes.
Assess the evidence provided, recognizing that collaborative practices can be informal or formal.
1: Minimal or no demonstration: The Applicant provides little or no evidence that team members and partners coordinate roles and responsibilities, build relationships and trust, or share networks, information, and resources.
2: Limited demonstration: Team members and partners coordinate some activities, but roles and responsibilities remain unclear. Relationships show limited evidence of trust, and sharing networks, information, and resources is occasional or limited.
3: Moderate demonstration: Team members and partners generally coordinate their roles and responsibilities, demonstrate developing relationships and trust, and share networks, information, and resources to support the work. These practices are clear and evident but applied inconsistently.
4: Strong demonstration: Team members and partners consistently coordinate clear roles and responsibilities, maintain relationships grounded in trust, and actively share networks, information, and resources. These practices strengthen their ability to advance the work together.
5: Exceptional demonstration: Team members and partners coordinate and adapt roles and responsibilities as needs change, sustain trust through challenges or differences, and share networks, information, and resources responsively. These practices demonstrate a commitment to advance the work together.
Consider how the Application describes the outcomes it seeks and the measurable or observable indicators the Applicant Team will use to check progress.
Assess the evidence provided, recognizing that progress and outcomes can be measured informally and formally.
1: Minimal or no demonstration: The Application provides little or no explanation of how the Applicant Team’s work will create opportunities for collective actions that strengthen relationships within the communities it serves. Expected outcomes and indicators of progress are absent or unclear.
2: Limited demonstration: The Application describes efforts to create opportunities for collective actions but provides limited explanation about how those efforts strengthen relationships within the communities it serves. Expected outcomes and indicators of progress are broad or only partially defined.
3: Moderate demonstration: The Application provides a plausible explanation of how the Applicant Team’s efforts will create consistent opportunities for collective actions that strengthen relationships within the communities it serves. Expected outcomes are clear, with some relevant measurable or observable indicators identified. The connection between the work and intended outcomes needs further development.
4: Strong demonstration: The Application provides a clear and convincing explanation of how the Applicant Team’s efforts will create or sustain consistent opportunities for collective actions that strengthen relationships within the communities it serves. The expected outcomes are grounded in community context, experience, or relevant evidence, with well-defined measurable or observable indicators of progress.
5: Exceptional demonstration: The Application provides a compelling, well-supported explanation of how the Applicant Team’s efforts will create or sustain consistent opportunities for collective actions that strengthen relationships within the communities it serves. The Application demonstrates an understanding of the conditions that support or limit its contribution, with meaningful, feasible indicators to gauge progress.
Consider and assess the evidence provided, recognizing that durability can take many forms depending on the community’s context.
1: Minimal or no demonstration: The Application provides little or no explanation of how funding will strengthen its capacity, develop knowledge it can continue to use, or sustain relationships beyond the grant. How the work will continue after funding ends is unclear.
2: Limited demonstration: The Application identifies opportunities to strengthen capacity, develop useful knowledge, and build relationships during the grant. However, it provides limited explanation of how these gains will support continued work beyond the grant term.
3: Moderate demonstration: The Application presents a plausible approach to sustaining strengthened capacity, retaining and applying knowledge, and maintaining relationships. Further development is needed for how these gains will support continued work beyond the grant term.
4: Strong demonstration: The Application presents a clear and credible approach to sustaining strengthened capacity, applying accumulated knowledge, and maintaining relationships beyond the grant. It identifies practical arrangements and resources that will enable these gains to support continued or deeper collaborative efforts.
5: Exceptional demonstration: The Application presents a compelling and well-supported approach to strengthen its capacity to listen, design and deliver, embed learning and iteration, and deepen relationships beyond the grant. It anticipates challenges and describes capabilities that will help the Applicant Team adapt and endure as needs and circumstances change.
Lever for Change addresses possible biases in the evaluation process both on the front end, before the scoring begins, and on the back end, after the reviewers have submitted their scores.
On the front end, Lever for Change’s Participatory Review and Evaluation Panel Review webinars review the Open Call criteria and the scoring rubric and include training on recognizing and addressing the biases that we all bring as we read and assess proposals. Lever for Change also works to address unconscious bias inherent in the scoring process.
During both Participatory Review and Evaluation Panel Review, each reviewer only reviews a very small subsample of the entire set of Applications. Therefore, each reviewer has a very different reference point by which to adjudicate each Application. For example, a reviewer may only see very good Applications. Because these Applications are of similarly good quality, the reviewer may decide to score these Applications lower than they deserve. By contrast, a reviewer that only sees poor Applications may give better scores on average. Furthermore, reviewers may have intrinsic cognitive biases. Even under ideal conditions, reviewers are prone to making non-objective judgements about the Applications they review, and so Lever for Change normalizes the raw scores provided by our evaluators to reduce the risk that bias in the assessment process eliminates a strong Application from consideration.
Normalization relies on finding the mean score given for all Applications and the mean score given by each reviewer. Reviewers whose mean score is higher than the global average will have their scores devalued to account for whatever biases led to inflated scores. Similarly, reviewers whose scores are lower than the global average will have their scores boosted to compensate for their tougher-than-average assessments.
The evaluation process will be conducted at two points during the Open Call process: first, after the conclusion of Participatory Review and, later, after the conclusion of Evaluation Panel Review. A submission that ranks among the top Applications, as determined by Participatory Review scores, will be eligible to advance to Evaluation Panel Review. A submission that ranks among the top Applications, as determined by Evaluation Panel Review scores, will be eligible for selection as an awardee.
As a further risk mitigation step, Lever for Change staff review reviewers’ scores and comments.
If at any point in the process, it is determined that an Applicant does not meet the eligibility criteria of the Open Call as laid out in the Open Call Rules, the Applicant will be notified and will not be eligible to progress to further stages of the Open Call.