Capsulab is Coboi lab’s monthly knowledge capsule. We want to share our internal research on topics such as innovation, labs and multi-actor projects, among others, creating concise and practical content and materials that share the key learnings.
In this capsule we talk about:
1. Describing the lab’s theory of change
Although there is often a certain incompatibility between the level of detail required to develop a theory of change and the level of uncertainty in which a lab operates, Mark Cabaj suggests conceptualizing a generic theory of change initially, which can be progressively clarified and detailed as time goes on.
2. Being clear about the purpose of the evaluation
Labs should evaluate their activity with a dual objective:
- Generate internal strategic learning to develop, improve and adapt the lab. It’s important not lo let day-to-day demands derail the evaluation process.
- Fulfill external responsibilities (such as showing the lab’s progress, justifying funding, etc.) Avoid communicating only the positive aspects with a marketing approach.
3. Defining the unit of analysis of the evaluation
A lab could potentially evaluate many aspects of its activities and operations. It’s important to choose what we want to evaluate and why. Following the Overall Outcome Framework (min 20 of the video ), we could focus on the following elements:
- Lab operation
- Participants’ reactions
- Changes in participants
- Actions taken
- Results of actions
- Structural changes
4. Using frameworks instead of one-size fits-all recipes
There is no universal solution that allows us to evaluate any type of project -labs included. It’s advisable to build a personalized evaluation model (with methods, questions and basic principles) that adapts to our needs and constraints (resources, time, preferences, capabilities, etc.).
5. Applying an agile and adaptive approach
The evaluation should be adapted to the preferences of those carrying it out and should evolve alongside the lab itself. To strengthen this adaptive capacity, it’s important that the evaluation is carried out as an internal function of the team (not outsourced), so that it can be done in real time and that the lab’s activities and nuances can be better understood.
Source: Mark Cabaj. (2017) Evaluation and Labs. Labwise initiative (available online here)
If you want to receive the latest news from capsulab , you can subscribe through this form .
With the support of:
