Evaluation
Robust quantitative evaluation of outcomes and impacts
Schiff Consulting offers a full range of statistical, data analysis, and data visualisation services to support impact, outcome, and developmental evaluations. We regularly collaborate with evaluation teams and bring quantitative skills that complement other aspects of evaluation and research. Our approach to evaluation is transparent and robust, and is based on establishing causal links between investments or interventions and outcomes.
Quantitative evaluation services
- Analysis of administrative and activity data
- Data cleaning and processing
- Design of quantitative evaluative metrics
- Analysis and visualisation of survey data
- Statistical analysis and modelling, including causal inference methods
- Geospatial analysis and mapping
- Data visualisation
- Text analysis (natural language processing)
Economics for evaluation
Schiff Consulting also applyies cost-benefit analysis and welfare economics to impact evaluations and value-for-money assessments. Economic theory and models can be used to develop frameworks for measuring impacts and for quantification of value. Economic frameworks are also useful for evaluation of policy interventions that affect communities or markets.
Economic evaluation services
- Cost-benefit analysis
- Break-even analysis
- Studies of industries and markets
- Policy analysis and modelling
- Competition and regulatory economics
Examples of work
Economics of international cooperation: As part of a multidisciplinary team, Aaron Schiff developed and implemented economic frameworks for evaluating the benefits and costs of programmes run by the International Atomic Energy Agency to promote knowledge transfer and skills development in the Asia-Pacific region. This involved developing economic models of three peaceful applications of nuclear technology: non-destructive testing, medical radiotherapy, and mutation breeding of crops. Based on extensive research, these models were used to generate quantitative estimates of the net economic impacts of the IAEA’s programmes.
Data analysis for health evaluation: To help evaluate the impacts of an innovative health app targeted at disadvantaged communities, Aaron analysed anonymised activity and health data to understand how use of the app translated into changed health outcomes for users. This involved statistical modelling and applications of causal inference methods to compare outcomes for app users with a comparison group of people (with Dovetail).
Data analysis for transport evaluation: The New Zealand Ministry of Transport commissioned Aaron Schiff to evaluate the impacts of various changes to driver licensing rules on road safety outcomes. This involved analysis of a large dataset of driver licensing records and information about road crashes. Statistical models were applied to understand licensing-related factors that affected road safety outcomes over a 10-year period, which were summarised in data visualisations.