SEval-Standards

In its scientific work, Method Consult follows the SEVAL standards for evaluation (evaluation standards recommended by the Swiss Evaluation Society, SEVAL). The standards for precision, correctness, usefulness and practicability are presented in the following short version by Thomas Widmer, Charles Landert and Nicole Bachmann (1999). Translation by Method Consult.

Precision

The precision standards are to guarantee, that an evaluation about the validity and / or usability of the evaluated program will generate and mediate adequate technical information.

• P1 Program documentation

  The evaluation object is to be described and documented clearly and precise in such a way that it can be clearly identified .

• P2 Context analysis

  The context, in which the evaluation object is situated, is to be investigated sufficiently detailed so that possible influences on the evaluation object could be identified.

• P3 Description of focus and proceeding

  The purposes and the proceeding of the evaluation is to documented and described sufficiently precise in such a way that they can get identified and evaluated.

• P4 Reliable information sources

  The information sources used in an evaluation are to be described sufficiently precise so that the adequateness of information can be judged.

• P5 Valid information

  The methods of information production are to be selected or developed and transformed in such a way that the validity of the obtained interpretation for the given purpose is guaranteed.

• P6 Reliable information

  The methods of information production are to be selected or developed and transformed in such a way that the reliability of the obtained interpretation for the given purpose is guaranteed.

• P7 Systematic information check

  The information selected, processed, and presented in an evaluation are to be checked systematically and all identified errors are to be corrected.

• P8 Analysis of quantitative information

  Quantitative information of an evaluation are to be analyzed adequately and systematically so that the questions of of the evaluation can be answered effectively.

• P9 Analysis of qualitative information

  Qualitative information of an evaluation are to be analyzed adequately and systematically so that the questions of of the evaluation can be answered effectively.

• P10 Reasons for conclusions

  The conclusions drawn within an evaluation are to be expressively given reasons for so that persons involved & persons concerned can judge them.

• P11 Impartial reporting

  The reporting methods are to be saved by precautions from distortions by personal feelings and preferences of some evaluation party so that evaluation reports do represent results in a fair manner.

• P12 Meta evaluation

  The evaluation itself is to be evaluated in a formative and summative mode with respect to available or other important standards so that the implementation can be instructed accordingly and that the persons involved & persons concerned can check thoroughly its strengths and weaknesses at the end of an evaluation.

Correctness

The correctness standards are to guarantee that an evaluation is carried through legally and ethically correct and that it dedicates proper attention to the welfare of the persons involved in the evaluation and of the persons concerned by the results.

• C1 Support of the service orientation

  The evaluation is to be planned in such a way that organizations are supported to consider the interests and needs of the whole target group spectrum and to orient their activities according to this.

• C2 Formal agreements

  The duties of the contract parties of an evaluation (what, how, by whom, when is to be done) are to be fixed in writing so that the parties are obliged to fulfill all conditions of this agreement or to reenter these anew in formal negotiations.

• C3 Protection of individual human rights

  Evaluations are to be planned and implemented in such a way that the rights and welfare of human beings are respected and protected.

• C4 Human formed interaction

  In their contacts with others, evaluators are to respect the dignity and value of human beings so that these are not at risk or getting harmed.

• C5 Complete and fair judgement

  Evaluators are to be complete and fair in the investigation and presentation of the weaknesses and strengths of the evaluation object in such a way that the strengths can get extended and the problem areas can get treated.

• C6 Transparency of results

  The contract parties of an evaluation are to guarantee that the evaluation results including fundamental restrictions are available to the persons concerned by the evaluation and to all those who have a valid claim to the evaluation results.

• C7 Declaration of conflicts of interest

  Conflicts of interest are to be treated in an open and sincere manner so that they do not interfere with the methods and results of the evaluation.

• C8 Financial responsibility

  The allocation and spending of resources by an evaluator is to be demonstrated by a careful accounting, and is to be otherwise clever and ethically responsible so that the expenditure is responsible and adequate.

Usefulness

The usefulness standards are to guarantee that an evaluation is oriented to the information needs of the intended evaluation users.

• U1 Identification of involved persons & concerned persons

  The persons are to be identified that are involved with an evaluation or concerned by it so that their interests and needs can be considered.

• U2 Credibility of evaluator

  The evaluator carrying through evaluations has to be credible as well as competent so that a maximum degree of credibility and acceptance is achieved by the evaluation results.

• U3 Amount and selection of information

  The obtained information has to be possible in an amount and selection that enables the treatment of useful questions about the evaluation object and at the same time to give time and attention to the interests and needs of the client and other persons involved & concerned.

• U4 Assessment of values

  The perspectives, methods and thoughts, which are the base for the interpretation of the results, are to be described carefully so that the fundaments of value judgements are clearly obvious.

• U5 Clarity of report

  Evaluation reports are to describe the evaluation object including its context as well as the focus, methods, and results of the evaluation so that the essential information is available and easily comprehendible.

• U6 Timing and distribution of the report

  The intended users are to be informed about important interim results as well as final reports in such a manner that they can use them in time.

• U7 Effect of the evaluation

  Evaluations are to be planned, implemented and described in such a way that the persons involved & concerned are encouraged to follow the evaluation process so that the use of the evaluation is more probable.

Practicability

The practicability standards are to guarantee that an evaluation is performed realistically, well thought through, diplomatically and cost-conscious.

• P1 Practical methods

  The evaluation methods are to be practical so that disturbances are minimized and the needed information can get procured.

• P2 Political viability

  Evaluations are to be planned and carried through in anticipation of the different positions of the several interest groups to achieve cooperation and and to avoid possible attempts of one of these groups to restrict the evaluation activities or to distort or misuse the results.

• P3 Cost-effectiveness

  The evaluation is to be efficient and is to produce information with a value that justifies the means.