Open-source software assessment methodologies


Several methods have been created to define an assessment process for free/open-source software. Some focus on some aspects like the maturity, the durability and the strategy of the organisation around the open-source project itself. Other methodologies add functional aspects to the assessment process.

Existing methodologies

There are more than 20 different OSS evaluation methods.Open Source Maturity Model from CapgeminiOpen Source Maturity Model from Navica

Comparison

Comparison criteria

Stol and Babar have proposed a comparison framework for OSS evaluation methods. Their framework lists criteria in four categories: criteria related to the context in which the method is to be used, the user of the method, the process of the method, and the evaluation of the method.
The comparison presented below is based on the following criteria:Seniority : the methodology birth date.Original authors/sponsors : original methodology authors and sponsoring entity License : Distribution and usage license for the methodology and the resulting assessmentsAssessment model :
  • * Detail levels : several levels of details or assessment granularity
  • * Predefined criteria : the methodology provides some predefined criteria
  • * Technical/functional criteria : the methodology permits the use of domain specific criteria based on technical information or featuresScoring model :
  • * Scoring scale by criterion
  • * Iterative process : the assessment can be performed and refined using several steps improving the level of details
  • * Criteria weighting : it is possible to apply weighting on the assessed criteria as part of the methodology scoring modelComparison : the comparison process is defined by the methodology