Collective Knowledge (software)
The Collective Knowledge project is an open-source framework and repository to enable collaborative, reproducible and sustainable research and development of complex computational systems. CK is a small, portable, customizable and decentralized infrastructure helping researchers and practitioners:
- share their code, data and models as reusable Python components and automation actions with unified JSON API, JSON meta information, and a UID based on FAIR principles
- assemble portable workflows from shared components
- automate, crowdsource and reproduce benchmarking of complex computational systems
- unify predictive analytics
- enable reproducible and interactive papers
Notable usages
- ARM uses CK to accelerate computer engineering
- Several ACM-sponsored conferences use CK to automate the Artifact Evaluation process
- Imperial College (London) uses CK to automate and crowdsource compiler bug detection
- Researchers from the University of Cambridge used CK to help the community reproduce results of their publication in the International Symposium on Code Generation and Optimization during Artifact Evaluation
- General Motors (USA) uses CK to crowd-benchmark convolutional neural network optimizations
- The Raspberry Pi Foundation and the cTuning foundation released a CK workflow with a reproducible "live" paper to enable collaborative research into multi-objective autotuning and machine learning techniques
- IBM uses CK to reproduce quantum results from nature
- CK is used to automate MLPerf benchmark