Riassunto analitico
Linaro’s Linux Kernel Functional Test framework (LKFT) is a software package made of a diverse and distributed set of composable tools and projects which come together to make a cohesive Linux kernel testing service.
Its mission is to perform functional regression testing on selected Linux kernel branches, in real time, and report any regression as quickly as possible. This is performed by executing a variety of functional tests on a selection of user-space operating systems.
Unfortunately, LKFT does not provide any effective support for performance analysis or regression detection. Performance analysis is much harder than functional analysis, because test results are not just pass/fail, but numbers, and there is often no predefined criterion to decide when numbers are good and when are bad.
The goal of this document is to describe a performance analysis and regression detection framework that can be utilized by continuous integration systems (CI), such as LKFT.
This document describes in detail all the features we added and the steps we took, in order to implement the missing features and integrations, to have a fully working pipeline of tools that can provide performance analysis in LKFT.
|
