MAIA Test management

MAIA Test Management

MAIA is creating a comprehensive report for each software build. The report offers both summarized high-level information and a lot of low-level details for all stakeholders.

Top box
Build Status
Build Comparison
Test Results
External artifacts
License Management
Vulnerabilities Management

Real-time test results

Post your test data through the streaming platform and get live progress and results.

Unified reporting

Send standardized test verdicts to get unified visualization and reporting.

Visualize for engagement

Visualize to build engagement and responsibility, resulting in high quality.

Fast bug remediation

Get instant failure reports and find out what went wrong using integrated analysis tools.

Historical test data

Get insights by comparing your latest tests with stored data from multiple test runs from the past.

Identify regression faster

Perform a diff on any two test run results to make it possible to identify fixes, new failures, and continuing failures.

Find recurring failures

Identify “flaky” test results to find troublesome underlying issues regarding environment, communications, etc.

Performance impact

Measure timing for the same test case over multiple test runs to understand code changes’ performance impact.

Top boxes

The top boxes contain aggregated information for each build.

Build status: Shows if the Build process was successful or has failed.
Tests: Indicates Ok if all tests are reported ok. If any of the tests have errors/fails, the box will contain the number of errors and the total number of tests.
Delivery reports: The time since the latest delivery report was created.
License: The number of components that need a license approval.
CVE decisions: The number of detected CVEs that need a remediation decision.

Build Status

Build Status is the primary information in the report. Do we have a successful build or not, i.e. do we have software to release or not?

Build Success

Build status icon on top of the Build Report page shows a successful build status.
The report includes a link to the build activity page containing detailed information of the build process.
The activity page has a link to all Build log pages holding detailed log data for each component.

Build Failed

Build status icon on top of the Build Report page shows a failed build status.
A link to the build activity page containing detailed information of the failed build process.
Build activity information showing the error descriptions, here we have a problem to build the nginx-component
A link to the Build log pages.
Build log with detailed data, here regarding the failed nginx build process.

Build Comparison

What has changed since the previous build …, or since the previous delivery…, or what has changed between two selected builds?

Compare with a previous build.

Compare this build with a previous build on the identical environment. The comparison may also be made to a previously delivered build, or as an advanced comparison, to any build.
Table with all Issues that have a new Status vs the previous build.
Table with all code changes vs the previous build.
Table with all changes in components vs the previous build i.e. component rebuilt only, source code changed and rebuilt, component added and built or removed.

Commit information.

Links to all changes in code (commits).
New window with commit-info, i.e. what files are included and complete diff-information for each file.
Identity of deliveries where this commit was first time included (for each product)
Identity of builds where this commit was first time included (for each environment)
Identity of all tasks (Issues) referenced in this commit.

Issue information.

Links to all Issue with changed status (Open/Done).
New window with detailed Issue-info, i.e. all commits with ref to this Issue, status etc.

Test Results

Test results may continuously be posted to MAIA, that is analyzing and registering the results to the relevant Build Report.

Test result inspection.

The top icon shows the current status for all automated tests (here 2 tests have failed). The tests tab lists all test executions performed on this software.
The click-able progress bar shows the accumulated status for each execution.
When clicking the progressbar, a window that is listing all test suites is opened. Failed test suites are clearly indicated in red.
Open a test suite and all test groups and test cases are listed. Errors are shown in red. Each test case has a window with test case descriptions and verdicts.

External artifacts

About external software included by the build process and reported to MAIA.

External artifacts included in the software build.

The External artifacts tab lists all software components detected by the build process.
For each external component, the license type and text is specified.
Detected vulnerabilities are displayed. Detailed information are enabling analysis and management.
A list of deliveries where the software is included.
Current health status is retrieved from the external hosts.

License Management

A list of all components included in the build, and for each component a License presentation that can be managed and approved.

Vulnerabilities Management

An automated process to detect vulnerabilities in the components/versions used in the current software build.

Vulnerabilities detected in the software build.

The CVE tab lists all software components/versions that holds a detected vulnerability (CVE).
All CVEs are listed with the CVE-identity and its corresponding CVSS score.
Weakness (CWE) prioritization is displayed in a separate column.
Presenting exploit occurences.
A column displaying latest remediation decisions.