As a product designer on a leading test management platform, I was tasked with designing a new feature called "Value Score." The core objective of this feature was to help users better understand and improve the quality of the tests they were creating. By applying a data-driven methodology, the Value Score provided a quantifiable score to each test, along with a set of recommendations. The ultimate goal was to accelerate the QA process by helping users design more effective, high-impact tests and identify areas for improvement. This project was a direct response to the need for a more intelligent and proactive approach to test design within our platform.
The Value Score feature fails to fulfill its intended purpose of guiding users to assess and improve the quality of tests. Its limited adoption and inconsistent performance result from three critical issues:
Low User Engagement:
Users do not understand the purpose or significance of the Score Value, leading to low interaction and underutilization of the feature.
Lack of Clarity in Representation:
The current design does not provide an intuitive or visually distinct way to convey the importance of the score.
Inconsistent Functionality of Recommendations:
Recommendations tied to the Score Value are unreliable—they sometimes fail to display, and when they do, key improvement suggestions may be missing.
These issues collectively hinder the Score Value feature from contributing effectively to the QA process, reducing its potential value as a decision-making tool for improving test quality.
The 'Score value' column is displayed in a color that varies depending on the score but in a way that does not appear clickable in order not to confuse the user.
The scores are color-coded for intuitive understanding:
Red (0–30): indicates a low score, with high transparency.
Yellow (30–60): indicates an average score, with high transparency.
Green (60–100): indicates a good score, with high transparency.
When entering the test, the score value appears on the left side separated from the insights under the heading Score value.
The score is displayed within a donut chart, with the relevant color filling the chart proportionally to the score.
The score value is delimited by a subtle frame to separate it from the insights while maintaining a clean design.
On the right side, a list of insights appears, accompanied by an AI icon to emphasize that the feature is powered by AI.
Insights update in real time whenever the score changes, ensuring that users receive the most accurate and up-to-date improvement suggestions. This dynamic behavior improves the feature's reliability and encourages consistent engagement.
