Standard Analysis Metrics
gemma3:4b
Timing Analysis
Accuracy Metrics
Unknown Analysis
Difference Analysis
Ignore From Analysis Metrics
gemma3:4b
Error
Ignore From Metadata Metrics
gemma3:4b
Error
Analyze and Ignore Metrics
gemma3:4b
Timing Analysis
Accuracy Metrics
Unknown Analysis
Difference Analysis
Test Metadata
Flag Name: PADDING_CHANGE_FEATURE_CARDS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:47:51)
Detected Issues:
Affected UI Elements:
Explanation:
The home screen title has changed from 'Welcome back!' to 'Ready to explore?'. The question text has also shifted. The underlying UI and functionality appear to be the same, so the semantic difference is close to 1, suggesting this change is purely cosmetic and doesn't affect the core functionality. A minor pixel difference exists due to the text change.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:27)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the text content of the greeting. 'Welcome back!' has changed to 'Ready to explore?'. Additionally, the layout has shifted slightly, impacting the positioning of the buttons and labels. The pixel difference reflects the significant textual change.
Test Metadata
Flag Name: CONTENT_CHANGE_PREMIUM_FEATURES
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:47:56)
Detected Issues:
Affected UI Elements:
Explanation:
The Recent Activity section has changed its layout. Specifically, the icons and text labels have shifted positions, and the overall arrangement is different. While the content (Activity 1, 2, 3) is still present, the layout change introduces a pixel-wise difference and a semantic change.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:31)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a significant content change within the 'Premium Features' section. Specifically, the 'Advanced Security' and 'Unlimited Storage' elements have disappeared and were replaced by 'Family Sharing' and 'Priority Support'. This represents a complete overhaul of the premium features displayed, impacting the user's understanding of what they are receiving for their premium subscription.
Test Metadata
Flag Name: PADDING_CHANGE_PREMIUM_BANNER
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:01)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is in the greeting text. The first image displays "Great to see you!" while the second image displays "Hello there!" The pixel difference is minimal and likely due to the change in text. The semantic difference is very high because the content itself is different, and the UI components relating to the greeting remain consistent. This suggests a likely issue with the localization or translation of the app's content.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:36)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the change in the 'Home' text from 'Great to see you!' to 'Hello there!'. This is a significant textual alteration impacting the initial user greeting. The pixel difference reflects this. The semantic difference is high since it is a core element of the UI. The affected elements are those text labels on the home screen.
Test Metadata
Flag Name: TEXT_CHANGE_PROFILE_HEADING
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:05)
Detected Issues:
Affected UI Elements:
Explanation:
The Name label, Email label and Account Type label are displayed with different text. This is a text change.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:41)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the content displayed within the 'Profile Information' section. Specifically, the 'Your Information' heading is present in the failure image, while it's absent in the reference image. This causes a complete visual difference, reflected in a pixel difference of 0.95. The semantic difference is also 0.95 because all other components related to profile information are identical.
Test Metadata
Flag Name: COLOR_CHANGE_PREMIUM_BADGE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:10)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has changed from a light gray to a slightly darker gray. This is the primary visual difference observed in the failure screenshot. The other UI elements and text remain unchanged, suggesting a minor color adjustment.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:46)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a color change within the 'Profile Information' section. Specifically, the text color has shifted from a darker shade to a lighter shade. This creates a very noticeable visual discrepancy between the reference and failure images. Due to the extreme pixel difference, it is highly likely that the semantic difference is also very close to 1, indicating a complete change in the visual presentation of the text within that section.
Test Metadata
Flag Name: EnhancedSettings_EXPERIENCE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:15)
Detected Issues:
Affected UI Elements:
Explanation:
The test failed primarily due to a layout change. The Dark Mode switch is in the 'on' position in the reference image, but in the failure image, it's in the 'off' position. Furthermore, the language dropdown shows 'English (US)' in the reference image, but 'English (US)' in the failure. The pixel difference is present due to these changes. The semantic difference is high as the switches and dropdown are the main UI elements.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:51)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a significant layout change within the 'App Settings' section. Specifically, the 'Automatic Updates' toggle switch and the 'Clear Cache' option have been repositioned. Additionally, a color change occurred in the toggle switch and the 'Clear Cache' button. These changes are visually apparent in the comparison images, leading to a high pixel difference and a substantial semantic difference. The layout change is the most significant factor in this failure.
Test Metadata
Flag Name: PADDING_CHANGE_PROFILE_INFO
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:20)
Detected Issues:
Affected UI Elements:
Explanation:
The layout of the 'Profile Information' section has shifted slightly. Specifically, there is a small padding change and a minor adjustment to the element positioning. The core content (name, email, account type) remains unchanged, indicating a layout-related issue, not a semantic difference.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:56)
Detected Issues:
Affected UI Elements:
Explanation:
The profile information section has undergone a significant layout change. Specifically, the spacing and positioning of the 'Name', 'Email', and 'Account Type' labels have shifted, leading to a large pixel difference. The semantic difference is high because the essential profile information is present, but visually misaligned. The large pixel difference suggests a problem with the layout or padding styles.
Test Metadata
Flag Name: ANIMATION_PHASE_PREMIUM_PULSE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:25)
Detected Issues:
Affected UI Elements:
Explanation:
The test failed due to a layout change. The 'Buy Premium Today!' button appears shifted slightly and the 'Upgrade Now!' text is slightly misaligned. The content related to the buttons and text are largely the same, indicating a precise layout issue that causes pixel differences. The semantic difference is high because the core functionality of the buttons remains the same, it's solely the visual positioning that's incorrect.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:02)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Buy Premium Today!' button has a slightly different color in the failure image compared to the reference image. The color shift is minor, but noticeable. All other UI elements appear to be identical and functioning as expected. The semantic difference is high because almost all elements are identical, but the color change is the core issue.
Test Metadata
Flag Name: COLOR_CHANGE_PROFILE_STATS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:29)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has changed from a light gray to a slightly darker gray. This constitutes a minor color variation.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:06)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has significantly changed between the reference and failure images. The reference image shows a light gray background, while the failure image shows a darker gray background. This is the primary difference driving the high pixel and semantic differences.
Test Metadata
Flag Name: CONTENT_CHANGE_WELCOME_MESSAGE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:33)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Welcome back, User!' message has changed from 'Great to see you!' indicating a content change. The pixel differences are minor and likely due to the change in text. The semantic difference is high as the core greeting has been altered.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:11)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is that the text 'Welcome back, User!' has changed from 'Great to see you!' This is a fundamental change in the welcome message. The pixel differences are very high, indicating a complete textual replacement. The semantic difference is also high, as the welcome message now communicates a different sentiment.
Test Metadata
Flag Name: COLOR_CHANGE_TOGGLE_SWITCH
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:38)
Detected Issues:
Affected UI Elements:
Explanation:
The Dark Mode switch is toggled to the 'on' position in the failure image, while in the reference image, it is off. This represents a color change, specifically the background color of the settings screen.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:16)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Enable Notifications' switch is visually highlighted in red in the failure image, indicating a color change. This is the dominant difference between the reference and failure images. The switch appears to be toggled on in both images, suggesting that the change is purely visual, likely due to a styling issue or incorrect color assignment for the switch's on state. The high pixel_diff value indicates a significant visual difference.
Test Metadata
Flag Name: ANIMATION_CHANGE_LOADING_SPINNER
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:42)
Detected Issues:
Affected UI Elements:
Explanation:
The loading indicator (represented by the circular animation) is currently incomplete, resulting in a noticeable pixel difference. This suggests a problem with the loading process or the animation itself. The rest of the UI elements appear to be intact.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:21)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the animated circular loading indicator. It's clearly visible in both the reference and failure images, suggesting a problem with the animation itself, or perhaps the loading state isn't properly displayed. The high pixel_diff indicates significant visual differences despite the loading indicator appearing to be present.
Test Metadata
Flag Name: LAYOUT_CHANGE_PROFILE_AVATAR
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:47)
Detected Issues:
Affected UI Elements:
Explanation:
The profile screen shows a visual glitch with a slight pixel difference. The layout appears to be subtly shifted, and the 'Edit Profile' button is slightly misaligned. The semantic difference is high as the key UI elements are present, but visually disrupted. The pixel difference reflects this misalignment and visual artifact.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:27)
Detected Issues:
Affected UI Elements:
Explanation:
The profile screen has a significant layout change. The 'Profile Information' section is positioned at the top of the screen in the reference image, but is shifted downwards in the failure image. This causes the layout to be different. The content within the 'Profile Information' section is also different - specifically, the labels for 'Name', 'Email', and 'Account Type' are all shifted downwards. The pixel difference is high because the entire section’s position has changed, but the semantic difference is high because the visual components and text are all different. This indicates a serious rendering issue, but as the pixel diff is so high, it's likely the cause is an issue with responsive design or a broken layout override.
Test Metadata
Flag Name: ANIMATION_PHASE_PROFILE_PHOTO_ROTATE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:52)
Detected Issues:
Affected UI Elements:
Explanation:
The 'John Doe' name is displayed incorrectly. The text is truncated, showing only 'John'. The email address and account type are displayed correctly. This indicates a text rendering or layout issue.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:32)
Detected Issues:
Affected UI Elements:
Explanation:
The layout of the 'Profile Information' section has shifted slightly. The name and email fields are still present and correct, but their positioning is different compared to the reference image. This resulted in a small pixel difference (0.05). The semantic difference is high (0.95) because the functional components are correct, but their layout is not consistent with the baseline.
Test Metadata
Flag Name: LAYOUT_CHANGE_SETTINGS_SECTIONS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:56)
Detected Issues:
Affected UI Elements:
Explanation:
The failure is primarily due to a minor layout change affecting the placement of elements within the settings screen. Specifically, the Dark Mode toggle and the Language dropdown appear to be slightly misaligned in the failure image compared to the reference. The pixel difference confirms this, though the semantic difference is high as most other elements remain unchanged. This likely stems from a rendering issue or a minor update affecting the layout.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:38)
Detected Issues:
Affected UI Elements:
Explanation:
The primary cause of the failure is a significant layout change affecting the arrangement of the settings options. Specifically, the 'Enable Notifications' toggle and the 'Dark Mode' switch have been repositioned. Furthermore, the 'Account Type' label has also changed its layout. This change results in a high pixel difference due to the alteration of several UI elements. The semantic difference is high because a considerable portion of the UI elements have different appearances and arrangements compared to the reference image.
Test Metadata
Flag Name: TEXT_CHANGE_PREMIUM_BUTTON
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:49:01)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the greeting text. The reference image says 'Hello there!' while the failure image says 'Ready to explore?'. This suggests a text content change.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:43)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the text on the "Upgrade Now!" button. In the failure image, the text has changed from "Upgrade Now!" to "Hello there!" This is a direct text change, resulting in a high pixel difference. The semantic difference is also high because the button's call to action has been altered.
Test Metadata
Flag Name: PremiumExperience_EXPERIENCE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:49:06)
Detected Issues:
Affected UI Elements:
Explanation:
The primary reason for the failure is a color change on the 'Premium Member' button and the renewal date. The button is now a different shade of blue, and the renewal date displays as 'January 1, 2024' instead of the expected 'January 1, 2023'. The semantic diff is very high as the core information has shifted. The pixel diff is only a minor discrepancy resulting from the color change.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:48)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a layout change: the Renewal Date displays 'January 1, 2024' instead of 'January 1, 2023' as shown in the reference image. This is a CONTENT_CHANGE. The other minor pixel differences (approx. 0.05) are likely due to minor variations in the visual representation of the Renewal Date value.