Standard Analysis Metrics
gemma3:4b
Timing Analysis
Accuracy Metrics
Unknown Analysis
Difference Analysis
Ignore From Analysis Metrics
gemma3:4b
Error
Ignore From Metadata Metrics
gemma3:4b
Timing Analysis
Accuracy Metrics
Unknown Analysis
Difference Analysis
Analyze and Ignore Metrics
gemma3:4b
Timing Analysis
Accuracy Metrics
Unknown Analysis
Difference Analysis
Test Metadata
Flag Name: PADDING_CHANGE_FEATURE_CARDS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:47:51)
Detected Issues:
Affected UI Elements:
Explanation:
The home screen title has changed from 'Welcome back!' to 'Ready to explore?'. The question text has also shifted. The underlying UI and functionality appear to be the same, so the semantic difference is close to 1, suggesting this change is purely cosmetic and doesn't affect the core functionality. A minor pixel difference exists due to the text change.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:21)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference observed is a layout change, specifically impacting the position and size of the 'Upgrade Now!' and 'Buy Premium Today!' buttons. The content within the buttons remains largely the same, though the text labels (Photos, Videos, Music, Documents) also appear in a slightly different layout. This difference results in a higher pixel difference due to the repositioning, but the semantic difference is relatively high since the core functionality is still present.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:27)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the text content of the greeting. 'Welcome back!' has changed to 'Ready to explore?'. Additionally, the layout has shifted slightly, impacting the positioning of the buttons and labels. The pixel difference reflects the significant textual change.
Test Metadata
Flag Name: CONTENT_CHANGE_PREMIUM_FEATURES
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:47:56)
Detected Issues:
Affected UI Elements:
Explanation:
The Recent Activity section has changed its layout. Specifically, the icons and text labels have shifted positions, and the overall arrangement is different. While the content (Activity 1, 2, 3) is still present, the layout change introduces a pixel-wise difference and a semantic change.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:27)
Detected Issues:
Affected UI Elements:
Explanation:
Upon close inspection of the screenshots, a key difference is observed in the 'Premium Content' banner and the layout of the 'Premium Features' section. The banner's text is slightly altered, and the arrangement of the premium features (Advanced Security, Unlimited Storage, Family Sharing, Priority Support) is shifted. This creates a visual discrepancy between the reference and failure states. While other subtle visual differences might exist (e.g., slight padding adjustments), the primary cause of the failure is identified as this content alteration.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:31)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a significant content change within the 'Premium Features' section. Specifically, the 'Advanced Security' and 'Unlimited Storage' elements have disappeared and were replaced by 'Family Sharing' and 'Priority Support'. This represents a complete overhaul of the premium features displayed, impacting the user's understanding of what they are receiving for their premium subscription.
Test Metadata
Flag Name: PADDING_CHANGE_PREMIUM_BANNER
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:01)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is in the greeting text. The first image displays "Great to see you!" while the second image displays "Hello there!" The pixel difference is minimal and likely due to the change in text. The semantic difference is very high because the content itself is different, and the UI components relating to the greeting remain consistent. This suggests a likely issue with the localization or translation of the app's content.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:33)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the text color of the 'Upgrade Now!' button and the 'Home' text. In the failure image, these elements are colored differently, creating a visual inconsistency. The 'Home' text is also differently colored. The semantic difference is high as this is a visually jarring change. There are other slight changes in color. The pixel difference is high because the colors are significantly different. The affected elements are the button and the 'Home' text.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:36)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the change in the 'Home' text from 'Great to see you!' to 'Hello there!'. This is a significant textual alteration impacting the initial user greeting. The pixel difference reflects this. The semantic difference is high since it is a core element of the UI. The affected elements are those text labels on the home screen.
Test Metadata
Flag Name: TEXT_CHANGE_PROFILE_HEADING
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:05)
Detected Issues:
Affected UI Elements:
Explanation:
The Name label, Email label and Account Type label are displayed with different text. This is a text change.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:38)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference lies in the text displayed within the 'Profile Information' section. Specifically, the 'Name' label, 'Email label', and 'Account Type label' have different text values compared to the reference image. The layout also appears slightly different with small padding adjustments. A high pixel difference indicates a significant visual change. The semantic difference is also high, suggesting a substantial variation in the UI elements' content.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:41)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the content displayed within the 'Profile Information' section. Specifically, the 'Your Information' heading is present in the failure image, while it's absent in the reference image. This causes a complete visual difference, reflected in a pixel difference of 0.95. The semantic difference is also 0.95 because all other components related to profile information are identical.
Test Metadata
Flag Name: COLOR_CHANGE_PREMIUM_BADGE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:10)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has changed from a light gray to a slightly darker gray. This is the primary visual difference observed in the failure screenshot. The other UI elements and text remain unchanged, suggesting a minor color adjustment.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:43)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a color change within the 'Profile Information' section, specifically the 'Account Type' label and the 'Free' text. The text color is noticeably different in the failure image compared to the reference image. Beyond this, the layout and other elements appear identical.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:46)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a color change within the 'Profile Information' section. Specifically, the text color has shifted from a darker shade to a lighter shade. This creates a very noticeable visual discrepancy between the reference and failure images. Due to the extreme pixel difference, it is highly likely that the semantic difference is also very close to 1, indicating a complete change in the visual presentation of the text within that section.
Test Metadata
Flag Name: EnhancedSettings_EXPERIENCE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:15)
Detected Issues:
Affected UI Elements:
Explanation:
The test failed primarily due to a layout change. The Dark Mode switch is in the 'on' position in the reference image, but in the failure image, it's in the 'off' position. Furthermore, the language dropdown shows 'English (US)' in the reference image, but 'English (US)' in the failure. The pixel difference is present due to these changes. The semantic difference is high as the switches and dropdown are the main UI elements.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:48)
Detected Issues:
Affected UI Elements:
Explanation:
Upon careful examination, the primary difference is a COLOR_CHANGE in the Dark Mode toggle and the Enable Notifications toggle. The toggle is now a different color than the reference image. Additionally, the layout has shifted slightly, creating a LAYOUT_CHANGE. The semantic difference is high, suggesting a substantial change in the UI elements' function or appearance. The overall layout is altered, affecting the visual hierarchy and usability.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:51)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a significant layout change within the 'App Settings' section. Specifically, the 'Automatic Updates' toggle switch and the 'Clear Cache' option have been repositioned. Additionally, a color change occurred in the toggle switch and the 'Clear Cache' button. These changes are visually apparent in the comparison images, leading to a high pixel difference and a substantial semantic difference. The layout change is the most significant factor in this failure.
Test Metadata
Flag Name: PADDING_CHANGE_PROFILE_INFO
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:20)
Detected Issues:
Affected UI Elements:
Explanation:
The layout of the 'Profile Information' section has shifted slightly. Specifically, there is a small padding change and a minor adjustment to the element positioning. The core content (name, email, account type) remains unchanged, indicating a layout-related issue, not a semantic difference.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:53)
Detected Issues:
Affected UI Elements:
Explanation:
Upon close examination, the 'Name' and 'Email' fields display slightly different values. The expected name is 'John Doe', while the displayed name is 'John Doe'. This appears to be a text rendering issue. All other UI elements appear to be identical, indicating a high semantic similarity. The pixel difference is a minor artifact of this textual variation.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:54:56)
Detected Issues:
Affected UI Elements:
Explanation:
The profile information section has undergone a significant layout change. Specifically, the spacing and positioning of the 'Name', 'Email', and 'Account Type' labels have shifted, leading to a large pixel difference. The semantic difference is high because the essential profile information is present, but visually misaligned. The large pixel difference suggests a problem with the layout or padding styles.
Test Metadata
Flag Name: ANIMATION_PHASE_PREMIUM_PULSE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:25)
Detected Issues:
Affected UI Elements:
Explanation:
The test failed due to a layout change. The 'Buy Premium Today!' button appears shifted slightly and the 'Upgrade Now!' text is slightly misaligned. The content related to the buttons and text are largely the same, indicating a precise layout issue that causes pixel differences. The semantic difference is high because the core functionality of the buttons remains the same, it's solely the visual positioning that's incorrect.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:10:59)
Detected Issues:
Affected UI Elements:
Explanation:
The primary cause of the failure appears to be a color change in the 'Upgrade Now!' button. It’s shifted from a vibrant yellow to a lighter shade. Additionally, the text alignment within the ‘Ready to explore?’ section has been adjusted. The positioning of the ‘Photos’ icon has also been altered. These changes collectively contribute to the visual discrepancy. A pixel-wise analysis shows a 15% difference between the images. The semantic difference is high because most of the UI elements are present, but with noticeable alterations.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:02)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Buy Premium Today!' button has a slightly different color in the failure image compared to the reference image. The color shift is minor, but noticeable. All other UI elements appear to be identical and functioning as expected. The semantic difference is high because almost all elements are identical, but the color change is the core issue.
Test Metadata
Flag Name: COLOR_CHANGE_PROFILE_STATS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:29)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has changed from a light gray to a slightly darker gray. This constitutes a minor color variation.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:05)
Detected Issues:
Affected UI Elements:
Explanation:
The profile information section layout appears to have shifted, particularly the spacing and alignment of the text labels (Name, Email, Account Type). The text content within the labels themselves (e.g., 'John Doe', 'john.doe@example.com', 'Free') also has slight differences in color and spacing. The overall UI appears visually different from the reference image, suggesting a layout change that caused the color shift as well.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:06)
Detected Issues:
Affected UI Elements:
Explanation:
The background color of the 'Profile Information' section has significantly changed between the reference and failure images. The reference image shows a light gray background, while the failure image shows a darker gray background. This is the primary difference driving the high pixel and semantic differences.
Test Metadata
Flag Name: CONTENT_CHANGE_WELCOME_MESSAGE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:33)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Welcome back, User!' message has changed from 'Great to see you!' indicating a content change. The pixel differences are minor and likely due to the change in text. The semantic difference is high as the core greeting has been altered.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:11)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference lies in the text content. The welcome message has changed from 'Great to see you!' to 'Welcome back, User!'. Additionally, the layout of the elements within the screen has shifted slightly - elements are positioned differently. The text within the buttons and activity labels also slightly changed. The pixel difference is high due to these combined changes. The semantic difference is high because nearly all the UI elements are present, but their content and placement are incorrect.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:11)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is that the text 'Welcome back, User!' has changed from 'Great to see you!' This is a fundamental change in the welcome message. The pixel differences are very high, indicating a complete textual replacement. The semantic difference is also high, as the welcome message now communicates a different sentiment.
Test Metadata
Flag Name: COLOR_CHANGE_TOGGLE_SWITCH
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:38)
Detected Issues:
Affected UI Elements:
Explanation:
The Dark Mode switch is toggled to the 'on' position in the failure image, while in the reference image, it is off. This represents a color change, specifically the background color of the settings screen.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:16)
Detected Issues:
Affected UI Elements:
Explanation:
The primary observed difference is a color change in the 'Dark Mode' switch. The switch is currently highlighted in red, while the reference image shows it in a different shade. The other UI elements are consistent. Semantic difference is high as all other UI components are present and functional.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:16)
Detected Issues:
Affected UI Elements:
Explanation:
The 'Enable Notifications' switch is visually highlighted in red in the failure image, indicating a color change. This is the dominant difference between the reference and failure images. The switch appears to be toggled on in both images, suggesting that the change is purely visual, likely due to a styling issue or incorrect color assignment for the switch's on state. The high pixel_diff value indicates a significant visual difference.
Test Metadata
Flag Name: ANIMATION_CHANGE_LOADING_SPINNER
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:42)
Detected Issues:
Affected UI Elements:
Explanation:
The loading indicator (represented by the circular animation) is currently incomplete, resulting in a noticeable pixel difference. This suggests a problem with the loading process or the animation itself. The rest of the UI elements appear to be intact.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:21)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the loading indicator around 'Activity 2'. It's present in the failure image, but not in the reference image. The screen appears to be loading content. There might be minor visual discrepancies related to the loading state, but the overall layout and content appear largely the same. The pixel difference is high due to the significant change in the loading indicator's visual representation.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:21)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the animated circular loading indicator. It's clearly visible in both the reference and failure images, suggesting a problem with the animation itself, or perhaps the loading state isn't properly displayed. The high pixel_diff indicates significant visual differences despite the loading indicator appearing to be present.
Test Metadata
Flag Name: LAYOUT_CHANGE_PROFILE_AVATAR
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:47)
Detected Issues:
Affected UI Elements:
Explanation:
The profile screen shows a visual glitch with a slight pixel difference. The layout appears to be subtly shifted, and the 'Edit Profile' button is slightly misaligned. The semantic difference is high as the key UI elements are present, but visually disrupted. The pixel difference reflects this misalignment and visual artifact.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:27)
Detected Issues:
Affected UI Elements:
Explanation:
Upon careful examination of the three images, it's evident that the most significant difference lies in the layout of the 'Profile Information' section. The background color and arrangement of elements within this section have changed. Furthermore, the color of the 'Name' and 'Email' labels has also been altered. While there are slight pixel differences (15%), the overall semantic difference is high (85%) due to the substantial change in layout and color. The color changes, while minor visually, contribute significantly to the overall semantic difference.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:27)
Detected Issues:
Affected UI Elements:
Explanation:
The profile screen has a significant layout change. The 'Profile Information' section is positioned at the top of the screen in the reference image, but is shifted downwards in the failure image. This causes the layout to be different. The content within the 'Profile Information' section is also different - specifically, the labels for 'Name', 'Email', and 'Account Type' are all shifted downwards. The pixel difference is high because the entire section’s position has changed, but the semantic difference is high because the visual components and text are all different. This indicates a serious rendering issue, but as the pixel diff is so high, it's likely the cause is an issue with responsive design or a broken layout override.
Test Metadata
Flag Name: ANIMATION_PHASE_PROFILE_PHOTO_ROTATE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:52)
Detected Issues:
Affected UI Elements:
Explanation:
The 'John Doe' name is displayed incorrectly. The text is truncated, showing only 'John'. The email address and account type are displayed correctly. This indicates a text rendering or layout issue.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:33)
Detected Issues:
Affected UI Elements:
Explanation:
Upon careful examination of the three screenshots, it appears that the profile information section has a slight shift in spacing compared to the expected state. The layout appears mostly identical; however, there's a subtle variation in the padding around the text elements. This contributes to the pixel difference. The semantic difference is very high, indicating that the overall structure and content are correct, but the precise visual arrangement is slightly off. There isn't any clear evidence of animation or color changes.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:32)
Detected Issues:
Affected UI Elements:
Explanation:
The layout of the 'Profile Information' section has shifted slightly. The name and email fields are still present and correct, but their positioning is different compared to the reference image. This resulted in a small pixel difference (0.05). The semantic difference is high (0.95) because the functional components are correct, but their layout is not consistent with the baseline.
Test Metadata
Flag Name: LAYOUT_CHANGE_SETTINGS_SECTIONS
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:48:56)
Detected Issues:
Affected UI Elements:
Explanation:
The failure is primarily due to a minor layout change affecting the placement of elements within the settings screen. Specifically, the Dark Mode toggle and the Language dropdown appear to be slightly misaligned in the failure image compared to the reference. The pixel difference confirms this, though the semantic difference is high as most other elements remain unchanged. This likely stems from a rendering issue or a minor update affecting the layout.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:38)
Detected Issues:
Affected UI Elements:
Explanation:
Upon close inspection, the dark mode switch and language dropdown have subtle shifts in their position and size, causing a pixel-wise difference. The semantic differences are high due to the overall layout changes, despite the core functionalities remaining the same. The high pixel_diff value indicates this is the primary cause for the failure.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:38)
Detected Issues:
Affected UI Elements:
Explanation:
The primary cause of the failure is a significant layout change affecting the arrangement of the settings options. Specifically, the 'Enable Notifications' toggle and the 'Dark Mode' switch have been repositioned. Furthermore, the 'Account Type' label has also changed its layout. This change results in a high pixel difference due to the alteration of several UI elements. The semantic difference is high because a considerable portion of the UI elements have different appearances and arrangements compared to the reference image.
Test Metadata
Flag Name: TEXT_CHANGE_PREMIUM_BUTTON
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:49:01)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is the greeting text. The reference image says 'Hello there!' while the failure image says 'Ready to explore?'. This suggests a text content change.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:43)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the text displayed on the 'Upgrade Now!' and 'Unlock Premium!' buttons. The text has been changed from 'Upgrade Now!' to 'Unlock Premium!'. All other UI elements and their positions appear to be identical, suggesting a straightforward text replacement issue. The pixel_diff reflects this minor change, while the semantic_diff is nearly 1 as the core functionality remains the same.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:43)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference between the reference and failure images is the text on the "Upgrade Now!" button. In the failure image, the text has changed from "Upgrade Now!" to "Hello there!" This is a direct text change, resulting in a high pixel difference. The semantic difference is also high because the button's call to action has been altered.
Test Metadata
Flag Name: PremiumExperience_EXPERIENCE
Reference
Failure
Diff
Analysis Results
Standard Analysis
gemma3:4b (Generated: 2025-05-13 03:49:06)
Detected Issues:
Affected UI Elements:
Explanation:
The primary reason for the failure is a color change on the 'Premium Member' button and the renewal date. The button is now a different shade of blue, and the renewal date displays as 'January 1, 2024' instead of the expected 'January 1, 2023'. The semantic diff is very high as the core information has shifted. The pixel diff is only a minor discrepancy resulting from the color change.
Ignore From Metadata
gemma3:4b (Generated: 2025-05-13 04:11:49)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference observed is a color change within the "Account Type" section from "Premium" to "Premium Member". This is reflected in the highlighted color. Additionally, there are subtle layout changes: the "Member Since" and "Renewal Date" values have shifted slightly, indicating a layout change. The semantic difference is high because all other UI elements appear to be correct; it’s simply the visual representation of the data that is slightly off. The pixel difference is small, primarily due to the color alteration.
Analyze and Ignore
gemma3:4b (Generated: 2025-05-13 03:55:48)
Detected Issues:
Affected UI Elements:
Explanation:
The primary difference is a layout change: the Renewal Date displays 'January 1, 2024' instead of 'January 1, 2023' as shown in the reference image. This is a CONTENT_CHANGE. The other minor pixel differences (approx. 0.05) are likely due to minor variations in the visual representation of the Renewal Date value.