TLDR Dev · ARTICLES & TUTORIALS

HOW WE RAISED MOBILE END-TO-END TEST STABILITY TO 98%

shopify.engineering5 min read

Summary from the TLDR Dev newsletter

Shopify's mobile E2E test suite had become so flaky that it had to be pulled from PR checks, because the old Appium/WebdriverIO setup using React Native Test IDs allowed footguns like arbitrary pauses and asserted on view-hierarchy nodes rather than what a user could actually see. They rebuilt it as an opinionated wrapper with a strict builder-style API that forces an assertion on every step and prefixes escape hatches with UNSAFE_, plus computer vision that finds elements the way a merchant does.