Reliability, Standards & Testing

Our Reliability, Standards & Testing team (RST) actively participates at Ecma International, the W3C, and the WHATWG, developing new standards and advocating for inclusive workflows. We work on projects with browser implementers and embedders to improve web platform interoperability through specification authoring, shared test suites development and infrastructure maintenance. We use our experience consuming new web platform features to inform our work on web platform reliability.


Our Past Reliability, Standards & Testing Work

Daily runs of Test262 against nightly builds of all major JavaScript Engines.

Test262 Report | Bocoup

Making the Fieldset Element Interoperable and Useful.

Fieldset Interoperability | Mozilla

Making the Fieldset Element Interoperable and Useful.

Screenshot of a successful export of tests from WebKit to WPT.

Integrating Web Platform Tests with the WebKit project.

Web Platform Tests Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Web Platform Tests, and running the material in parallel within the WebKit build infrastructure.

Running 1.2 million conformance tests across 4 browsers every 24 hours

Web Platform Test Running | Google

Google funded us to develop infrastructure for running the entire Web Platform Tests suite against the 4 browser engines every day.

Improving Test262 integration with the WebKit project.

Test262 Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Test262, and running the material in parallel within the WebKit build infrastructure .

Burning Down Open Bugs in WPT

Web Platform Tests Infrastructure Maintenance | Google

Bocoup is working to stabilize Web Platform Tests infrastructure, making this shared test suite more reliable for browser teams.

Improving Test Author Workflow

Pull Request Validation for Web Platform Tests | Google

Bocoup created continuous integration tools for auto-running new WPT tests in each major browser.

Finding & Fixing Browser Compatibility Bugs

Web Navigation Compatibility | Mozilla

Mozilla's Firefox rendering team engaged us to search for incompatibilities between browsers and the HTML Navigation specification. We uncovered numerous bugs, including a rare one in all browsers.

Overseeing the Development of WebRTC Tests

WebRTC Test Reviewing | Google

We worked with WebRTC testers to increase testing consistency through weekly reviews.

Unifying and improving divergent test forks for the benefit of all.

Migrating Service Worker Tests to WPT | Google

The Google Chrome team wrote a large set of valuable tests for a new web standard. The team asked us to move them to a place where more people could use and improve them.

Extending the Official Test Suite for JavaScript

Test262 Support for V8 | Google

Bocoup worked with the Google Chrome V8 JavaScript engine team to extend Ecma Test262, the official test suite for the JavaScript language, to implement tests and to build smarter tooling for managing feature compliance across an increasingly large landscape of runtimes for JavaScript engines in web browsers.

Working with Facebook to develop the mobile web acid test suite.

Ringmark | Facebook

We worked with open source and standards engineers at Facebook in 2013 to develop a mobile web acid test suite to demonstrate what features needed in order to work properly on the mobile web.

Collaborated with the ChromeOS team to build a Web Audio API testing tool.

Web Audio Testing Tool | Google

The Chrome team engaged Bocoup to build a web application to exercise the full surface area of the Web Audio API so they could test their work.

Recent from the Blog

The ECMAScribes

Did you know that in the process of standardizing JavaScript, TC39 publishes notes for each of their regular meetings? Every other month, over 50 "delegates"…

Read more

How to scribe at TPAC

Next week is TPAC in Fukuoka, Japan. This is an annual conference for all working groups in the W3C to meet face-to-face. Naturally, there is…

Read more

Contributing to the ARIA Authoring Practices Guide

We believe that inclusivity and accessibility are of utmost importance to the open web platform. One of the ways that we empower the full diversity…

Read more

Contact Us

We'd love to hear from you. Get in touch!


+1 617-379-2752


P.O. Box 961436
Boston, MA 02196