Reliability, Standards & Testing

Our Reliability, Standards & Testing team (RST) actively participates at Ecma International, the W3C, and the WHATWG, developing new standards and advocating for inclusive workflows. We work on projects with browser implementers and embedders to improve web platform interoperability through specification authoring, shared test suites development and infrastructure maintenance. We use our experience consuming new web platform features to inform our work on web platform reliability.

Work

Our Past Reliability, Standards & Testing Work

Screenshot of the homepage of the ARIA-AT app

Building an app to manage manual testing of browsers and assistive technologies rendering ARIA accessibility features.

Test Management App for ARIA-AT | Facebook

We designed and built an app that manages manual test runs of web browsers and assistive technologies to help scale WPT-inspired interoperability tests for ARIA accessibility features.

Screenshot of wpt.fyi that displays results for

Adding new WPT tests for Fetch Metadata, COEP, and COOP to improve browser security guarantees.

Testing New HTTP Headers for Better Browser Security Guarantees | Google

We added new web-platform-tests tests for Fetch Metadata request headers and COEP/COOP response headers that improve browser security guarantees for users and web developers.

Screenshot of the Aria-AT Test Runner Prototype home page.

Developing a manual test suite for screen reader interoperability on the web.

Screen Reader Interoperability Test Suite Design | Facebook

We worked with the ARIA and Assistive Technology (ARIA-AT) Community Group to develop a assertion model and testing workflow for testing AT interop and implement a prototype runner.

Writing a regression test suite for the accessible interaction design pattern examples in the ARIA Authoring Practice Guidelines (APG).

Ensuring Correctness of W3C Accessibility Examples | Facebook

Facebook funded Bocoup to write comprehensive regression tests for the examples in the Accessible Rich Internet Applications (ARIA) Authoring Practice Guidelines (APG).

Contributing to the ARIA Authoring Practices Guide (APG) for authoring accessible web pages.

Maintaining ARIA Authoring Practices | Facebook

We are actively maintaining the APG, adding new guidelines for new features in the ARIA specification, reviewing contributions from the community, and maintaining CI and testing for the APG examples.

Creating a set of web APIs for interacting with the physical world.

Generic Sensor API For The Web Platform | Bocoup

A device programming model for the Web Platform that establishes a generic sensor class for all sensors to inherit from.

Daily runs of Test262 against nightly builds of all major JavaScript Engines.

Test262 Report | Bocoup

A daily report on the state of JavaScript engine interoperability and conformance.

Making the Fieldset Element Interoperable and Useful.

Fieldset Interoperability | Mozilla

Making the Fieldset Element Interoperable and Useful.

Screenshot of a successful export of tests from WebKit to WPT.

Integrating Web Platform Tests with the WebKit project.

Web Platform Tests Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Web Platform Tests, and running the material in parallel within the WebKit build infrastructure.

Running 1.2 million conformance tests across 4 browsers every 24 hours

Web Platform Test Running | Google

Google funded us to develop infrastructure for running the entire Web Platform Tests suite against the 4 browser engines every day.

Improving Test262 integration with the WebKit project.

Test262 Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Test262, and running the material in parallel within the WebKit build infrastructure .

Burning Down Open Bugs in WPT

Web Platform Tests Infrastructure Maintenance | Google

Bocoup is working to stabilize Web Platform Tests infrastructure, making this shared test suite more reliable for browser teams.

Improving Test Author Workflow

Pull Request Validation for Web Platform Tests | Google

Bocoup created continuous integration tools for auto-running new WPT tests in each major browser.

Finding & Fixing Browser Compatibility Bugs

Web Navigation Compatibility | Mozilla

Mozilla's Firefox rendering team engaged us to search for incompatibilities between browsers and the HTML Navigation specification. We uncovered numerous bugs, including a rare one in all browsers.

Overseeing the Development of WebRTC Tests

WebRTC Test Reviewing | Google

We worked with WebRTC testers to increase testing consistency through weekly reviews.

Unifying and improving divergent test forks for the benefit of all.

Migrating Service Worker Tests to WPT | Google

The Google Chrome team wrote a large set of valuable tests for a new web standard. The team asked us to move them to a place where more people could use and improve them.

Extending the Official Test Suite for JavaScript

Test262 Support for V8 | Google

Bocoup worked with the Google Chrome V8 JavaScript engine team to extend Ecma Test262, the official test suite for the JavaScript language, to implement tests and to build smarter tooling for managing feature compliance across an increasingly large landscape of runtimes for JavaScript engines in web browsers.

Working with Facebook to develop the mobile web acid test suite.

Ringmark | Facebook

We worked with open source and standards engineers at Facebook in 2013 to develop a mobile web acid test suite to demonstrate what features facebook.com needed in order to work properly on the mobile web.

Collaborated with the ChromeOS team to build a Web Audio API testing tool.

Web Audio Testing Tool | Google

The Chrome team engaged Bocoup to build a web application to exercise the full surface area of the Web Audio API so they could test their work.

Recent from the Blog

Introducing the Web Platform Contribution Guide

Many people in the web development community, including many of us at Bocoup, were drawn to the web because it appears to be a diverse…

Read more

Interoperability Testing for Assistive Technologies and The Web Platform

In 2018, we began contributing to ecosystem infrastructure for ARIA, the accessibility API for the web platform, with a project focused on regression testing for…

Read more

Launching Test262 Results on MDN Web Docs

We are excited to announce support for report embedding on test262.report, along with a new MDN collaboration to bring up-to-date information about ECMAScript feature conformance…

Read more

Contact Us

We'd love to hear from you. Get in touch!

Phone

+1 617-379-2752

Mail

P.O. Box 961436
Boston, MA 02196