Reliability, Standards & Testing

Our Reliability, Standards & Testing team (RST) actively participates at Ecma International, the W3C, and the WHATWG, developing new standards and advocating for inclusive workflows. We work on projects with browser implementers and embedders to improve web platform interoperability through specification authoring, shared test suites development and infrastructure maintenance. We use our experience consuming new web platform features to inform our work on web platform reliability.

Work

Our Past Reliability, Standards & Testing Work

Screenshot of MDN documentation for appearance property.

Rationalizing the spec for the CSS appearance property to help ship an unprefixed version.

Unprefixing appearance to ship web-compatible styling of form elements | Google, Mozilla

We reviewed and updated the spec for the CSS appearance property, helped browsers ship appearance unprefixed without breaking compatibility, and made it easier to style HTML widget elements across browsers.

Screenshot of the homepage of the ARIA-AT app

Building an app to manage manual testing of browsers and assistive technologies rendering ARIA accessibility features.

Test Management App for ARIA-AT | Facebook

We designed and built an app that manages manual test runs of web browsers and assistive technologies to help scale WPT-inspired interoperability tests for ARIA accessibility features.

Screenshot of wpt.fyi that displays results for “cross origin opener policy“

Adding new WPT tests for Fetch Metadata, COEP, and COOP to improve browser security guarantees.

Testing New HTTP Headers for Better Browser Security Guarantees | Google

We added new web-platform-tests tests for Fetch Metadata request headers and COEP/COOP response headers that improve browser security guarantees for users and web developers.

Screenshot of the Aria-AT Test Runner Prototype home page.

Developing a manual test suite for screen reader interoperability on the web.

Screen Reader Interoperability Test Suite Design | Facebook

We worked with the ARIA and Assistive Technology (ARIA-AT) Community Group to develop a assertion model and testing workflow for testing AT interop and implement a prototype runner.

Screenshot of Example of Tabs with Automatic Activation

Writing a regression test suite for the accessible interaction design pattern examples in the ARIA Authoring Practice Guidelines (APG).

Ensuring Correctness of W3C Accessibility Examples | Facebook

Facebook funded Bocoup to write comprehensive regression tests for the examples in the Accessible Rich Internet Applications (ARIA) Authoring Practice Guidelines (APG).

Screenshot of WAI-ARIA Authoring Practices home page

Contributing to the ARIA Authoring Practices Guide (APG) for authoring accessible web pages.

Maintaining ARIA Authoring Practices | Facebook

We are actively maintaining the APG, adding new guidelines for new features in the ARIA specification, reviewing contributions from the community, and maintaining CI and testing for the APG examples.

Icons representing Sensor API

Creating a set of web APIs for interacting with the physical world.

Generic Sensor API For The Web Platform | Bocoup

A device programming model for the Web Platform that establishes a generic sensor class for all sensors to inherit from.

Fieldset layout model

Making the Fieldset Element Interoperable and Useful.

Fieldset Interoperability | Mozilla

Making the Fieldset Element Interoperable and Useful.

Screenshot of a successful export of tests from WebKit to WPT.

Integrating Web Platform Tests with the WebKit project.

Web Platform Tests Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Web Platform Tests, and running the material in parallel within the WebKit build infrastructure.

screenshot of web-platform-tests/results-collection

Running 1.2 million conformance tests across 4 browsers every 24 hours

Web Platform Test Running | Google

Google funded us to develop infrastructure for running the entire Web Platform Tests suite against the 4 browser engines every day.

screenshot of a list of tests in test262

Improving Test262 integration with the WebKit project.

Test262 Integration with WebKit | WebKit

We developed a set of tools for importing and exporting test material from Test262, and running the material in parallel within the WebKit build infrastructure .

Screenshot of the Web platform tests repo's issues on Github

Burning Down Open Bugs in WPT

Web Platform Tests Infrastructure Maintenance | Google

Bocoup is working to stabilize Web Platform Tests infrastructure, making this shared test suite more reliable for browser teams.

Screenshot of a dashboard for viewing PRs for web platform tests

Improving Test Author Workflow

Pull Request Validation for Web Platform Tests | Google

Bocoup created continuous integration tools for auto-running new WPT tests in each major browser.

screenshot of a table with Browsing context names

Finding & Fixing Browser Compatibility Bugs

Web Navigation Compatibility | Mozilla

Mozilla's Firefox rendering team engaged us to search for incompatibilities between browsers and the HTML Navigation specification. We uncovered numerous bugs, including a rare one in all browsers.

Rick Waldron approving a PR for WebRTC on Github

Overseeing the Development of WebRTC Tests

WebRTC Test Reviewing | Google

We worked with WebRTC testers to increase testing consistency through weekly reviews.

Screenshot of a comment from Mike Pennisi on Github

Unifying and improving divergent test forks for the benefit of all.

Migrating Service Worker Tests to WPT | Google

The Google Chrome team wrote a large set of valuable tests for a new web standard. The team asked us to move them to a place where more people could use and improve them.

Javascript logo

Extending the Official Test Suite for JavaScript

Test262 Support for V8 | Google

Bocoup worked with the Google Chrome V8 JavaScript engine team to extend Ecma Test262, the official test suite for the JavaScript language, to implement tests and to build smarter tooling for managing feature compliance across an increasingly large landscape of runtimes for JavaScript engines in web browsers.

Ringmark logo

Working with Facebook to develop the mobile web acid test suite.

Ringmark | Facebook

We worked with open source and standards engineers at Facebook in 2013 to develop a mobile web acid test suite to demonstrate what features facebook.com needed in order to work properly on the mobile web.

Web audio wrapper API control panel

Collaborated with the ChromeOS team to build a Web Audio API testing tool.

Web Audio Testing Tool | Google

The Chrome team engaged Bocoup to build a web application to exercise the full surface area of the Web Audio API so they could test their work.

Recent from the Blog

‘Can I Use…’, but for ARIA!

Three years ago we announced our work on the ARIA-AT program to develop an interoperability testing system for assistive technologies, starting with screen readers. Last…

Read more About ‘Can I Use…’, but for ARIA!

Introducing the Web Platform Contribution Guide

Many people in the web development community, including many of us at Bocoup, were drawn to the web because it appears to be a diverse…

Read more About Introducing the Web Platform Contribution Guide

Interoperability Testing for Assistive Technologies and The Web Platform

In 2018, we began contributing to ecosystem infrastructure for ARIA, the accessibility API for the web platform, with a project focused on regression testing for…

Read more About Interoperability Testing for Assistive Technologies and The Web Platform

Contact Us

We'd love to hear from you. Get in touch!

Mail

P.O. Box 961436
Boston, MA 02196