Welcome to the DataPerf Challenge!

Announcement Date: Jul. 22, 2022

Launch Date: TBD. Please register here if you are interested in participating.

About

We provide three example benchmarks to demonstrate how the DataPerf challenges operate in practice. These examples are referred to as reference implementations. The reference implementations highlight the most important elements of the benchmark. They do not guarantee their optimal performance. Rather, they serve as benchmark-compliant baselines and hence are a starting point for code reference.

Please note that these challenges are still in alpha stage and are under active development. Hence, the code at these repositories is not final. Please refer to our whitepaper for details here: [ PDF ]

• Speech Data Selection
• Vision Data Selection [Participating Guidelines]
• Vision Data Debugging [Participating Guidelines]

Watch our presentation about these challenges below. The corresponding slides can be found here.



If you are interested in participating in the challenges, please fill this form and we will get back to you!