Tue 16 Jul 2019 16:00 - 16:30 at Bouzy - Specialized Benchmarks and Future

Frequently state-of-the-art Android taint-analysis tools are upgraded and steadily novel tools become available. Benchmarks are the first choice to evaluate such upgraded or novel tools. However, as mature some of these tools are, the immature even the most employed benchmarks are. Most benchmarks are missing a precisely defined ground-truth, are generally deprecated and have never been updated since their on-demand creation.

To overcome these drawbacks, we developed ReproDroid, a framework to create, refine and automatically execute reproducible benchmarks for Android app analysis tools. Along with ReproDroid we could automatically compare analysis tools and thereby identify false promises made in benchmark evaluations and speed-up benchmark processes.

On this basis benchmarks could become more, namely challenges. Different communities already use challenges to compare existing and
novel analysis tools competitively and regularly. Thus, it is time to also boost the development of Android taint-analysis benchmarks and their associated tools by starting competitive challenges.

I am a PhD student in the Specification and Modelling of Software Systems research group at the Paderborn University in Germany. My research focuses on cooperative (static and dynamic) Android app analysis.

Links

Tue 16 Jul

benchwork-2019-papers
15:30 - 17:00: BenchWork - Specialized Benchmarks and Future at Bouzy
benchwork-2019-papers15:30 - 16:00
Talk
Hridesh RajanIowa State University
benchwork-2019-papers16:00 - 16:30
Talk
Felix PauckPaderborn University, Germany
Media Attached
benchwork-2019-papers16:30 - 17:00
Day closing
Kim HerzigTools for Software Engineers, Microsoft, Ben HermannPaderborn University