sed_eval is an open source Python toolbox which provides a standardized, and transparent way to evaluate sound event detection systems.In addition to this, it provides tools for evaluating acoustic scene classification systems as well as audio tagging.

Toolbox can be installed easily from PyPI with pip: 

pip install sed_eval

More information how to use the toolbox can be found from the online documentation.

If you use sed_eval in a research project, please cite the following paper:

Annamaria Mesaros, Toni Heittola, and Tuomas Virtanen, “Metrics for polyphonic sound event detection”, Applied Sciences, 6(6):162, 2016