asv (airspeed-velocity) integration

[FFY00]

asv is a project that can run benchmarks and create a nice website with the results and comparisons to previous versions. I would be really nice if it was possible to use pytest-benchmark as the data provider, as it has a nicer API to write tests and is integrated with pytest.

One option would be to add support directly to pytest-benchmark, but this adds more weight for the maintainers and would maybe be better as a separate plugin.

#200 would allow us to more easily implement this, but for the time being, I was thinking about hijacking pytest_benchmark_generate_json to additionally generate the asv output. What do you think?

An asv plugin would need the following:

• A way to fetch the benchmark data, so that it can generate the asv output
• A way to customize the commit information (pytest_benchmark_generate_commit_info), because we may be running benchmarks for an external project and want to track its version/commit

[astrojuanlu]

@FFY00 Did you end up hacking something? There's a symmetric proposal at airspeed-velocity/asv#567

[FFY00]

I did not 😕