Build History for branch/main

Ignore results from ops on `ref` benchmarks This prevents the `get` op from being optimized away and makes some other operations also more realistic.

Bench and test with OCaml 5.3 and drop <5.2.1 from Windows tests

Upgrade to ocamlformat 0.27.0

Release notes for 0.1.7

Ensure `sherlodoc` is installed when generating docs

Move private function used only once out of module scope

Avoid `include` of modules

`s/a require/require a/`

Updated changes

Add a scalable `Countdown` counter

Use a loop to reduce code size

Port to 4.12

Release notes for 0.1.6

Fail when benchmark results have duplicates

More careful error handling and finalization Errors raised from benchmark callbacks should now properly stop the timing and backtrace should be preserved.

Add a naïve bounded queue benchmark

Add a benchmark of atomic increments

Release notes for 0.1.4

Test on 5.2.0 on Windows on CI

Automatically filter benchmarks to run by given diff base file This makes it more convenient to run diffs against only specific benchmarks.

Randomize the order of benchmark suites by default The intention behind this is to try to account for things that might put the runtime into a state where it has major effects on specific benchmarks. After randomizing, we should see variation from run to run rather than e.g. having the potential effects only shown in specific suites.

Fix tests to pass on FreeBSD

Release notes for 0.1.3

Use a more flexible signature for `Metric.make`

More flexible typing

Use `^` instead of `+` in documentation for string concatenation

Add `Metric.make` to support ad hoc metrics

Upgrade ocamlformat from `0.26.1` to `0.26.2`

Bench on 5.2.x

Avoid duplication

Use `replace` instead of `add` This is more in line with with other benchmarks of hash tables

Add `Hashtbl` benchmark

Link to benchmarks on Picos

Add a minimalist `Unix` IO benchmark

Link to benchmarks on `pascal`

Prepare for `summer`

Implement brief output as diff to self

Add brief current-bench configuration instructions

Release notes for 0.1.2

Release notes for 0.1.2

Use 256-color ANSI color gradients for better/worse results

Link to `bench` directory

Add `-brief` output mode This is useful as the output mode when running a benchmark executable as a test and the JSON output is just too much.

Add note on `wrap`

Add link to benchmarks

Add benchmarks of some `Stdlib` data structures

Require `sherlodoc` for searchable documentation

Add support for `wrap`ping the `work` without timing `wrap` itself The `wrap` function can be e.g. used to install effect handlers. This also tweaks the internal implementation of `Times.record` to try to minimize memory use, allocations, and false sharing as much as possible.

Auto resetting single word barrier

Add `-diff base.json` switch to diff against base results from file

Release notes for 0.1.1

Add `-debug` flag/mode to help debug benchmarks By default all the benchmarks are run and the results collected before any output is produced. This can make it difficult to determine which benchmark is causing problems in case of bugs. The `-debug` flag/mode is supposed to help debug benchmarks by printing some progress information.

Keep earliest start time per domain This is important on OCaml 4 where we use domain-shims, which uses systhreads to emulate domains. What can happen with systhreads, in particular, is that one or more systhreads may run for a long time or even complete their work before other systhreads get a change to run. The timings captured on different workers are then (more or less) sequential rather than parallel as assumed by the calculation of time per operation (latency) and total thruput.

Wordsmithing

Reformat and correct phrase

Add initial documentation and simplify API This drops the public APIs to manipulate times and statistics as those are likely to change.

Add optional argument to neglect `domain_local_await`

Require latest version of DLA with bug fixes

No need to take `Float.abs` before squaring Thanks to @lyrm for noticing this.

Drop `backoff` dependency

Add GH action to test on Windows

By default run an extra (busy) domain when `n_domains = 1` The OCaml runtime has a number of special cases when running only a single domain. When benchmarking multicore abstractions we probably don't want to benchmark those special cases except in special cases.

Support running an extra (busy) domain

Avoid spawning an extra domain

Install polling DLA on every domain

Add `Util.generate_push_and_pop_sequence` for benchmarking queues

API reference link