2025-01-21 15:55.17: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/ignore-results-from-ops-on-ref-bench (fcbc847459c7b0a57aed81d20eeda373202e0c2c) (freebsd-x86_64:freebsd-14.1-5.3_opam-2.3)
Base: freebsd-14.1-ocaml-5.3
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "ignore-results-from-ops-on-ref-bench" && cd "multicore-bench" && git reset --hard fcbc8474
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM freebsd-14.1-ocaml-5.3
# freebsd-14.1-5.3_opam-2.3
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
WORKDIR /src
RUN sudo ln -f /usr/local/bin/opam-2.3 /usr/local/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
WORKDIR /src
RUN sudo chown opam /src
RUN cd ~/opam-repository && (git cat-file -e da383c8610c72e3b8a92e6327148910d1d81cd57 || git fetch origin master) && git reset -q --hard da383c8610c72e3b8a92e6327148910d1d81cd57 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./
RUN opam pin add -yn multicore-bench.dev './'
RUN echo '(lang dune 3.0)' > './dune-project'
ENV DEPS="astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /src
RUN opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2025-01-21 15:55.17: Using cache hint "ocaml-multicore/multicore-bench-freebsd-14.1-ocaml-5.3-freebsd-14.1-5.3_opam-2.3-371af18bf17f57d0742a0bdd3f06aae0"
2025-01-21 15:55.17: Using OBuilder spec:
((from freebsd-14.1-ocaml-5.3)
(comment freebsd-14.1-5.3_opam-2.3)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(workdir /src)
(run (shell "sudo ln -f /usr/local/bin/opam-2.3 /usr/local/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(workdir /src)
(run (shell "sudo chown opam /src"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e da383c8610c72e3b8a92e6327148910d1d81cd57 || git fetch origin master) && git reset -q --hard da383c8610c72e3b8a92e6327148910d1d81cd57 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
(run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
(env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /src))
(run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2025-01-21 15:55.17: Waiting for resource in pool OCluster
2025-01-21 15:55.17: Waiting for worker…
2025-01-21 15:55.21: Got resource from pool OCluster
Building on summer
HEAD is now at 276f98e Ignore results from ops on `ref` benchmarks
HEAD is now at fcbc847 Ignore results from ops on `ref` benchmarks
(from freebsd-14.1-ocaml-5.3)
2025-01-21 15:47.17 ---> using "fa4c65a721275037aa0f851d49090cd38fc202c0147147d39fba5c0e4d9b16e6" from cache
/: (comment freebsd-14.1-5.3_opam-2.3)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (workdir /src)
/src: (run (shell "sudo ln -f /usr/local/bin/opam-2.3 /usr/local/bin/opam"))
2025-01-21 15:47.17 ---> using "707c7e294765dd0c27e269a5b580560b225237a2f86c98e49e9b55231281b700" from cache
/src: (run (shell "opam init --reinit -ni"))
No configuration file found, using built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This version of opam requires an update to the layout of /home/opam/.opam from version 2.1 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
[NOTE] The 'jobs' option was reset, its value was 1 and its new value will vary according to the current number of cores on your machine. You can restore the fixed value using:
opam option jobs=1 --global
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] no changes from git+file:///home/opam/opam-repository
2025-01-21 15:47.18 ---> using "45749df81b3980750ffa6bca410a05b72322147ab2725b654dada75710103de9" from cache
/src: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
FreeBSD 14.1-RELEASE-p5
The OCaml toplevel, version 5.3.0
2.3.0
2025-01-21 15:47.18 ---> using "f64bb7c3e303337c7ff569b67d81a7b6dbef733cbc8fc2ef78eebdda8d34b5e9" from cache
/src: (workdir /src)
/src: (run (shell "sudo chown opam /src"))
2025-01-21 15:47.19 ---> using "b5dd81919ce8bb132a9ebf4541726236220f50fa3e495f7f25632fce1e88b154" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e da383c8610c72e3b8a92e6327148910d1d81cd57 || git fetch origin master) && git reset -q --hard da383c8610c72e3b8a92e6327148910d1d81cd57 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
f93eb7cb02..da383c8610 master -> origin/master
da383c8610 Merge pull request #27275 from xavierleroy/maintenance-intent
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from git+file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
The following packages are not being upgraded because the new versions conflict with other installed packages:
- ocaml.5.4.0
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
2025-01-21 15:47.19 ---> using "dfd823d36066430f3691efabc1cd6fe72c8c6acb0216729540797faeabbf8f94" from cache
/src: (copy (src multicore-bench.opam) (dst ./))
2025-01-21 15:47.20 ---> using "fdea677d2375a8d9850b9118abac6e63961cc804aae8bb89a593f03bbfd0ccb5" from cache
/src: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
[multicore-bench.dev] synchronised (file:///src)
multicore-bench is now pinned to file:///src (version dev)
2025-01-21 15:47.20 ---> using "b6a74a8a8ee7eda853b5b9d020aa59c1a3ce51d3f25cd76e8c7dfc0364afdffd" from cache
/src: (run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
2025-01-21 15:47.21 ---> using "6093bae2dd7b22d0deb2d017fcaf55c09ee4228f25df8ce1964ff21ead7bd966" from cache
/src: (env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/src: (env CI true)
/src: (env OCAMLCI true)
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
[WARNING] Unknown update command for bsd, skipping system update
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (file:///src)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2025-01-21 15:47.21 ---> using "0761698af1e7a2ff0ca6d68573cacb63679811eb188fd65ed99cedc47b56b012" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
∗ astring 0.8.5
∗ backoff 0.1.1
∗ camlp-streams 5.0.1
∗ cmdliner 1.3.0
∗ cppo 1.8.0
∗ csexp 1.5.2
∗ domain-local-await 1.0.1
∗ domain_shims 0.1.0
∗ dune 3.17.1
∗ fmt 0.9.0
∗ logs 0.7.0
∗ mdx 2.5.0
∗ mtime 2.1.0
∗ multicore-magic 2.3.1
∗ ocaml-version 3.7.3
∗ ocamlbuild 0.15.0
∗ ocamlfind 1.9.6
∗ re 1.12.0
∗ result 1.5
∗ seq base
∗ thread-table 1.0.0
∗ topkg 1.0.7
∗ yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
⬇ retrieved astring.0.8.5 (cached)
⬇ retrieved camlp-streams.5.0.1 (cached)
⬇ retrieved cmdliner.1.3.0 (cached)
⬇ retrieved csexp.1.5.2 (cached)
⬇ retrieved cppo.1.8.0 (cached)
⬇ retrieved domain-local-await.1.0.1 (cached)
⬇ retrieved domain_shims.0.1.0 (cached)
⬇ retrieved backoff.0.1.1 (cached)
⬇ retrieved fmt.0.9.0 (cached)
⬇ retrieved logs.0.7.0 (cached)
⬇ retrieved mdx.2.5.0 (cached)
⬇ retrieved mtime.2.1.0 (cached)
⬇ retrieved multicore-magic.2.3.1 (cached)
⬇ retrieved ocaml-version.3.7.3 (cached)
⬇ retrieved ocamlbuild.0.15.0 (cached)
⬇ retrieved re.1.12.0 (cached)
⬇ retrieved ocamlfind.1.9.6 (cached)
⬇ retrieved seq.base (cached)
∗ installed seq.base
⬇ retrieved thread-table.1.0.0 (cached)
⬇ retrieved result.1.5 (cached)
⬇ retrieved topkg.1.0.7 (cached)
⬇ retrieved dune.3.17.1 (cached)
⬇ retrieved yojson.2.2.2 (cached)
∗ installed cmdliner.1.3.0
∗ installed ocamlfind.1.9.6
∗ installed ocamlbuild.0.15.0
∗ installed topkg.1.0.7
∗ installed mtime.2.1.0
∗ installed fmt.0.9.0
∗ installed astring.0.8.5
∗ installed logs.0.7.0
∗ installed dune.3.17.1
∗ installed thread-table.1.0.0
∗ installed result.1.5
∗ installed ocaml-version.3.7.3
∗ installed multicore-magic.2.3.1
∗ installed domain_shims.0.1.0
∗ installed csexp.1.5.2
∗ installed cppo.1.8.0
∗ installed camlp-streams.5.0.1
∗ installed backoff.0.1.1
∗ installed re.1.12.0
∗ installed domain-local-await.1.0.1
∗ installed yojson.2.2.2
∗ installed mdx.2.5.0
Done.
2025-01-21 15:47.21 ---> using "286eb5fa2d39273446fca787bb7fed0b3ad6f9cda2122f8051238f8e696c1de1" from cache
/src: (copy (src .) (dst /src))
2025-01-21 15:47.41 ---> saved as "54dd30e322913928a8ad5ed27a2763891b53887fc1c8f3d94ec3bcfeb2402d2e"
/src: (run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
ops over time/cas int:
45.37 M/s
ops over time/get:
309.90 M/s
ops over time/incr:
62.39 M/s
ops over time/push & pop:
23.29 M/s
ops over time/swap:
28.53 M/s
ops over time/xchg int:
49.55 M/s
time per op/cas int:
22.04 ns
time per op/get:
3.23 ns
time per op/incr:
16.03 ns
time per op/push & pop:
42.94 ns
time per op/swap:
35.05 ns
time per op/xchg int:
20.18 ns
Atomic incr:
ops over time/CAS, 1 domains:
43.27 M/s
ops over time/CAS, 2 domains:
9.21 M/s
ops over time/CAS, 4 domains:
5.77 M/s
ops over time/CAS, 8 domains:
4.42 M/s
ops over time/CAS with backoff, 1 domains:
43.08 M/s
ops over time/CAS with backoff, 2 domains:
33.76 M/s
ops over time/CAS with backoff, 4 domains:
30.25 M/s
ops over time/CAS with backoff, 8 domains:
25.88 M/s
ops over time/Incr, 1 domains:
67.08 M/s
ops over time/Incr, 2 domains:
30.47 M/s
ops over time/Incr, 4 domains:
32.11 M/s
ops over time/Incr, 8 domains:
29.23 M/s
time per op/CAS, 1 domains:
23.11 ns
time per op/CAS, 2 domains:
217.08 ns
time per op/CAS, 4 domains:
693.16 ns
time per op/CAS, 8 domains:
1808.87 ns
time per op/CAS with backoff, 1 domains:
23.21 ns
time per op/CAS with backoff, 2 domains:
59.23 ns
time per op/CAS with backoff, 4 domains:
132.25 ns
time per op/CAS with backoff, 8 domains:
309.14 ns
time per op/Incr, 1 domains:
14.91 ns
time per op/Incr, 2 domains:
65.64 ns
time per op/Incr, 4 domains:
124.56 ns
time per op/Incr, 8 domains:
273.70 ns
Bounded_q:
messages over time/1 adder, 1 taker:
2.47 M/s
messages over time/1 adder, 2 takers:
1.69 M/s
messages over time/1 adder, 4 takers:
0.74 M/s
messages over time/2 adders, 1 taker:
2.16 M/s
messages over time/2 adders, 2 takers:
1.80 M/s
messages over time/2 adders, 4 takers:
1.26 M/s
messages over time/4 adders, 1 taker:
2.66 M/s
messages over time/4 adders, 2 takers:
1.96 M/s
messages over time/4 adders, 4 takers:
0.72 M/s
messages over time/one domain:
5.49 M/s
time per message/1 adder, 1 taker:
809.50 ns
time per message/1 adder, 2 takers:
1774.07 ns
time per message/1 adder, 4 takers:
6776.42 ns
time per message/2 adders, 1 taker:
1389.07 ns
time per message/2 adders, 2 takers:
2218.81 ns
time per message/2 adders, 4 takers:
4756.86 ns
time per message/4 adders, 1 taker:
1879.04 ns
time per message/4 adders, 2 takers:
3068.54 ns
time per message/4 adders, 4 takers:
11171.05 ns
time per message/one domain:
182.03 ns
Hashtbl:
operations over time/1 worker, 10% reads:
4.73 M/s
operations over time/1 worker, 50% reads:
7.54 M/s
operations over time/1 worker, 90% reads:
5.65 M/s
operations over time/2 workers, 10% reads:
2.59 M/s
operations over time/2 workers, 50% reads:
3.45 M/s
operations over time/2 workers, 90% reads:
3.76 M/s
operations over time/4 workers, 10% reads:
2.19 M/s
operations over time/4 workers, 50% reads:
2.44 M/s
operations over time/4 workers, 90% reads:
3.05 M/s
operations over time/8 workers, 10% reads:
1.54 M/s
operations over time/8 workers, 50% reads:
1.89 M/s
operations over time/8 workers, 90% reads:
2.44 M/s
operations over time/one domain, 10% reads:
9.22 M/s
operations over time/one domain, 50% reads:
8.36 M/s
operations over time/one domain, 90% reads:
10.46 M/s
time per operation/1 worker, 10% reads:
211.62 ns
time per operation/1 worker, 50% reads:
132.68 ns
time per operation/1 worker, 90% reads:
176.99 ns
time per operation/2 workers, 10% reads:
773.16 ns
time per operation/2 workers, 50% reads:
580.02 ns
time per operation/2 workers, 90% reads:
532.21 ns
time per operation/4 workers, 10% reads:
1823.31 ns
time per operation/4 workers, 50% reads:
1641.23 ns
time per operation/4 workers, 90% reads:
1312.29 ns
time per operation/8 workers, 10% reads:
5202.59 ns
time per operation/8 workers, 50% reads:
4227.20 ns
time per operation/8 workers, 90% reads:
3276.94 ns
time per operation/one domain, 10% reads:
108.51 ns
time per operation/one domain, 50% reads:
119.59 ns
time per operation/one domain, 90% reads:
95.56 ns
Queue:
messages over time/one domain:
14.97 M/s
time per message/one domain:
66.78 ns
Ref with Mutex:
ops over time/cas int:
10.59 M/s
ops over time/get:
12.09 M/s
ops over time/incr:
9.93 M/s
ops over time/push & pop:
10.68 M/s
ops over time/swap:
10.43 M/s
ops over time/xchg int:
10.85 M/s
time per op/cas int:
94.42 ns
time per op/get:
82.72 ns
time per op/incr:
100.70 ns
time per op/push & pop:
93.59 ns
time per op/swap:
95.84 ns
time per op/xchg int:
92.17 ns
Ref with [@poll error]:
ops over time/cas int:
75.95 M/s
ops over time/get:
279.05 M/s
ops over time/incr:
215.05 M/s
ops over time/push & pop:
28.37 M/s
ops over time/swap:
39.89 M/s
ops over time/xchg int:
78.52 M/s
time per op/cas int:
13.17 ns
time per op/get:
3.58 ns
time per op/incr:
4.65 ns
time per op/push & pop:
35.25 ns
time per op/swap:
25.07 ns
time per op/xchg int:
12.74 ns
Stack:
messages over time/one domain:
17.40 M/s
time per message/one domain:
57.48 ns
Unix:
blocking reads over time/1 worker:
1.12 M/s
blocking reads over time/2 workers:
2.53 M/s
blocking reads over time/4 workers:
4.90 M/s
time per blocking read/1 worker:
895.00 ns
time per blocking read/2 workers:
789.71 ns
time per blocking read/4 workers:
816.39 ns
2025-01-21 15:48.29 ---> saved as "c6f99f811e87227fbd2eba82d6a59d6da001a62a85e9f23ac1c129f35dfce702"
Job succeeded
2025-01-21 16:00.30: Job succeeded