2025-02-05 08:34.24: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (deca5287e35206850ec28880adae0705730115e9) (openbsd-amd64:openbsd-76-amd64-5.3_opam-2.3)
Base: openbsd-76-amd64-ocaml-5.3
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard deca5287
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM openbsd-76-amd64-ocaml-5.3
# openbsd-76-amd64-5.3_opam-2.3
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
RUN doas ln -f /usr/bin/opam-2.3 /usr/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
RUN cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam /home/opam/src/./
RUN opam pin add -yn multicore-bench.dev '/home/opam/src/./'
RUN echo '(lang dune 3.0)' > '/home/opam/src/./dune-project'
ENV DEPS="astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /home/opam/src
RUN cd /home/opam/src && opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2025-02-05 08:34.24: Using cache hint "ocaml-multicore/multicore-bench-openbsd-76-amd64-ocaml-5.3-openbsd-76-amd64-5.3_opam-2.3-bbdea2f49ee045baf858fda2a2111a8d"
2025-02-05 08:34.24: Using OBuilder spec:
((from openbsd-76-amd64-ocaml-5.3)
(comment openbsd-76-amd64-5.3_opam-2.3)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(run (shell "doas ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst /home/opam/src/./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev '/home/opam/src/./'"))
(run (network host)
(shell "echo '(lang dune 3.0)' > '/home/opam/src/./dune-project'"))
(env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /home/opam/src))
(run (shell "cd /home/opam/src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2025-02-05 08:34.24: Waiting for resource in pool OCluster
2025-02-05 09:38.12: Waiting for worker…
2025-02-05 12:17.13: Got resource from pool OCluster
Building on bremusa
All commits already cached
HEAD is now at deca528 Ignore results from ops on `ref` benchmarks
(from openbsd-76-amd64-ocaml-5.3)
2025-02-05 12:17.13 ---> using "753f998be4709b35e38a93b7272dee818f697255d5b48fadd1c23cb92a82f244" from cache
/: (comment openbsd-76-amd64-5.3_opam-2.3)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (run (shell "doas ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
2025-02-05 12:17.13 ---> using "b8621e22ceef6e45a2b70edd0350b6ec56c4cb2588ea75f8c24bf97f9bb8e3c1" from cache
/: (run (shell "opam init --reinit -ni"))
No configuration file found, using built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
2025-02-05 12:17.13 ---> using "caa4033b0f51d691107e536d025405bc96e59134e192afef776a8bfd43aac5e1" from cache
/: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
OpenBSD 7.6
The OCaml toplevel, version 5.3.0
2.3.0
2025-02-05 12:17.13 ---> using "7116693f695a70fbcc11fcbf90bc7fd32f30a6c20aabff3b1e1c926faaad9b01" from cache
/: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
f93eb7cb02..3ee951993d master -> origin/master
3ee951993d Merge pull request #27253 from kit-ty-kate/opam-publish-ocamlfind.1.9.8
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 12:17.13 ---> using "b197c49a2fa127333af86f9258cc0d44f8f7534990c7866247e403c2e122f354" from cache
/: (copy (src multicore-bench.opam) (dst /home/opam/src/./))
2025-02-05 12:18.10 ---> saved as "c0b0da25416f4009d5b5434bdc863d6a6f2bc1ddf755b1ead463f125a5253fb7"
/: (run (network host)
(shell "opam pin add -yn multicore-bench.dev '/home/opam/src/./'"))
[multicore-bench.dev] synchronised (file:///home/opam/src)
multicore-bench is now pinned to file:///home/opam/src (version dev)
2025-02-05 12:19.04 ---> saved as "8976d953498170024e2f8a8a77c2cf93acc50711187f7349c2a315fef475c1ea"
/: (run (network host)
(shell "echo '(lang dune 3.0)' > '/home/opam/src/./dune-project'"))
2025-02-05 12:20.02 ---> saved as "1866f90217c3dd658a8ff93db08487d6de2305ec1840e935e0335e7fb17e1259"
/: (env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/: (env CI true)
/: (env OCAMLCI true)
/: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
[WARNING] Unknown update command for bsd, skipping system update
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (file:///home/opam/src)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2025-02-05 12:21.09 ---> saved as "4e30ba55b0bcc6adeea935a8cff8d4bc8eb065a5e48cdbc8b49fcfbc4e34a1c2"
/: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.1
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.8.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.17.2
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.5.0
- install mtime 2.1.0
- install multicore-magic 2.3.1
- install ocaml-version 3.7.3
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.8
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved backoff.0.1.1 (cached)
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved cppo.1.8.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved mdx.2.5.0 (cached)
-> retrieved multicore-magic.2.3.1 (cached)
-> retrieved ocaml-version.3.7.3 (cached)
-> retrieved ocamlfind.1.9.8 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved re.1.12.0 (cached)
-> retrieved seq.base (cached)
-> retrieved result.1.5 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.17.2 (cached)
-> installed cmdliner.1.3.0
-> installed dune.3.17.2
-> installed ocamlbuild.0.15.0
-> installed backoff.0.1.1
-> installed camlp-streams.5.0.1
-> installed cppo.1.8.0
-> installed csexp.1.5.2
-> installed domain_shims.0.1.0
-> installed multicore-magic.2.3.1
-> installed ocaml-version.3.7.3
-> installed ocamlfind.1.9.8
-> installed result.1.5
-> installed seq.base
-> installed thread-table.1.0.0
-> installed re.1.12.0
-> installed domain-local-await.1.0.1
-> installed topkg.1.0.7
-> installed yojson.2.2.2
-> installed astring.0.8.5
-> installed fmt.0.9.0
-> installed mtime.2.1.0
-> installed logs.0.7.0
-> installed mdx.2.5.0
Done.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 12:31.02 ---> saved as "e51d5e70b21f75c8d37f6c065d83bc133919eec4a4f7e17aa233f3334bf09098"
/: (copy (src .) (dst /home/opam/src))
2025-02-05 12:31.45 ---> saved as "050d15b168e70918c90c8aee371e0dfc2013f1aecaeab525645f629e00e40b42"
/: (run (shell "cd /home/opam/src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
ops over time/cas int:
56.13 M/s
ops over time/get:
318.05 M/s
ops over time/incr:
82.37 M/s
ops over time/push & pop:
30.43 M/s
ops over time/swap:
45.86 M/s
ops over time/xchg int:
60.17 M/s
time per op/cas int:
17.81 ns
time per op/get:
3.14 ns
time per op/incr:
12.14 ns
time per op/push & pop:
32.86 ns
time per op/swap:
21.81 ns
time per op/xchg int:
16.62 ns
Atomic incr:
ops over time/CAS, 1 domains:
40.00 M/s
ops over time/CAS, 2 domains:
15.04 M/s
ops over time/CAS, 4 domains:
10.92 M/s
ops over time/CAS with backoff, 1 domains:
55.29 M/s
ops over time/CAS with backoff, 2 domains:
31.14 M/s
ops over time/CAS with backoff, 4 domains:
22.48 M/s
ops over time/Incr, 1 domains:
87.84 M/s
ops over time/Incr, 2 domains:
39.45 M/s
ops over time/Incr, 4 domains:
35.58 M/s
time per op/CAS, 1 domains:
25.00 ns
time per op/CAS, 2 domains:
132.94 ns
time per op/CAS, 4 domains:
366.24 ns
time per op/CAS with backoff, 1 domains:
18.09 ns
time per op/CAS with backoff, 2 domains:
64.22 ns
time per op/CAS with backoff, 4 domains:
177.92 ns
time per op/Incr, 1 domains:
11.38 ns
time per op/Incr, 2 domains:
50.70 ns
time per op/Incr, 4 domains:
112.43 ns
Bounded_q:
messages over time/1 adder, 1 taker:
2.53 M/s
messages over time/1 adder, 2 takers:
0.59 M/s
messages over time/2 adders, 1 taker:
2.39 M/s
messages over time/2 adders, 2 takers:
0.15 M/s
messages over time/one domain:
2.38 M/s
time per message/1 adder, 1 taker:
791.14 ns
time per message/1 adder, 2 takers:
5111.82 ns
time per message/2 adders, 1 taker:
1253.89 ns
time per message/2 adders, 2 takers:
27444.29 ns
time per message/one domain:
420.31 ns
Hashtbl:
operations over time/1 worker, 10% reads:
7.52 M/s
operations over time/1 worker, 50% reads:
7.57 M/s
operations over time/1 worker, 90% reads:
6.56 M/s
operations over time/2 workers, 10% reads:
2.13 M/s
operations over time/2 workers, 50% reads:
2.85 M/s
operations over time/2 workers, 90% reads:
3.07 M/s
operations over time/4 workers, 10% reads:
1.83 M/s
operations over time/4 workers, 50% reads:
1.76 M/s
operations over time/4 workers, 90% reads:
2.26 M/s
operations over time/8 workers, 10% reads:
1.21 M/s
operations over time/8 workers, 50% reads:
1.52 M/s
operations over time/8 workers, 90% reads:
2.04 M/s
operations over time/one domain, 10% reads:
14.72 M/s
operations over time/one domain, 50% reads:
16.45 M/s
operations over time/one domain, 90% reads:
20.70 M/s
time per operation/1 worker, 10% reads:
133.04 ns
time per operation/1 worker, 50% reads:
132.05 ns
time per operation/1 worker, 90% reads:
152.50 ns
time per operation/2 workers, 10% reads:
938.88 ns
time per operation/2 workers, 50% reads:
701.60 ns
time per operation/2 workers, 90% reads:
651.78 ns
time per operation/4 workers, 10% reads:
2189.93 ns
time per operation/4 workers, 50% reads:
2272.81 ns
time per operation/4 workers, 90% reads:
1771.44 ns
time per operation/8 workers, 10% reads:
6585.47 ns
time per operation/8 workers, 50% reads:
5279.37 ns
time per operation/8 workers, 90% reads:
3924.51 ns
time per operation/one domain, 10% reads:
67.92 ns
time per operation/one domain, 50% reads:
60.78 ns
time per operation/one domain, 90% reads:
48.30 ns
Queue:
messages over time/one domain:
24.53 M/s
time per message/one domain:
40.76 ns
Ref with Mutex:
ops over time/cas int:
12.71 M/s
ops over time/get:
13.08 M/s
ops over time/incr:
9.40 M/s
ops over time/push & pop:
6.84 M/s
ops over time/swap:
12.69 M/s
ops over time/xchg int:
12.07 M/s
time per op/cas int:
78.70 ns
time per op/get:
76.43 ns
time per op/incr:
106.38 ns
time per op/push & pop:
146.13 ns
time per op/swap:
78.79 ns
time per op/xchg int:
82.85 ns
Ref with [@poll error]:
ops over time/cas int:
101.30 M/s
ops over time/get:
355.08 M/s
ops over time/incr:
142.73 M/s
ops over time/push & pop:
30.40 M/s
ops over time/swap:
64.78 M/s
ops over time/xchg int:
97.50 M/s
time per op/cas int:
9.87 ns
time per op/get:
2.82 ns
time per op/incr:
7.01 ns
time per op/push & pop:
32.90 ns
time per op/swap:
15.44 ns
time per op/xchg int:
10.26 ns
Stack:
messages over time/one domain:
24.98 M/s
time per message/one domain:
40.04 ns
Unix:
blocking reads over time/1 worker:
0.39 M/s
blocking reads over time/2 workers:
0.78 M/s
blocking reads over time/4 workers:
1.25 M/s
time per blocking read/1 worker:
2535.72 ns
time per blocking read/2 workers:
2559.25 ns
time per blocking read/4 workers:
3207.60 ns
2025-02-05 12:34.31 ---> saved as "9451684b35d5a03ca05ef43e54c4ef49e07bde9dc99035b9b6650cb40c1c8559"
Job succeeded
2025-02-05 12:34.32: Job succeeded