2025-02-05 08:34.24: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (deca5287e35206850ec28880adae0705730115e9) (macos-arm64:macos-homebrew-5.3_arm64_opam-2.3)
Base: macos-homebrew-ocaml-5.3
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard deca5287
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM macos-homebrew-ocaml-5.3
# macos-homebrew-5.3_arm64_opam-2.3
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
RUN ln -f ~/local/bin/opam-2.3 ~/local/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
RUN cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./src/./
RUN opam pin add -yn multicore-bench.dev './src/./'
RUN echo '(lang dune 3.0)' > './src/./dune-project'
ENV DEPS="astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . ./src
RUN cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2025-02-05 08:34.24: Using cache hint "ocaml-multicore/multicore-bench-macos-homebrew-ocaml-5.3-macos-homebrew-5.3_arm64_opam-2.3-bbdea2f49ee045baf858fda2a2111a8d"
2025-02-05 08:34.24: Using OBuilder spec:
((from macos-homebrew-ocaml-5.3)
(comment macos-homebrew-5.3_arm64_opam-2.3)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(run (shell "ln -f ~/local/bin/opam-2.3 ~/local/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./src/./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './src/./'"))
(run (network host)
(shell "echo '(lang dune 3.0)' > './src/./dune-project'"))
(env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst ./src))
(run (shell "cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2025-02-05 08:34.24: Waiting for resource in pool OCluster
2025-02-05 10:00.37: Waiting for worker…
2025-02-05 13:17.14: Got resource from pool OCluster
Building on m1-worker-03
HEAD is now at c4f3be5 Bench and test with OCaml 5.3 and drop <5.2.1 from Windows tests
HEAD is now at deca528 Ignore results from ops on `ref` benchmarks
(from macos-homebrew-ocaml-5.3)
2025-02-05 13:17.15 ---> using "6ee950b55569b1a3f8a7953dc679318bf303d3a70ac7d49901c0ac2ca3805d7c" from cache
/: (comment macos-homebrew-5.3_arm64_opam-2.3)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (run (shell "ln -f ~/local/bin/opam-2.3 ~/local/bin/opam"))
2025-02-05 13:17.15 ---> using "8efc335cb5004a650aab29e72b9849a2b2e2f0853bc55d3a74763c7cceed5d74" from cache
/: (run (shell "opam init --reinit -ni"))
No configuration file found, using built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This version of opam requires an update to the layout of /Users/mac1000/.opam from version 2.1 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
[NOTE] The 'jobs' option was reset, its value was 1 and its new value will vary according to the current number of cores on your machine. You can restore the fixed value using:
opam option jobs=1 --global
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] no changes from git+file:///Users/mac1000/opam-repository
2025-02-05 13:17.15 ---> using "e29fa6de89fe919799ac81fd4a1c768d8341cedf873c17042854467d2aebeceb" from cache
/: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Darwin 23.4.0
The OCaml toplevel, version 5.3.0
2.3.0
2025-02-05 13:17.15 ---> using "a268524b45b0c90a951719c2a6c8c78c0b8a0fec90c9f437befd49b0008dc673" from cache
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
f93eb7cb02..3ee951993d master -> origin/master
3ee951993d Merge pull request #27253 from kit-ty-kate/opam-publish-ocamlfind.1.9.8
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from git+file:///Users/mac1000/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
The following packages are not being upgraded because the new versions conflict with other installed packages:
- ocaml.5.4.0
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 13:17.15 ---> using "a1cad0881881595cdc1653ba1b51b2989dd649c9b74b79e4cbb697413cf6129f" from cache
/: (copy (src multicore-bench.opam) (dst ./src/./))
2025-02-05 13:17.16 ---> saved as "dca758399a7f3da3a90d76bc09db3e2eccce4e92ad197b6ad4f84bafa02f0dbe"
/: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './src/./'"))
[multicore-bench.dev] synchronised (file:///Users/mac1000/src)
multicore-bench is now pinned to file:///Users/mac1000/src (version dev)
2025-02-05 13:17.31 ---> saved as "b8035e934e94dcabe52b022b72f1b933fe709ca8308756899935e8fa187a9fc3"
/: (run (network host)
(shell "echo '(lang dune 3.0)' > './src/./dune-project'"))
2025-02-05 13:17.32 ---> saved as "ed9677767225e6783459bd33e802307ef3aca4cf89ca4ba2f22f3a7c0781a53c"
/: (env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-effects.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.3.0 ocaml-base-compiler.5.3.0 ocaml-compiler.5.3.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/: (env CI true)
/: (env OCAMLCI true)
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
+ /opt/homebrew/bin/brew "update"
- ==> Updating Homebrew...
- ==> Downloading https://ghcr.io/v2/homebrew/portable-ruby/portable-ruby/blobs/sha256:d9faa506c014dedc0b034a68103ba75c9a58242f4d6c67b6ca0f649c39602bcf
- Already downloaded: /Users/mac1000/Library/Caches/Homebrew/portable-ruby-3.3.7.arm64_big_sur.bottle.tar.gz
- ==> Pouring portable-ruby-3.3.7.arm64_big_sur.bottle.tar.gz
- ==> Homebrew collects anonymous analytics.
- Read the analytics documentation (and how to opt-out) here:
- https://docs.brew.sh/Analytics
- No analytics have been recorded yet (nor will be during this `brew` run).
-
- ==> Homebrew is run entirely by unpaid volunteers. Please consider donating:
- https://github.com/Homebrew/brew#donations
-
- Already up-to-date.
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (file:///Users/mac1000/src)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2025-02-05 13:17.54 ---> saved as "68ba5edc7291554a037464966c3a48df113b7ca4159c50804f1016dceeb03857"
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.3.0).
[NOTE] Package ocaml is already installed (current version is 5.3.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-effects is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.1
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.8.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.17.2
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.5.0
- install mtime 2.1.0
- install multicore-magic 2.3.1
- install ocaml-version 3.7.3
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.8
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved backoff.0.1.1 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved cppo.1.8.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved multicore-magic.2.3.1 (cached)
-> retrieved mdx.2.5.0 (cached)
-> retrieved ocaml-version.3.7.3 (cached)
-> retrieved ocamlfind.1.9.8 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved result.1.5 (cached)
-> retrieved seq.base (cached)
-> installed seq.base
-> retrieved re.1.12.0 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.17.2 (cached)
-> installed cmdliner.1.3.0
-> installed ocamlfind.1.9.8
-> installed ocamlbuild.0.15.0
-> installed topkg.1.0.7
-> installed mtime.2.1.0
-> installed fmt.0.9.0
-> installed astring.0.8.5
-> installed logs.0.7.0
-> installed dune.3.17.2
-> installed domain_shims.0.1.0
-> installed csexp.1.5.2
-> installed backoff.0.1.1
-> installed ocaml-version.3.7.3
-> installed camlp-streams.5.0.1
-> installed multicore-magic.2.3.1
-> installed result.1.5
-> installed thread-table.1.0.0
-> installed cppo.1.8.0
-> installed domain-local-await.1.0.1
-> installed re.1.12.0
-> installed yojson.2.2.2
-> installed mdx.2.5.0
Done.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 13:18.33 ---> saved as "ff12a36916c4a0c25f9a6756a679f8d8df36b2d29b0dd5ead1252697e67275eb"
/: (copy (src .) (dst ./src))
2025-02-05 13:18.34 ---> saved as "aff7704d4cd82987fb079704e6f4fd405a56e9cdd9b3480ad4df80819f8743d1"
/: (run (shell "cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
ops over time/cas int:
140.92 M/s
ops over time/get:
604.42 M/s
ops over time/incr:
135.75 M/s
ops over time/push & pop:
92.27 M/s
ops over time/swap:
97.74 M/s
ops over time/xchg int:
165.97 M/s
time per op/cas int:
7.10 ns
time per op/get:
1.65 ns
time per op/incr:
7.37 ns
time per op/push & pop:
10.84 ns
time per op/swap:
10.23 ns
time per op/xchg int:
6.03 ns
Atomic incr:
ops over time/CAS, 1 domains:
128.99 M/s
ops over time/CAS, 2 domains:
30.46 M/s
ops over time/CAS, 4 domains:
12.24 M/s
ops over time/CAS, 8 domains:
6.23 M/s
ops over time/CAS with backoff, 1 domains:
134.69 M/s
ops over time/CAS with backoff, 2 domains:
125.94 M/s
ops over time/CAS with backoff, 4 domains:
97.39 M/s
ops over time/CAS with backoff, 8 domains:
59.18 M/s
ops over time/Incr, 1 domains:
135.44 M/s
ops over time/Incr, 2 domains:
53.40 M/s
ops over time/Incr, 4 domains:
26.50 M/s
ops over time/Incr, 8 domains:
19.66 M/s
time per op/CAS, 1 domains:
7.75 ns
time per op/CAS, 2 domains:
65.66 ns
time per op/CAS, 4 domains:
326.73 ns
time per op/CAS, 8 domains:
1284.79 ns
time per op/CAS with backoff, 1 domains:
7.42 ns
time per op/CAS with backoff, 2 domains:
15.88 ns
time per op/CAS with backoff, 4 domains:
41.08 ns
time per op/CAS with backoff, 8 domains:
135.19 ns
time per op/Incr, 1 domains:
7.38 ns
time per op/Incr, 2 domains:
37.45 ns
time per op/Incr, 4 domains:
150.92 ns
time per op/Incr, 8 domains:
406.97 ns
Bounded_q:
messages over time/1 adder, 1 taker:
10.52 M/s
messages over time/1 adder, 2 takers:
2.89 M/s
messages over time/1 adder, 4 takers:
4.98 M/s
messages over time/2 adders, 1 taker:
2.18 M/s
messages over time/2 adders, 2 takers:
9.18 M/s
messages over time/2 adders, 4 takers:
5.31 M/s
messages over time/4 adders, 1 taker:
9.50 M/s
messages over time/4 adders, 2 takers:
7.20 M/s
messages over time/4 adders, 4 takers:
5.84 M/s
messages over time/one domain:
19.07 M/s
time per message/1 adder, 1 taker:
190.15 ns
time per message/1 adder, 2 takers:
1039.75 ns
time per message/1 adder, 4 takers:
1004.08 ns
time per message/2 adders, 1 taker:
1377.01 ns
time per message/2 adders, 2 takers:
435.53 ns
time per message/2 adders, 4 takers:
1129.96 ns
time per message/4 adders, 1 taker:
526.07 ns
time per message/4 adders, 2 takers:
832.81 ns
time per message/4 adders, 4 takers:
1369.07 ns
time per message/one domain:
52.45 ns
Hashtbl:
operations over time/1 worker, 10% reads:
23.11 M/s
operations over time/1 worker, 50% reads:
22.55 M/s
operations over time/1 worker, 90% reads:
29.86 M/s
operations over time/2 workers, 10% reads:
8.99 M/s
operations over time/2 workers, 50% reads:
9.14 M/s
operations over time/2 workers, 90% reads:
12.66 M/s
operations over time/4 workers, 10% reads:
9.32 M/s
operations over time/4 workers, 50% reads:
9.53 M/s
operations over time/4 workers, 90% reads:
12.57 M/s
operations over time/8 workers, 10% reads:
5.45 M/s
operations over time/8 workers, 50% reads:
5.63 M/s
operations over time/8 workers, 90% reads:
7.51 M/s
operations over time/one domain, 10% reads:
36.03 M/s
operations over time/one domain, 50% reads:
35.53 M/s
operations over time/one domain, 90% reads:
52.07 M/s
time per operation/1 worker, 10% reads:
43.27 ns
time per operation/1 worker, 50% reads:
44.34 ns
time per operation/1 worker, 90% reads:
33.49 ns
time per operation/2 workers, 10% reads:
222.51 ns
time per operation/2 workers, 50% reads:
218.74 ns
time per operation/2 workers, 90% reads:
158.01 ns
time per operation/4 workers, 10% reads:
428.97 ns
time per operation/4 workers, 50% reads:
419.69 ns
time per operation/4 workers, 90% reads:
318.29 ns
time per operation/8 workers, 10% reads:
1467.78 ns
time per operation/8 workers, 50% reads:
1420.98 ns
time per operation/8 workers, 90% reads:
1065.46 ns
time per operation/one domain, 10% reads:
27.75 ns
time per operation/one domain, 50% reads:
28.14 ns
time per operation/one domain, 90% reads:
19.21 ns
Queue:
messages over time/one domain:
52.84 M/s
time per message/one domain:
18.92 ns
Ref with Mutex:
ops over time/cas int:
56.23 M/s
ops over time/get:
63.15 M/s
ops over time/incr:
63.16 M/s
ops over time/push & pop:
52.11 M/s
ops over time/swap:
56.04 M/s
ops over time/xchg int:
56.22 M/s
time per op/cas int:
17.78 ns
time per op/get:
15.84 ns
time per op/incr:
15.83 ns
time per op/push & pop:
19.19 ns
time per op/swap:
17.84 ns
time per op/xchg int:
17.79 ns
Ref with [@poll error]:
ops over time/cas int:
157.75 M/s
ops over time/get:
1237.28 M/s
ops over time/incr:
481.92 M/s
ops over time/push & pop:
99.67 M/s
ops over time/swap:
103.23 M/s
ops over time/xchg int:
154.53 M/s
time per op/cas int:
6.34 ns
time per op/get:
0.81 ns
time per op/incr:
2.08 ns
time per op/push & pop:
10.03 ns
time per op/swap:
9.69 ns
time per op/xchg int:
6.47 ns
Stack:
messages over time/one domain:
61.29 M/s
time per message/one domain:
16.32 ns
Unix:
blocking reads over time/1 worker:
2.63 M/s
blocking reads over time/2 workers:
4.26 M/s
blocking reads over time/4 workers:
3.00 M/s
time per blocking read/1 worker:
379.85 ns
time per blocking read/2 workers:
469.02 ns
time per blocking read/4 workers:
1333.28 ns
2025-02-05 13:18.42 ---> saved as "a0e61a0c318c0d827bb1ed35800c054c0bfc7373300ed47d1e4369bcfa44ca71"
Job succeeded
2025-02-05 13:18.48: Job succeeded