2025-02-05 08:34.24: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (deca5287e35206850ec28880adae0705730115e9) (linux-x86_64:debian-12-5.0_opam-2.3)
Base: ocaml/opam:debian-12-ocaml-5.0@sha256:b76c766bee396852c25d4b17148c2c695483eba5904a1515808a576bc92c07f0
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard deca5287
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM ocaml/opam:debian-12-ocaml-5.0@sha256:b76c766bee396852c25d4b17148c2c695483eba5904a1515808a576bc92c07f0
# debian-12-5.0_opam-2.3
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
WORKDIR /src
RUN sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
WORKDIR /src
RUN sudo chown opam /src
RUN cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./
RUN opam pin add -yn multicore-bench.dev './'
RUN echo '(lang dune 3.0)' > './dune-project'
ENV DEPS="astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.0.0 ocaml-base-compiler.5.0.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /src
RUN opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2025-02-05 08:34.24: Using cache hint "ocaml-multicore/multicore-bench-ocaml/opam:debian-12-ocaml-5.0@sha256:b76c766bee396852c25d4b17148c2c695483eba5904a1515808a576bc92c07f0-debian-12-5.0_opam-2.3-3f540c6ef9d7142ee3bd28bbc24273aa"
2025-02-05 08:34.24: Using OBuilder spec:
((from ocaml/opam:debian-12-ocaml-5.0@sha256:b76c766bee396852c25d4b17148c2c695483eba5904a1515808a576bc92c07f0)
(comment debian-12-5.0_opam-2.3)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(workdir /src)
(run (shell "sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(workdir /src)
(run (shell "sudo chown opam /src"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
(run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
(env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.0.0 ocaml-base-compiler.5.0.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /src))
(run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2025-02-05 08:34.24: Waiting for resource in pool OCluster
2025-02-05 11:04.47: Waiting for worker…
2025-02-05 11:08.19: Got resource from pool OCluster
Building on phoebe.caelum.ci.dev
All commits already cached
HEAD is now at deca528 Ignore results from ops on `ref` benchmarks
(from ocaml/opam:debian-12-ocaml-5.0@sha256:b76c766bee396852c25d4b17148c2c695483eba5904a1515808a576bc92c07f0)
2025-02-05 11:08.20 ---> using "810efee3cf583c9f1c39146a67e6881f77bdf5162f874b2f96caa8c7358148f6" from cache
/: (comment debian-12-5.0_opam-2.3)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (workdir /src)
/src: (run (shell "sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
2025-02-05 11:08.20 ---> using "0ef660b0f17c4f56349af07d651289e5fba1745eb57cc4d471ec59c81ba16d12" from cache
/src: (run (shell "opam init --reinit -ni"))
Configuring from /home/opam/.opamrc and then from built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This development version of opam requires an update to the layout of /home/opam/.opam from version 2.0 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
[NOTE] The 'jobs' option was reset, its value was 39 and its new value will vary according to the current number of cores on your machine. You can restore the fixed value using:
opam option jobs=39 --global
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
2025-02-05 11:08.20 ---> using "7bec2f6f2999bdcfd2f1ee4c47a378838362e853c4907d29c853c7014ae07bcc" from cache
/src: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Linux 5.15.0-131-generic
The OCaml toplevel, version 5.0.0
2.3.0
2025-02-05 11:08.20 ---> using "a341da5be79535bb7972bf5db9a3fd7a3450a5dff3fac8bbca4610969d93319f" from cache
/src: (workdir /src)
/src: (run (shell "sudo chown opam /src"))
2025-02-05 11:08.20 ---> using "0174626be44927b0b490b049a79201ad915319691d2452a298fe92ecb230d64e" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 3ee951993de4d18fd335fcea4ac7375cab56a637 || git fetch origin master) && git reset -q --hard 3ee951993de4d18fd335fcea4ac7375cab56a637 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
3e681a81f6..bb41a3bfcc master -> origin/master
3ee951993d Merge pull request #27253 from kit-ty-kate/opam-publish-ocamlfind.1.9.8
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 11:08.20 ---> using "d0b48a69911f6bf1cf393b3e37b88b10e173363697bbe329ff584426648a1e81" from cache
/src: (copy (src multicore-bench.opam) (dst ./))
2025-02-05 11:08.20 ---> saved as "0f40b2be6347dd8a95bbf49665671d994388e309c653e0170914c084990ac91c"
/src: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
[multicore-bench.dev] synchronised (file:///src)
multicore-bench is now pinned to file:///src (version dev)
2025-02-05 11:08.24 ---> saved as "dd4388e613951376ba7fd15bdbae3928044c8ef780a5c5ad8dd4e91996fbfd94"
/src: (run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
2025-02-05 11:08.24 ---> saved as "c082123f8c4629cb76b64999b45254a0a255d6dea0838c86e7195b6db9d5f4f5"
/src: (env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.2 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.5.0.0 ocaml-base-compiler.5.0.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.8 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/src: (env CI true)
/src: (env OCAMLCI true)
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
+ /usr/bin/sudo "apt-get" "update"
- Hit:1 http://deb.debian.org/debian bookworm InRelease
- Get:2 http://deb.debian.org/debian bookworm-updates InRelease [55.4 kB]
- Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]
- Get:4 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [243 kB]
- Fetched 346 kB in 1s (397 kB/s)
- Reading package lists...
-
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (file:///src)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.0.0).
[NOTE] Package ocaml is already installed (current version is 5.0.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2025-02-05 11:08.52 ---> saved as "69104b26cdadc4829b44457dcd0944bf5b71b9699aabcce7235109cc54704bbb"
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.0.0).
[NOTE] Package ocaml is already installed (current version is 5.0.0).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.1
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.8.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.17.2
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.5.0
- install mtime 2.1.0
- install multicore-magic 2.3.1
- install ocaml-version 3.7.3
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.8
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved backoff.0.1.1 (cached)
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved cppo.1.8.0 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved mdx.2.5.0 (cached)
-> retrieved multicore-magic.2.3.1 (cached)
-> retrieved ocaml-version.3.7.3 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved ocamlfind.1.9.8 (cached)
-> retrieved re.1.12.0 (cached)
-> retrieved seq.base (cached)
-> installed seq.base
-> retrieved result.1.5 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.17.2 (cached)
-> installed cmdliner.1.3.0
-> installed ocamlfind.1.9.8
-> installed ocamlbuild.0.15.0
-> installed topkg.1.0.7
-> installed mtime.2.1.0
-> installed fmt.0.9.0
-> installed astring.0.8.5
-> installed logs.0.7.0
-> installed dune.3.17.2
-> installed domain_shims.0.1.0
-> installed backoff.0.1.1
-> installed result.1.5
-> installed thread-table.1.0.0
-> installed csexp.1.5.2
-> installed ocaml-version.3.7.3
-> installed multicore-magic.2.3.1
-> installed camlp-streams.5.0.1
-> installed domain-local-await.1.0.1
-> installed cppo.1.8.0
-> installed re.1.12.0
-> installed yojson.2.2.2
-> installed mdx.2.5.0
Done.
# To update the current shell environment, run: eval $(opam env)
2025-02-05 11:11.24 ---> saved as "8ebe95d5d7b9a25be7bd72b51ed95167bcac0777caa9d3f18533be15948150ba"
/src: (copy (src .) (dst /src))
2025-02-05 11:11.24 ---> saved as "350a7fef873e7f784d10bcfa8e758d4e6ceaf58c76bf74a060904a2d2f24cf2c"
/src: (run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
ops over time/cas int:
24.90 M/s
ops over time/get:
152.73 M/s
ops over time/incr:
70.91 M/s
ops over time/push & pop:
6.26 M/s
ops over time/swap:
8.85 M/s
ops over time/xchg int:
30.05 M/s
time per op/cas int:
40.17 ns
time per op/get:
6.55 ns
time per op/incr:
14.10 ns
time per op/push & pop:
159.66 ns
time per op/swap:
113.05 ns
time per op/xchg int:
33.27 ns
Atomic incr:
ops over time/CAS, 1 domains:
27.97 M/s
ops over time/CAS, 2 domains:
25.10 M/s
ops over time/CAS, 4 domains:
9.18 M/s
ops over time/CAS, 8 domains:
3.78 M/s
ops over time/CAS with backoff, 1 domains:
49.16 M/s
ops over time/CAS with backoff, 2 domains:
49.72 M/s
ops over time/CAS with backoff, 4 domains:
9.46 M/s
ops over time/CAS with backoff, 8 domains:
4.68 M/s
ops over time/Incr, 1 domains:
73.70 M/s
ops over time/Incr, 2 domains:
18.14 M/s
ops over time/Incr, 4 domains:
20.29 M/s
ops over time/Incr, 8 domains:
6.64 M/s
time per op/CAS, 1 domains:
35.75 ns
time per op/CAS, 2 domains:
79.69 ns
time per op/CAS, 4 domains:
435.78 ns
time per op/CAS, 8 domains:
2118.25 ns
time per op/CAS with backoff, 1 domains:
20.34 ns
time per op/CAS with backoff, 2 domains:
40.23 ns
time per op/CAS with backoff, 4 domains:
422.75 ns
time per op/CAS with backoff, 8 domains:
1709.23 ns
time per op/Incr, 1 domains:
13.57 ns
time per op/Incr, 2 domains:
110.23 ns
time per op/Incr, 4 domains:
197.18 ns
time per op/Incr, 8 domains:
1204.42 ns
Bounded_q:
messages over time/1 adder, 1 taker:
2.24 M/s
messages over time/1 adder, 2 takers:
1.03 M/s
messages over time/1 adder, 4 takers:
0.40 M/s
messages over time/2 adders, 1 taker:
3.55 M/s
messages over time/2 adders, 2 takers:
3.09 M/s
messages over time/2 adders, 4 takers:
1.22 M/s
messages over time/4 adders, 1 taker:
1.80 M/s
messages over time/4 adders, 2 takers:
1.58 M/s
messages over time/4 adders, 4 takers:
1.53 M/s
messages over time/one domain:
1.69 M/s
time per message/1 adder, 1 taker:
892.89 ns
time per message/1 adder, 2 takers:
2922.32 ns
time per message/1 adder, 4 takers:
12493.55 ns
time per message/2 adders, 1 taker:
844.10 ns
time per message/2 adders, 2 takers:
1295.15 ns
time per message/2 adders, 4 takers:
4906.21 ns
time per message/4 adders, 1 taker:
2773.13 ns
time per message/4 adders, 2 takers:
3806.44 ns
time per message/4 adders, 4 takers:
5225.71 ns
time per message/one domain:
592.03 ns
Hashtbl:
operations over time/1 worker, 10% reads:
3.69 M/s
operations over time/1 worker, 50% reads:
4.32 M/s
operations over time/1 worker, 90% reads:
3.32 M/s
operations over time/2 workers, 10% reads:
3.48 M/s
operations over time/2 workers, 50% reads:
3.81 M/s
operations over time/2 workers, 90% reads:
4.14 M/s
operations over time/4 workers, 10% reads:
2.76 M/s
operations over time/4 workers, 50% reads:
3.42 M/s
operations over time/4 workers, 90% reads:
3.37 M/s
operations over time/8 workers, 10% reads:
1.98 M/s
operations over time/8 workers, 50% reads:
2.14 M/s
operations over time/8 workers, 90% reads:
2.49 M/s
operations over time/one domain, 10% reads:
6.20 M/s
operations over time/one domain, 50% reads:
4.75 M/s
operations over time/one domain, 90% reads:
7.76 M/s
time per operation/1 worker, 10% reads:
271.06 ns
time per operation/1 worker, 50% reads:
231.60 ns
time per operation/1 worker, 90% reads:
301.32 ns
time per operation/2 workers, 10% reads:
574.79 ns
time per operation/2 workers, 50% reads:
524.50 ns
time per operation/2 workers, 90% reads:
483.45 ns
time per operation/4 workers, 10% reads:
1451.59 ns
time per operation/4 workers, 50% reads:
1168.04 ns
time per operation/4 workers, 90% reads:
1185.60 ns
time per operation/8 workers, 10% reads:
4042.59 ns
time per operation/8 workers, 50% reads:
3734.54 ns
time per operation/8 workers, 90% reads:
3213.97 ns
time per operation/one domain, 10% reads:
161.33 ns
time per operation/one domain, 50% reads:
210.35 ns
time per operation/one domain, 90% reads:
128.92 ns
Queue:
messages over time/one domain:
18.74 M/s
time per message/one domain:
53.37 ns
Ref with Mutex:
ops over time/cas int:
4.53 M/s
ops over time/get:
5.19 M/s
ops over time/incr:
5.17 M/s
ops over time/push & pop:
3.15 M/s
ops over time/swap:
4.12 M/s
ops over time/xchg int:
4.62 M/s
time per op/cas int:
220.55 ns
time per op/get:
192.80 ns
time per op/incr:
193.45 ns
time per op/push & pop:
317.32 ns
time per op/swap:
242.66 ns
time per op/xchg int:
216.40 ns
Ref with [@poll error]:
ops over time/cas int:
37.14 M/s
ops over time/get:
135.57 M/s
ops over time/incr:
188.11 M/s
ops over time/push & pop:
6.11 M/s
ops over time/swap:
11.98 M/s
ops over time/xchg int:
91.24 M/s
time per op/cas int:
26.92 ns
time per op/get:
7.38 ns
time per op/incr:
5.32 ns
time per op/push & pop:
163.79 ns
time per op/swap:
83.48 ns
time per op/xchg int:
10.96 ns
Stack:
messages over time/one domain:
21.79 M/s
time per message/one domain:
45.90 ns
Unix:
blocking reads over time/1 worker:
0.44 M/s
blocking reads over time/2 workers:
0.61 M/s
blocking reads over time/4 workers:
0.84 M/s
time per blocking read/1 worker:
2298.80 ns
time per blocking read/2 workers:
3299.59 ns
time per blocking read/4 workers:
4764.19 ns
2025-02-05 11:13.13 ---> saved as "362bc0c8048bb29a5a335743439844632e0ae74a491864494fcc7a90b4844e22"
Job succeeded
2025-02-05 11:13.14: Job succeeded