2024-09-01 14:13.40: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (298c5d1e24da82a9640825ef4a68b9aef88daaca) (linux-x86_64:(lower-bound))
Base: ocaml/opam:debian-12-ocaml-4.13@sha256:a3da3c524a9eaefadecdecc2161e1a6423dc5278ed342a5af049393270919fa8
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard 298c5d1e
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM ocaml/opam:debian-12-ocaml-4.13@sha256:a3da3c524a9eaefadecdecc2161e1a6423dc5278ed342a5af049393270919fa8
# debian-12-4.13_opam-2.2
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
WORKDIR /src
RUN sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
WORKDIR /src
RUN sudo chown opam /src
RUN cd ~/opam-repository && (git cat-file -e 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 || git fetch origin master) && git reset -q --hard 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./
RUN opam pin add -yn multicore-bench.dev './'
ENV DEPS="astring.0.8.5 backoff.0.1.0 base-bigarray.base base-bytes.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.1.0 cppo.1.6.1 csexp.1.3.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.14.0 fmt.0.8.7 host-arch-x86_64.1 host-system-other.1 jbuilder.1.0+beta20.1 logs.0.7.0 mdx.2.4.0 mtime.2.0.0 multicore-magic.2.1.0 ocaml.4.13.1 ocaml-base-compiler.4.13.1 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.2.4.0 ocamlbuild.0.14.0 ocamlfind.1.9.1 re.1.7.2 result.1.5 seq.0.2.2 stdlib-shims.0.1.0 thread-table.1.0.0 topkg.1.0.3 yojson.2.1.0"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /src
RUN opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2024-09-01 14:13.40: Using cache hint "ocaml-multicore/multicore-bench-ocaml/opam:debian-12-ocaml-4.13@sha256:a3da3c524a9eaefadecdecc2161e1a6423dc5278ed342a5af049393270919fa8-debian-12-4.13_opam-2.2-edb58df4953bee9664f135a25e0e0271"
2024-09-01 14:13.40: Using OBuilder spec:
((from ocaml/opam:debian-12-ocaml-4.13@sha256:a3da3c524a9eaefadecdecc2161e1a6423dc5278ed342a5af049393270919fa8)
(comment debian-12-4.13_opam-2.2)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(workdir /src)
(run (shell "sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(workdir /src)
(run (shell "sudo chown opam /src"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 || git fetch origin master) && git reset -q --hard 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
(env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-bytes.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.1.0 cppo.1.6.1 csexp.1.3.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.14.0 fmt.0.8.7 host-arch-x86_64.1 host-system-other.1 jbuilder.1.0+beta20.1 logs.0.7.0 mdx.2.4.0 mtime.2.0.0 multicore-magic.2.1.0 ocaml.4.13.1 ocaml-base-compiler.4.13.1 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.2.4.0 ocamlbuild.0.14.0 ocamlfind.1.9.1 re.1.7.2 result.1.5 seq.0.2.2 stdlib-shims.0.1.0 thread-table.1.0.0 topkg.1.0.3 yojson.2.1.0")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /src))
(run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2024-09-01 14:13.40: Waiting for resource in pool OCluster
2024-09-01 16:38.19: Waiting for worker…
2024-09-01 16:41.26: Got resource from pool OCluster
Building on x86-bm-c12.sw.ocaml.org
All commits already cached
HEAD is now at 298c5d1 Add a naïve bounded queue benchmark
(from ocaml/opam:debian-12-ocaml-4.13@sha256:a3da3c524a9eaefadecdecc2161e1a6423dc5278ed342a5af049393270919fa8)
2024-09-01 16:41.26 ---> using "3f780e6a721096052e39abdde102bc9ff199077eebd22a6187825d0e718fab89" from cache
/: (comment debian-12-4.13_opam-2.2)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (workdir /src)
/src: (run (shell "sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam"))
2024-09-01 16:41.26 ---> using "e5285b91aec6f565e898a05e4e2a519ff4d661bb6a400449dabdb31bf07ee1a5" from cache
/src: (run (shell "opam init --reinit -ni"))
Configuring from /home/opam/.opamrc and then from built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This development version of opam requires an update to the layout of /home/opam/.opam from version 2.0 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
2024-09-01 16:41.26 ---> using "2e4c193793d788d6073018372d255f76453eaccf5c34cc598997a1e615af66f8" from cache
/src: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Linux 5.15.0-119-generic
The OCaml toplevel, version 4.13.1
2.2.1
2024-09-01 16:41.26 ---> using "82b5eaacb8d2dca26a1a328a4cbad2ee73f80f47a2422fec18772bafed0c46c3" from cache
/src: (workdir /src)
/src: (run (shell "sudo chown opam /src"))
2024-09-01 16:41.26 ---> using "8cfe220373fd93974d5580b3cdbf05f836521b43dd9dde83bdb1bf46fdbe4748" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 || git fetch origin master) && git reset -q --hard 2c6ced5ce1aa21f25fbb395652fb1b3b30c9d5d5 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
e89899ac28..8187cd8d36 master -> origin/master
2c6ced5ce1 Merge pull request #26448 from avsm/upper-mdx
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# Run eval $(opam env) to update the current shell environment
2024-09-01 16:41.26 ---> using "ba8c14e075ea2cf07483e84ad742ebf11dc058ed66bd5ea83b692a16aad845c4" from cache
/src: (copy (src multicore-bench.opam) (dst ./))
2024-09-01 16:41.26 ---> saved as "c69609088725b347a38510365f39010c7d709266f145bca9949209a8a109acb6"
/src: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
[multicore-bench.dev] synchronised (file:///src)
multicore-bench is now pinned to file:///src (version dev)
2024-09-01 16:41.29 ---> saved as "165eb2a7276245087736b295e5ba7b44806e5794bd7be0d846956556dd4035e9"
/src: (env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-bytes.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.1.0 cppo.1.6.1 csexp.1.3.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.14.0 fmt.0.8.7 host-arch-x86_64.1 host-system-other.1 jbuilder.1.0+beta20.1 logs.0.7.0 mdx.2.4.0 mtime.2.0.0 multicore-magic.2.1.0 ocaml.4.13.1 ocaml-base-compiler.4.13.1 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.2.4.0 ocamlbuild.0.14.0 ocamlfind.1.9.1 re.1.7.2 result.1.5 seq.0.2.2 stdlib-shims.0.1.0 thread-table.1.0.0 topkg.1.0.3 yojson.2.1.0")
/src: (env CI true)
/src: (env OCAMLCI true)
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
+ /usr/bin/sudo "apt-get" "update"
- Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB]
- Get:2 http://deb.debian.org/debian bookworm-updates InRelease [55.4 kB]
- Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]
- Get:4 http://deb.debian.org/debian bookworm/main amd64 Packages [8787 kB]
- Get:5 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [179 kB]
- Fetched 9221 kB in 2s (5058 kB/s)
- Reading package lists...
-
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (no changes)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 2).
[NOTE] Package ocaml-base-compiler is already installed (current version is 4.13.1).
[NOTE] Package ocaml is already installed (current version is 4.13.1).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2024-09-01 16:41.59 ---> saved as "10ff7a7f1425ddb2c11ea5853bc159030e0541c6a861adcde293812410280b92"
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 2).
[NOTE] Package ocaml-base-compiler is already installed (current version is 4.13.1).
[NOTE] Package ocaml is already installed (current version is 4.13.1).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 26 packages
- install astring 0.8.5
- install backoff 0.1.0
- install base-bytes base
- install camlp-streams 5.0.1
- install cmdliner 1.1.0
- install cppo 1.6.1
- install csexp 1.3.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.14.0
- install fmt 0.8.7
- install jbuilder 1.0+beta20.1
- install logs 0.7.0
- install mdx 2.4.0
- install mtime 2.0.0
- install multicore-magic 2.1.0
- install ocaml-version 2.4.0
- install ocamlbuild 0.14.0
- install ocamlfind 1.9.1
- install re 1.7.2
- install result 1.5
- install seq 0.2.2
- install stdlib-shims 0.1.0
- install thread-table 1.0.0
- install topkg 1.0.3
- install yojson 2.1.0
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved backoff.0.1.0 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved cmdliner.1.1.0 (cached)
-> retrieved cppo.1.6.1 (cached)
-> retrieved csexp.1.3.2 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved fmt.0.8.7 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved jbuilder.1.0+beta20.1 (cached)
-> retrieved mdx.2.4.0 (cached)
-> retrieved mtime.2.0.0 (cached)
-> retrieved ocaml-version.2.4.0 (cached)
-> retrieved ocamlbuild.0.14.0 (cached)
-> retrieved ocamlfind.1.9.1 (cached)
-> retrieved re.1.7.2 (cached)
-> retrieved result.1.5 (cached)
-> retrieved seq.0.2.2 (cached)
-> retrieved stdlib-shims.0.1.0 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.3 (cached)
-> retrieved multicore-magic.2.1.0 (https://github.com/ocaml-multicore/multicore-magic/releases/download/2.1.0/multicore-magic-2.1.0.tbz)
-> retrieved yojson.2.1.0 (https://github.com/ocaml-community/yojson/releases/download/2.1.0/yojson-2.1.0.tbz)
-> retrieved dune.3.14.0 (https://github.com/ocaml/dune/releases/download/3.14.0/dune-3.14.0.tbz)
-> installed cmdliner.1.1.0
-> installed ocamlfind.1.9.1
-> installed base-bytes.base
-> installed ocamlbuild.0.14.0
-> installed jbuilder.1.0+beta20.1
-> installed cppo.1.6.1
-> installed re.1.7.2
-> installed topkg.1.0.3
-> installed mtime.2.0.0
-> installed astring.0.8.5
-> installed dune.3.14.0
-> installed domain_shims.0.1.0
-> installed stdlib-shims.0.1.0
-> installed result.1.5
-> installed thread-table.1.0.0
-> installed multicore-magic.2.1.0
-> installed backoff.0.1.0
-> installed camlp-streams.5.0.1
-> installed seq.0.2.2
-> installed ocaml-version.2.4.0
-> installed csexp.1.3.2
-> installed domain-local-await.1.0.1
-> installed fmt.0.8.7
-> installed yojson.2.1.0
-> installed logs.0.7.0
-> installed mdx.2.4.0
Done.
# Run eval $(opam env) to update the current shell environment
2024-09-01 16:43.26 ---> saved as "bcb452df0a9fbc89908f68734cc5e1bf37f9406781def5b92b48b39897060747"
/src: (copy (src .) (dst /src))
2024-09-01 16:43.26 ---> saved as "204065c7fb0a280463b141ceac190047c547001452910160c1b8506f98a0ab2e"
/src: (run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
time per op/get:
3.12 ns
ops over time/get:
320.74 M/s
time per op/incr:
5.91 ns
ops over time/incr:
169.11 M/s
time per op/push & pop:
33.02 ns
ops over time/push & pop:
30.29 M/s
time per op/cas int:
11.19 ns
ops over time/cas int:
89.36 M/s
time per op/xchg int:
10.89 ns
ops over time/xchg int:
91.83 M/s
time per op/swap:
20.62 ns
ops over time/swap:
48.51 M/s
Atomic incr:
time per op/CAS, 1 domains:
10.34 ns
ops over time/CAS, 1 domains:
96.69 M/s
time per op/CAS with backoff, 1 domains:
11.21 ns
ops over time/CAS with backoff, 1 domains:
89.21 M/s
time per op/Incr, 1 domains:
5.55 ns
ops over time/Incr, 1 domains:
180.24 M/s
Bounded_q:
time per message/one domain:
244.03 ns
messages over time/one domain:
4.10 M/s
Hashtbl:
time per operation/one domain, 10% reads:
90.32 ns
operations over time/one domain, 10% reads:
11.07 M/s
time per operation/one domain, 50% reads:
90.82 ns
operations over time/one domain, 50% reads:
11.01 M/s
time per operation/one domain, 90% reads:
83.64 ns
operations over time/one domain, 90% reads:
11.96 M/s
time per operation/1 worker, 10% reads:
171.02 ns
operations over time/1 worker, 10% reads:
5.85 M/s
time per operation/2 workers, 10% reads:
345.61 ns
operations over time/2 workers, 10% reads:
5.79 M/s
time per operation/4 workers, 10% reads:
686.41 ns
operations over time/4 workers, 10% reads:
5.83 M/s
time per operation/8 workers, 10% reads:
1437.65 ns
operations over time/8 workers, 10% reads:
5.56 M/s
time per operation/1 worker, 50% reads:
172.14 ns
operations over time/1 worker, 50% reads:
5.81 M/s
time per operation/2 workers, 50% reads:
339.06 ns
operations over time/2 workers, 50% reads:
5.90 M/s
time per operation/4 workers, 50% reads:
694.99 ns
operations over time/4 workers, 50% reads:
5.76 M/s
time per operation/8 workers, 50% reads:
1410.20 ns
operations over time/8 workers, 50% reads:
5.67 M/s
time per operation/1 worker, 90% reads:
154.78 ns
operations over time/1 worker, 90% reads:
6.46 M/s
time per operation/2 workers, 90% reads:
321.38 ns
operations over time/2 workers, 90% reads:
6.22 M/s
time per operation/4 workers, 90% reads:
626.73 ns
operations over time/4 workers, 90% reads:
6.38 M/s
time per operation/8 workers, 90% reads:
1282.73 ns
operations over time/8 workers, 90% reads:
6.24 M/s
Queue:
time per message/one domain:
41.71 ns
messages over time/one domain:
23.98 M/s
Ref with Mutex:
time per op/get:
81.03 ns
ops over time/get:
12.34 M/s
time per op/incr:
81.79 ns
ops over time/incr:
12.23 M/s
time per op/push & pop:
93.40 ns
ops over time/push & pop:
10.71 M/s
time per op/cas int:
87.49 ns
ops over time/cas int:
11.43 M/s
time per op/xchg int:
86.98 ns
ops over time/xchg int:
11.50 M/s
time per op/swap:
92.00 ns
ops over time/swap:
10.87 M/s
Ref with [@poll error]:
time per op/get:
3.27 ns
ops over time/get:
305.90 M/s
time per op/incr:
5.23 ns
ops over time/incr:
191.20 M/s
time per op/push & pop:
32.58 ns
ops over time/push & pop:
30.70 M/s
time per op/cas int:
11.49 ns
ops over time/cas int:
87.02 M/s
time per op/xchg int:
11.41 ns
ops over time/xchg int:
87.67 M/s
time per op/swap:
20.96 ns
ops over time/swap:
47.71 M/s
Stack:
time per message/one domain:
44.17 ns
messages over time/one domain:
22.64 M/s
Unix:
time per blocking read/1 worker:
1584.94 ns
blocking reads over time/1 worker:
0.63 M/s
2024-09-01 16:43.30 ---> saved as "143efb77de0910c87f5084bc6e100b4f53a31dad1a40851e16ed498bee6f9315"
Job succeeded
2024-09-01 16:43.30: Job succeeded