2024-09-11 13:30.32: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (298c5d1e24da82a9640825ef4a68b9aef88daaca) (linux-x86_64:ubuntu-20.04-5.2_opam-2.2)
Base: ocaml/opam:ubuntu-20.04-ocaml-5.2@sha256:3cb224d0c4191527facab6ef0e1fd6e70dbccb45b3c172785e97975e2921f529
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard 298c5d1e
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM ocaml/opam:ubuntu-20.04-ocaml-5.2@sha256:3cb224d0c4191527facab6ef0e1fd6e70dbccb45b3c172785e97975e2921f529
# ubuntu-20.04-5.2_opam-2.2
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
WORKDIR /src
RUN sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
WORKDIR /src
RUN sudo chown opam /src
RUN cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./
RUN opam pin add -yn multicore-bench.dev './'
ENV DEPS="astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /src
RUN opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2024-09-11 13:30.32: Using cache hint "ocaml-multicore/multicore-bench-ocaml/opam:ubuntu-20.04-ocaml-5.2@sha256:3cb224d0c4191527facab6ef0e1fd6e70dbccb45b3c172785e97975e2921f529-ubuntu-20.04-5.2_opam-2.2-d9562627ca46d81389ea05095b6dc868"
2024-09-11 13:30.32: Using OBuilder spec:
((from ocaml/opam:ubuntu-20.04-ocaml-5.2@sha256:3cb224d0c4191527facab6ef0e1fd6e70dbccb45b3c172785e97975e2921f529)
(comment ubuntu-20.04-5.2_opam-2.2)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(workdir /src)
(run (shell "sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(workdir /src)
(run (shell "sudo chown opam /src"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
(env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /src))
(run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2024-09-11 13:30.32: Waiting for resource in pool OCluster
2024-09-11 14:05.09: Waiting for worker…
2024-09-11 14:10.20: Got resource from pool OCluster
Building on x86-bm-c9.sw.ocaml.org
All commits already cached
HEAD is now at 298c5d1 Add a naïve bounded queue benchmark
(from ocaml/opam:ubuntu-20.04-ocaml-5.2@sha256:3cb224d0c4191527facab6ef0e1fd6e70dbccb45b3c172785e97975e2921f529)
2024-09-11 14:10.36 ---> saved as "39367f9505917995f9eaff72c8f1d1ce0d11606421d94b0d83720370dbefbf28"
/: (comment ubuntu-20.04-5.2_opam-2.2)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (workdir /src)
/src: (run (shell "sudo ln -f /usr/bin/opam-2.2 /usr/bin/opam"))
2024-09-11 14:10.36 ---> saved as "c2a28c12f1ea91b4310f48b1cf9124539226240f1f7da99eaf1abfbf31087f6a"
/src: (run (shell "opam init --reinit -ni"))
Configuring from /home/opam/.opamrc and then from built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This development version of opam requires an update to the layout of /home/opam/.opam from version 2.0 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
2024-09-11 14:12.07 ---> saved as "22ddbf4574ac6824a51143d28f872bae296c7675b8179b749a1e70f8a80ab715"
/src: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Linux 5.15.0-119-generic
The OCaml toplevel, version 5.2.0
2.2.1
2024-09-11 14:12.07 ---> saved as "63e9c38447539f3ee7f853a010016292a5ff598b7ce59b8a3f5f3bce3c89a087"
/src: (workdir /src)
/src: (run (shell "sudo chown opam /src"))
2024-09-11 14:12.07 ---> saved as "d8cc961303e9079d36b84b6562761396eb80a34d6c87ba203a9c5bd93ec659a3"
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
e89899ac28..0329818dcf master -> origin/master
0329818dcf Merge pull request #26527 from dbuenzli/b0-publish-mtime.2.1.0-etc-b00ab5a8b3cb608d
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# Run eval $(opam env) to update the current shell environment
2024-09-11 14:13.18 ---> saved as "d4488668638af5d7e3ce48d5a752a8a122c88a6ae9557d03d3c0749ae0b6c93d"
/src: (copy (src multicore-bench.opam) (dst ./))
2024-09-11 14:13.18 ---> saved as "d544a30ff8bf562b25ec0fe34655c97b443df389a7491c63513f6ba276a5f63c"
/src: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
[multicore-bench.dev] synchronised (file:///src)
multicore-bench is now pinned to file:///src (version dev)
2024-09-11 14:13.21 ---> saved as "b183a2c9f8ab578d62838dcef671a8c6e2a4e10d3a862cb0b53eb634037d99a1"
/src: (env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/src: (env CI true)
/src: (env OCAMLCI true)
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
+ /usr/bin/sudo "apt-get" "update"
- Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease
- Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB]
- Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease
- Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB]
- Get:5 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [33.5 kB]
- Get:6 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [4098 kB]
- Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1557 kB]
- Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [4419 kB]
- Get:9 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1271 kB]
- Get:10 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [30.9 kB]
- Get:11 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3957 kB]
- Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3946 kB]
- Fetched 19.6 MB in 2s (10.1 MB/s)
- Reading package lists...
-
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (no changes)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.2.0).
[NOTE] Package ocaml is already installed (current version is 5.2.0).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2024-09-11 14:13.54 ---> saved as "89b016858d1b50e2703f072b26d42cc30e92864fecd293eb0a55435e66127f88"
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.2.0).
[NOTE] Package ocaml is already installed (current version is 5.2.0).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.0
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.7.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.16.0
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.4.1
- install mtime 2.1.0
- install multicore-magic 2.3.0
- install ocaml-version 3.6.8
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.6
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved backoff.0.1.0 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved cppo.1.7.0 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved multicore-magic.2.3.0 (cached)
-> retrieved mdx.2.4.1 (cached)
-> retrieved ocaml-version.3.6.8 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved ocamlfind.1.9.6 (cached)
-> retrieved re.1.12.0 (cached)
-> retrieved seq.base (cached)
-> installed seq.base
-> retrieved result.1.5 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.16.0 (cached)
-> installed cmdliner.1.3.0
-> installed ocamlfind.1.9.6
-> installed ocamlbuild.0.15.0
-> installed topkg.1.0.7
-> installed mtime.2.1.0
-> installed fmt.0.9.0
-> installed astring.0.8.5
-> installed logs.0.7.0
-> installed dune.3.16.0
-> installed domain_shims.0.1.0
-> installed csexp.1.5.2
-> installed backoff.0.1.0
-> installed result.1.5
-> installed ocaml-version.3.6.8
-> installed thread-table.1.0.0
-> installed multicore-magic.2.3.0
-> installed camlp-streams.5.0.1
-> installed domain-local-await.1.0.1
-> installed re.1.12.0
-> installed cppo.1.7.0
-> installed yojson.2.2.2
-> installed mdx.2.4.1
Done.
# Run eval $(opam env) to update the current shell environment
2024-09-11 14:15.30 ---> saved as "9b2e2e0874c9c83f6572869658e7abc85ed8c0e33785949b5e0222abfbc1d059"
/src: (copy (src .) (dst /src))
2024-09-11 14:15.30 ---> saved as "c054f120102c570cbee0e8dd8ba46bf50f76d423c34c451fb34e860fb74160b7"
/src: (run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
time per op/get:
2.97 ns
ops over time/get:
337.17 M/s
time per op/incr:
11.88 ns
ops over time/incr:
84.18 M/s
time per op/push & pop:
48.01 ns
ops over time/push & pop:
20.83 M/s
time per op/cas int:
15.64 ns
ops over time/cas int:
63.92 M/s
time per op/xchg int:
15.80 ns
ops over time/xchg int:
63.29 M/s
time per op/swap:
23.14 ns
ops over time/swap:
43.21 M/s
Atomic incr:
time per op/CAS, 1 domains:
16.56 ns
ops over time/CAS, 1 domains:
60.40 M/s
time per op/CAS, 2 domains:
150.90 ns
ops over time/CAS, 2 domains:
13.25 M/s
time per op/CAS, 4 domains:
326.56 ns
ops over time/CAS, 4 domains:
12.25 M/s
time per op/CAS, 8 domains:
1024.07 ns
ops over time/CAS, 8 domains:
7.81 M/s
time per op/CAS with backoff, 1 domains:
24.11 ns
ops over time/CAS with backoff, 1 domains:
41.47 M/s
time per op/CAS with backoff, 2 domains:
37.60 ns
ops over time/CAS with backoff, 2 domains:
53.19 M/s
time per op/CAS with backoff, 4 domains:
86.15 ns
ops over time/CAS with backoff, 4 domains:
46.43 M/s
time per op/CAS with backoff, 8 domains:
1083.73 ns
ops over time/CAS with backoff, 8 domains:
7.38 M/s
time per op/Incr, 1 domains:
11.58 ns
ops over time/Incr, 1 domains:
86.37 M/s
time per op/Incr, 2 domains:
50.59 ns
ops over time/Incr, 2 domains:
39.54 M/s
time per op/Incr, 4 domains:
78.46 ns
ops over time/Incr, 4 domains:
50.98 M/s
time per op/Incr, 8 domains:
477.44 ns
ops over time/Incr, 8 domains:
16.76 M/s
Bounded_q:
time per message/one domain:
157.40 ns
messages over time/one domain:
6.35 M/s
time per message/1 adder, 1 taker:
976.19 ns
messages over time/1 adder, 1 taker:
2.05 M/s
time per message/1 adder, 2 takers:
2125.11 ns
messages over time/1 adder, 2 takers:
1.41 M/s
time per message/1 adder, 4 takers:
7277.22 ns
messages over time/1 adder, 4 takers:
0.69 M/s
time per message/2 adders, 1 taker:
926.75 ns
messages over time/2 adders, 1 taker:
3.24 M/s
time per message/2 adders, 2 takers:
2343.99 ns
messages over time/2 adders, 2 takers:
1.71 M/s
time per message/2 adders, 4 takers:
4617.19 ns
messages over time/2 adders, 4 takers:
1.30 M/s
time per message/4 adders, 1 taker:
1953.85 ns
messages over time/4 adders, 1 taker:
2.56 M/s
time per message/4 adders, 2 takers:
2719.64 ns
messages over time/4 adders, 2 takers:
2.21 M/s
time per message/4 adders, 4 takers:
5410.96 ns
messages over time/4 adders, 4 takers:
1.48 M/s
Hashtbl:
time per operation/one domain, 10% reads:
70.83 ns
operations over time/one domain, 10% reads:
14.12 M/s
time per operation/one domain, 50% reads:
92.08 ns
operations over time/one domain, 50% reads:
10.86 M/s
time per operation/one domain, 90% reads:
55.94 ns
operations over time/one domain, 90% reads:
17.88 M/s
time per operation/1 worker, 10% reads:
182.17 ns
operations over time/1 worker, 10% reads:
5.49 M/s
time per operation/2 workers, 10% reads:
904.39 ns
operations over time/2 workers, 10% reads:
2.21 M/s
time per operation/4 workers, 10% reads:
1537.21 ns
operations over time/4 workers, 10% reads:
2.60 M/s
time per operation/8 workers, 10% reads:
3413.00 ns
operations over time/8 workers, 10% reads:
2.34 M/s
time per operation/1 worker, 50% reads:
186.54 ns
operations over time/1 worker, 50% reads:
5.36 M/s
time per operation/2 workers, 50% reads:
515.86 ns
operations over time/2 workers, 50% reads:
3.88 M/s
time per operation/4 workers, 50% reads:
1341.36 ns
operations over time/4 workers, 50% reads:
2.98 M/s
time per operation/8 workers, 50% reads:
3028.28 ns
operations over time/8 workers, 50% reads:
2.64 M/s
time per operation/1 worker, 90% reads:
167.52 ns
operations over time/1 worker, 90% reads:
5.97 M/s
time per operation/2 workers, 90% reads:
726.13 ns
operations over time/2 workers, 90% reads:
2.75 M/s
time per operation/4 workers, 90% reads:
821.66 ns
operations over time/4 workers, 90% reads:
4.87 M/s
time per operation/8 workers, 90% reads:
3996.89 ns
operations over time/8 workers, 90% reads:
2.00 M/s
Queue:
time per message/one domain:
48.74 ns
messages over time/one domain:
20.52 M/s
Ref with Mutex:
time per op/get:
85.43 ns
ops over time/get:
11.71 M/s
time per op/incr:
86.17 ns
ops over time/incr:
11.60 M/s
time per op/push & pop:
95.15 ns
ops over time/push & pop:
10.51 M/s
time per op/cas int:
87.26 ns
ops over time/cas int:
11.46 M/s
time per op/xchg int:
85.99 ns
ops over time/xchg int:
11.63 M/s
time per op/swap:
89.33 ns
ops over time/swap:
11.19 M/s
Ref with [@poll error]:
time per op/get:
2.63 ns
ops over time/get:
380.86 M/s
time per op/incr:
4.56 ns
ops over time/incr:
219.37 M/s
time per op/push & pop:
53.08 ns
ops over time/push & pop:
18.84 M/s
time per op/cas int:
10.87 ns
ops over time/cas int:
91.97 M/s
time per op/xchg int:
10.84 ns
ops over time/xchg int:
92.26 M/s
time per op/swap:
17.91 ns
ops over time/swap:
55.84 M/s
Stack:
time per message/one domain:
41.66 ns
messages over time/one domain:
24.00 M/s
Unix:
time per blocking read/1 worker:
1288.91 ns
blocking reads over time/1 worker:
0.78 M/s
time per blocking read/2 workers:
1291.13 ns
blocking reads over time/2 workers:
1.55 M/s
time per blocking read/4 workers:
1410.00 ns
blocking reads over time/4 workers:
2.84 M/s
2024-09-11 14:16.06 ---> saved as "84a25c4658535ec1984c29e4c069a7e579d3e864b81bebb2ff68d49ad94d588d"
Job succeeded
2024-09-11 14:16.06: Job succeeded