2025-01-21 15:55.17: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/ignore-results-from-ops-on-ref-bench (fcbc847459c7b0a57aed81d20eeda373202e0c2c) (linux-x86_64:fedora-41-4.14_opam-2.3)
Base: ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "ignore-results-from-ops-on-ref-bench" && cd "multicore-bench" && git reset --hard fcbc8474
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900
# fedora-41-4.14_opam-2.3
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
WORKDIR /src
RUN sudo dnf install -y findutils
RUN sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
WORKDIR /src
RUN sudo chown opam /src
RUN cd ~/opam-repository && (git cat-file -e b41fc63234d56d04112634b1ea9121f12caf9794 || git fetch origin master) && git reset -q --hard b41fc63234d56d04112634b1ea9121f12caf9794 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./
RUN opam pin add -yn multicore-bench.dev './'
RUN echo '(lang dune 3.0)' > './dune-project'
ENV DEPS="astring.0.8.5 backoff.0.1.1 base-bigarray.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.4.14.2 ocaml-base-compiler.4.14.2 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . /src
RUN opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2025-01-21 15:55.17: Using cache hint "ocaml-multicore/multicore-bench-ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900-fedora-41-4.14_opam-2.3-a6ce96dbbb6af53835677281ad10586e"
2025-01-21 15:55.17: Using OBuilder spec:
((from ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900)
(comment fedora-41-4.14_opam-2.3)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(workdir /src)
(run (network host)
(shell "sudo dnf install -y findutils"))
(run (shell "sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(workdir /src)
(run (shell "sudo chown opam /src"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e b41fc63234d56d04112634b1ea9121f12caf9794 || git fetch origin master) && git reset -q --hard b41fc63234d56d04112634b1ea9121f12caf9794 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
(run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
(env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.4.14.2 ocaml-base-compiler.4.14.2 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst /src))
(run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2025-01-21 15:55.17: Waiting for resource in pool OCluster
2025-01-21 15:55.17: Waiting for worker…
2025-01-21 15:55.27: Got resource from pool OCluster
Building on doris.caelum.ci.dev
All commits already cached
HEAD is now at fcbc847 Ignore results from ops on `ref` benchmarks
(from ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900)
Unable to find image 'ocaml/opam:fedora-41-ocaml-4.14@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900' locally
docker.io/ocaml/opam@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900: Pulling from ocaml/opam
b98ee30980f7: Pulling fs layer
b98ee30980f7: Download complete
b98ee30980f7: Pull complete
Digest: sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900
Status: Downloaded newer image for ocaml/opam@sha256:5778e6ee45b5c3f726d5ce01673b1caf7ace3b4a296fa4ad06d25806fbfd3900
2025-01-21 15:55.27 ---> using "50be0ec0208e20fe7c41856479c843b86ffd4c4e993ca70cf81ef86567d6d61a" from cache
/: (comment fedora-41-4.14_opam-2.3)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (workdir /src)
/src: (run (network host)
(shell "sudo dnf install -y findutils"))
Updating and loading repositories:
Fedora 41 - x86_64 - Updates 100% | 181.7 KiB/s | 24.0 KiB | 00m00s
Fedora 41 - x86_64 - Updates 100% | 4.9 MiB/s | 2.5 MiB | 00m01s
Repositories loaded.
Package "findutils-1:4.10.0-4.fc41.x86_64" is already installed.
Nothing to do.
2025-01-21 15:55.27 ---> using "744d9a1a3c20e71ca5ff79a89afc8a3b0322ef95daf07339360d4beb6524c95e" from cache
/src: (run (shell "sudo ln -f /usr/bin/opam-2.3 /usr/bin/opam"))
2025-01-21 15:55.27 ---> using "a3cf241ff6b898745fe2a7bfaf5f61dc27254c67719db82563b655abe37dfdca" from cache
/src: (run (shell "opam init --reinit -ni"))
Configuring from /home/opam/.opamrc and then from built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This development version of opam requires an update to the layout of /home/opam/.opam from version 2.0 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
2025-01-21 15:55.27 ---> using "cf302921b6ed76b7e8312a0d8be60e89723e69f6150e3930b56f525696e27c16" from cache
/src: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Linux 5.15.0-130-generic
The OCaml toplevel, version 4.14.2
2.3.0
2025-01-21 15:55.27 ---> using "29949835635d714eab62e612d7f48f654de42f3b6a8968313bdccfd2f5b210e6" from cache
/src: (workdir /src)
/src: (run (shell "sudo chown opam /src"))
2025-01-21 15:55.27 ---> using "b07d74bbfec83eea9aa7555a7345243d98d9400ffdf26c770ba70897fca3606f" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e b41fc63234d56d04112634b1ea9121f12caf9794 || git fetch origin master) && git reset -q --hard b41fc63234d56d04112634b1ea9121f12caf9794 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
3e681a81f6..b41fc63234 master -> origin/master
b41fc63234 Merge pull request #27302 from ocaml/dra27--rm-non-win32-host-pkgs
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from file:///home/opam/opam-repository
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# To update the current shell environment, run: eval $(opam env)
2025-01-21 15:55.27 ---> using "78f76d951ea6067c7a361529b02ba1fc85b8b1abddd85bb22ee9b0093eed683e" from cache
/src: (copy (src multicore-bench.opam) (dst ./))
2025-01-21 15:55.27 ---> using "73edd551f2e48b7c300bd71cb33a790579c95a8b7ba3e85889895da749254d1d" from cache
/src: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './'"))
[multicore-bench.dev] synchronised (file:///src)
multicore-bench is now pinned to file:///src (version dev)
2025-01-21 15:55.27 ---> using "1b9d9b8b9acdca1902f269ccbf0254f6c73f8c7d208439babb233daec6143a5a" from cache
/src: (run (network host)
(shell "echo '(lang dune 3.0)' > './dune-project'"))
2025-01-21 15:55.27 ---> using "81a5d621bd1e173e4d9a625d7e39bbd717f5ca124e78a8123a41491458e71be0" from cache
/src: (env DEPS "astring.0.8.5 backoff.0.1.1 base-bigarray.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.8.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.17.1 fmt.0.9.0 logs.0.7.0 mdx.2.5.0 mtime.2.1.0 multicore-magic.2.3.1 ocaml.4.14.2 ocaml-base-compiler.4.14.2 ocaml-config.2 ocaml-options-vanilla.1 ocaml-version.3.7.3 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/src: (env CI true)
/src: (env OCAMLCI true)
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam update --depexts && opam install --cli=2.3 --depext-only -y multicore-bench.dev $DEPS"))
+ /usr/bin/sudo "yum" "makecache"
- Updating and loading repositories:
- Fedora 41 - x86_64 - Updates 100% | 133.8 KiB/s | 24.8 KiB | 00m00s
- Fedora 41 - x86_64 - Updates 100% | 5.7 MiB/s | 3.0 MiB | 00m01s
- Repositories loaded.
- Metadata cache created.
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (file:///src)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 2).
[NOTE] Package ocaml-base-compiler is already installed (current version is 4.14.2).
[NOTE] Package ocaml is already installed (current version is 4.14.2).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2025-01-21 15:55.27 ---> using "2caa7871467f614c38996747126a18122c5e4200dc476ab85cfad70d1a684f5d" from cache
/src: (run (cache (opam-archives (target /home/opam/.opam/download-cache)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 2).
[NOTE] Package ocaml-base-compiler is already installed (current version is 4.14.2).
[NOTE] Package ocaml is already installed (current version is 4.14.2).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.1
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.8.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.17.1
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.5.0
- install mtime 2.1.0
- install multicore-magic 2.3.1
- install ocaml-version 3.7.3
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.6
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved backoff.0.1.1 (cached)
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved cppo.1.8.0 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mdx.2.5.0 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved multicore-magic.2.3.1 (cached)
-> retrieved ocaml-version.3.7.3 (cached)
-> retrieved ocamlfind.1.9.6 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved re.1.12.0 (cached)
-> retrieved seq.base (cached)
-> installed seq.base
-> retrieved result.1.5 (cached)
-> retrieved thread-table.1.0.0 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.17.1 (cached)
-> installed cmdliner.1.3.0
-> installed ocamlbuild.0.15.0
-> installed ocamlfind.1.9.6
-> installed topkg.1.0.7
-> installed mtime.2.1.0
-> installed fmt.0.9.0
-> installed astring.0.8.5
-> installed logs.0.7.0
-> installed dune.3.17.1
-> installed domain_shims.0.1.0
-> installed csexp.1.5.2
-> installed camlp-streams.5.0.1
-> installed backoff.0.1.1
-> installed result.1.5
-> installed thread-table.1.0.0
-> installed ocaml-version.3.7.3
-> installed multicore-magic.2.3.1
-> installed domain-local-await.1.0.1
-> installed re.1.12.0
-> installed cppo.1.8.0
-> installed yojson.2.2.2
-> installed mdx.2.5.0
Done.
# To update the current shell environment, run: eval $(opam env)
2025-01-21 15:55.27 ---> using "0af623a175a5a46a9091d5ff688738e8bbd6f34fdb02e5067e2c81370dd12e12" from cache
/src: (copy (src .) (dst /src))
2025-01-21 15:55.28 ---> saved as "d4a2c69b63822a1dc95c0468cd49782cccbeb4768155f00735ac3e834ffd1613"
/src: (run (shell "opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
ops over time/cas int:
247.51 M/s
ops over time/get:
643.73 M/s
ops over time/incr:
250.24 M/s
ops over time/push & pop:
96.46 M/s
ops over time/swap:
123.49 M/s
ops over time/xchg int:
229.85 M/s
time per op/cas int:
4.04 ns
time per op/get:
1.55 ns
time per op/incr:
4.00 ns
time per op/push & pop:
10.37 ns
time per op/swap:
8.10 ns
time per op/xchg int:
4.35 ns
Atomic incr:
ops over time/CAS, 1 domains:
254.62 M/s
ops over time/CAS with backoff, 1 domains:
253.41 M/s
ops over time/Incr, 1 domains:
244.17 M/s
time per op/CAS, 1 domains:
3.93 ns
time per op/CAS with backoff, 1 domains:
3.95 ns
time per op/Incr, 1 domains:
4.10 ns
Bounded_q:
messages over time/one domain:
15.10 M/s
time per message/one domain:
66.21 ns
Hashtbl:
operations over time/1 worker, 10% reads:
16.05 M/s
operations over time/1 worker, 50% reads:
15.54 M/s
operations over time/1 worker, 90% reads:
19.84 M/s
operations over time/2 workers, 10% reads:
15.86 M/s
operations over time/2 workers, 50% reads:
15.26 M/s
operations over time/2 workers, 90% reads:
19.63 M/s
operations over time/4 workers, 10% reads:
15.25 M/s
operations over time/4 workers, 50% reads:
14.84 M/s
operations over time/4 workers, 90% reads:
19.33 M/s
operations over time/8 workers, 10% reads:
13.91 M/s
operations over time/8 workers, 50% reads:
13.66 M/s
operations over time/8 workers, 90% reads:
17.68 M/s
operations over time/one domain, 10% reads:
23.24 M/s
operations over time/one domain, 50% reads:
22.73 M/s
operations over time/one domain, 90% reads:
28.91 M/s
time per operation/1 worker, 10% reads:
62.30 ns
time per operation/1 worker, 50% reads:
64.37 ns
time per operation/1 worker, 90% reads:
50.41 ns
time per operation/2 workers, 10% reads:
126.09 ns
time per operation/2 workers, 50% reads:
131.04 ns
time per operation/2 workers, 90% reads:
101.91 ns
time per operation/4 workers, 10% reads:
262.38 ns
time per operation/4 workers, 50% reads:
269.58 ns
time per operation/4 workers, 90% reads:
206.89 ns
time per operation/8 workers, 10% reads:
575.12 ns
time per operation/8 workers, 50% reads:
585.69 ns
time per operation/8 workers, 90% reads:
452.50 ns
time per operation/one domain, 10% reads:
43.03 ns
time per operation/one domain, 50% reads:
44.00 ns
time per operation/one domain, 90% reads:
34.60 ns
Queue:
messages over time/one domain:
41.74 M/s
time per message/one domain:
23.96 ns
Ref with Mutex:
ops over time/cas int:
56.46 M/s
ops over time/get:
64.36 M/s
ops over time/incr:
52.33 M/s
ops over time/push & pop:
50.13 M/s
ops over time/swap:
54.91 M/s
ops over time/xchg int:
55.97 M/s
time per op/cas int:
17.71 ns
time per op/get:
15.54 ns
time per op/incr:
19.11 ns
time per op/push & pop:
19.95 ns
time per op/swap:
18.21 ns
time per op/xchg int:
17.87 ns
Ref with [@poll error]:
ops over time/cas int:
231.63 M/s
ops over time/get:
536.59 M/s
ops over time/incr:
299.72 M/s
ops over time/push & pop:
96.96 M/s
ops over time/swap:
123.12 M/s
ops over time/xchg int:
202.69 M/s
time per op/cas int:
4.32 ns
time per op/get:
1.86 ns
time per op/incr:
3.34 ns
time per op/push & pop:
10.31 ns
time per op/swap:
8.12 ns
time per op/xchg int:
4.93 ns
Stack:
messages over time/one domain:
44.45 M/s
time per message/one domain:
22.50 ns
Unix:
blocking reads over time/1 worker:
0.56 M/s
time per blocking read/1 worker:
1783.44 ns
2025-01-21 15:55.32 ---> saved as "cd574c845028df4098cb47293ae884b006ff7a6e16a4100d531b5f13738bf54b"
Job succeeded
2025-01-21 15:55.32: Job succeeded