2024-09-11 13:30.32: New job: test ocaml-multicore/multicore-bench https://github.com/ocaml-multicore/multicore-bench.git#refs/heads/main (298c5d1e24da82a9640825ef4a68b9aef88daaca) (macos-x86_64:macos-homebrew-5.2_opam-2.2)
Base: macos-homebrew-ocaml-5.2
Opam project build
To reproduce locally:
git clone --recursive "https://github.com/ocaml-multicore/multicore-bench.git" -b "main" && cd "multicore-bench" && git reset --hard 298c5d1e
cat > Dockerfile <<'END-OF-DOCKERFILE'
FROM macos-homebrew-ocaml-5.2
# macos-homebrew-5.2_opam-2.2
USER 1000:1000
ENV CLICOLOR_FORCE="1"
ENV OPAMCOLOR="always"
RUN ln -f ~/local/bin/opam-2.2 ~/local/bin/opam
RUN opam init --reinit -ni
RUN uname -rs && opam exec -- ocaml -version && opam --version
RUN cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u
COPY --chown=1000:1000 multicore-bench.opam ./src/./
RUN opam pin add -yn multicore-bench.dev './src/./'
ENV DEPS="astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2"
ENV CI="true"
ENV OCAMLCI="true"
RUN opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS
RUN opam install $DEPS
COPY --chown=1000:1000 . ./src
RUN cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build
END-OF-DOCKERFILE
docker build .
END-REPRO-BLOCK
2024-09-11 13:30.32: Using cache hint "ocaml-multicore/multicore-bench-macos-homebrew-ocaml-5.2-macos-homebrew-5.2_opam-2.2-d9562627ca46d81389ea05095b6dc868"
2024-09-11 13:30.32: Using OBuilder spec:
((from macos-homebrew-ocaml-5.2)
(comment macos-homebrew-5.2_opam-2.2)
(user (uid 1000) (gid 1000))
(env CLICOLOR_FORCE 1)
(env OPAMCOLOR always)
(run (shell "ln -f ~/local/bin/opam-2.2 ~/local/bin/opam"))
(run (shell "opam init --reinit -ni"))
(run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u"))
(copy (src multicore-bench.opam) (dst ./src/./))
(run (network host)
(shell "opam pin add -yn multicore-bench.dev './src/./'"))
(env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
(env CI true)
(env OCAMLCI true)
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
(run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam install $DEPS"))
(copy (src .) (dst ./src))
(run (shell "cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
)
2024-09-11 13:30.32: Waiting for resource in pool OCluster
2024-09-11 13:30.32: Waiting for worker…
2024-09-11 20:16.42: Got resource from pool OCluster
Building on i7-worker-04
All commits already cached
HEAD is now at 298c5d1 Add a naïve bounded queue benchmark
(from macos-homebrew-ocaml-5.2)
2024-09-11 20:16.44 ---> using "9b46fe3d2429f2b9195a02468cb57ac45cfa11fb4a87cb32b5e5375232223327" from cache
/: (comment macos-homebrew-5.2_opam-2.2)
/: (user (uid 1000) (gid 1000))
/: (env CLICOLOR_FORCE 1)
/: (env OPAMCOLOR always)
/: (run (shell "ln -f ~/local/bin/opam-2.2 ~/local/bin/opam"))
2024-09-11 20:16.44 ---> using "b003627c18f5d873361872ecfa38a9a8b5c86cc26245bef1d152887064c98071" from cache
/: (run (shell "opam init --reinit -ni"))
No configuration file found, using built-in defaults.
Checking for available remotes: rsync and local, git.
- you won't be able to use mercurial repositories unless you install the hg command on your system.
- you won't be able to use darcs repositories unless you install the darcs command on your system.
This version of opam requires an update to the layout of /Users/mac1000/.opam from version 2.1 to version 2.2, which can't be reverted.
You may want to back it up before going further.
Continue? [y/n] y
[NOTE] The 'jobs' option was reset, its value was 1 and its new value will vary according to the current number of cores on your machine. You can restore the fixed value using:
opam option jobs=1 --global
Format upgrade done.
<><> Updating repositories ><><><><><><><><><><><><><><><><><><><><><><><><><><>
[default] no changes from git+file:///Users/mac1000/opam-repository
2024-09-11 20:16.45 ---> using "408d2cc158c17e89759cf51b146539f00642e287086d5c54f85c33dae9e6a1f9" from cache
/: (run (shell "uname -rs && opam exec -- ocaml -version && opam --version"))
Darwin 23.4.0
The OCaml toplevel, version 5.2.0
2.2.0
2024-09-11 20:16.45 ---> using "80c5626e56c363c9237b2d67b74b9ac64751c52cd041543c0fda73b45b911c9a" from cache
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "cd ~/opam-repository && (git cat-file -e 0329818dcfd3de1a722ea09eeeed94cd24caa375 || git fetch origin master) && git reset -q --hard 0329818dcfd3de1a722ea09eeeed94cd24caa375 && git log --no-decorate -n1 --oneline && opam update -u"))
From https://github.com/ocaml/opam-repository
* branch master -> FETCH_HEAD
fe8dffac61..0329818dcf master -> origin/master
0329818dcf Merge pull request #26527 from dbuenzli/b0-publish-mtime.2.1.0-etc-b00ab5a8b3cb608d
<><> Updating package repositories ><><><><><><><><><><><><><><><><><><><><><><>
[default] synchronised from git+file:///Users/mac1000/opam-repository
default (at git+file:///Users/mac1000/opam-repository):
[WARNING] opam is out-of-date. Please consider updating it (https://opam.ocaml.org/doc/Install.html)
Everything as up-to-date as possible (run with --verbose to show unavailable upgrades).
The following packages are not being upgraded because the new versions conflict with other installed packages:
- ocaml.5.4.0
However, you may "opam upgrade" these packages explicitly, which will ask permission to downgrade or uninstall the conflicting packages.
Nothing to do.
# Run eval $(opam env) to update the current shell environment
2024-09-11 20:16.46 ---> using "45dfee795dca857ad238521a422ecfebf920e326b1b9514fb8ec2a6246ce102f" from cache
/: (copy (src multicore-bench.opam) (dst ./src/./))
2024-09-11 20:16.48 ---> saved as "19fb1606cbc7350747fff602a45656645be0d2e0cf3ce9a135c4bbd79403cf49"
/: (run (network host)
(shell "opam pin add -yn multicore-bench.dev './src/./'"))
[multicore-bench.dev] synchronised (file:///Users/mac1000/src)
multicore-bench is now pinned to file:///Users/mac1000/src (version dev)
2024-09-11 20:16.58 ---> saved as "1ad737be573cdc9ed51ffa125fbd838ff67dce231b15d408fde596b3fda1deb0"
/: (env DEPS "astring.0.8.5 backoff.0.1.0 base-bigarray.base base-domains.base base-nnp.base base-threads.base base-unix.base camlp-streams.5.0.1 cmdliner.1.3.0 cppo.1.7.0 csexp.1.5.2 domain-local-await.1.0.1 domain_shims.0.1.0 dune.3.16.0 fmt.0.9.0 host-arch-x86_64.1 host-system-other.1 logs.0.7.0 mdx.2.4.1 mtime.2.1.0 multicore-magic.2.3.0 ocaml.5.2.0 ocaml-base-compiler.5.2.0 ocaml-config.3 ocaml-options-vanilla.1 ocaml-version.3.6.8 ocamlbuild.0.15.0 ocamlfind.1.9.6 re.1.12.0 result.1.5 seq.base thread-table.1.0.0 topkg.1.0.7 yojson.2.2.2")
/: (env CI true)
/: (env OCAMLCI true)
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam update --depexts && opam install --cli=2.2 --depext-only -y multicore-bench.dev $DEPS"))
+ /usr/local/bin/brew "update"
- ==> Updating Homebrew...
- ==> Downloading https://ghcr.io/v2/homebrew/portable-ruby/portable-ruby/blobs/sha256:bd12dc53d0714e477ce2ff4beaeb6ad71a9317271a63c3cd2f5d0427cf42f5c5
- Already downloaded: /Users/mac1000/Library/Caches/Homebrew/portable-ruby-3.3.4_1.el_capitan.bottle.tar.gz
- ==> Pouring portable-ruby-3.3.4_1.el_capitan.bottle.tar.gz
- ==> Homebrew collects anonymous analytics.
- Read the analytics documentation (and how to opt-out) here:
- https://docs.brew.sh/Analytics
- No analytics have been recorded yet (nor will be during this `brew` run).
-
- ==> Homebrew is run entirely by unpaid volunteers. Please consider donating:
- https://github.com/Homebrew/brew#donations
-
- Already up-to-date.
<><> Synchronising pinned packages ><><><><><><><><><><><><><><><><><><><><><><>
[multicore-bench.dev] synchronised (no changes)
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.2.0).
[NOTE] Package ocaml is already installed (current version is 5.2.0).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
2024-09-11 20:17.36 ---> saved as "7ae0dbaea53c52b8af013c1ecd6d1721e90515cc42f52283e5cf2a1050c9b459"
/: (run (cache (opam-archives (target /Users/mac1000/.opam/download-cache)) (homebrew (target /Users/mac1000/Library/Caches/Homebrew)))
(network host)
(shell "opam install $DEPS"))
[NOTE] Package ocaml-options-vanilla is already installed (current version is 1).
[NOTE] Package ocaml-config is already installed (current version is 3).
[NOTE] Package ocaml-base-compiler is already installed (current version is 5.2.0).
[NOTE] Package ocaml is already installed (current version is 5.2.0).
[NOTE] Package host-system-other is already installed (current version is 1).
[NOTE] Package host-arch-x86_64 is already installed (current version is 1).
[NOTE] Package base-unix is already installed (current version is base).
[NOTE] Package base-threads is already installed (current version is base).
[NOTE] Package base-nnp is already installed (current version is base).
[NOTE] Package base-domains is already installed (current version is base).
[NOTE] Package base-bigarray is already installed (current version is base).
The following actions will be performed:
=== install 23 packages
- install astring 0.8.5
- install backoff 0.1.0
- install camlp-streams 5.0.1
- install cmdliner 1.3.0
- install cppo 1.7.0
- install csexp 1.5.2
- install domain-local-await 1.0.1
- install domain_shims 0.1.0
- install dune 3.16.0
- install fmt 0.9.0
- install logs 0.7.0
- install mdx 2.4.1
- install mtime 2.1.0
- install multicore-magic 2.3.0
- install ocaml-version 3.6.8
- install ocamlbuild 0.15.0
- install ocamlfind 1.9.6
- install re 1.12.0
- install result 1.5
- install seq base
- install thread-table 1.0.0
- install topkg 1.0.7
- install yojson 2.2.2
<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
-> retrieved camlp-streams.5.0.1 (cached)
-> retrieved backoff.0.1.0 (cached)
-> retrieved astring.0.8.5 (cached)
-> retrieved cmdliner.1.3.0 (cached)
-> retrieved domain-local-await.1.0.1 (cached)
-> retrieved csexp.1.5.2 (cached)
-> retrieved domain_shims.0.1.0 (cached)
-> retrieved cppo.1.7.0 (cached)
-> retrieved fmt.0.9.0 (cached)
-> retrieved logs.0.7.0 (cached)
-> retrieved mdx.2.4.1 (cached)
-> retrieved mtime.2.1.0 (cached)
-> retrieved multicore-magic.2.3.0 (cached)
-> retrieved ocaml-version.3.6.8 (cached)
-> retrieved ocamlfind.1.9.6 (cached)
-> retrieved re.1.12.0 (cached)
-> retrieved ocamlbuild.0.15.0 (cached)
-> retrieved seq.base (cached)
-> installed seq.base
-> retrieved thread-table.1.0.0 (cached)
-> retrieved result.1.5 (cached)
-> retrieved topkg.1.0.7 (cached)
-> retrieved yojson.2.2.2 (cached)
-> retrieved dune.3.16.0 (cached)
-> installed cmdliner.1.3.0
-> installed ocamlfind.1.9.6
-> installed ocamlbuild.0.15.0
-> installed topkg.1.0.7
-> installed mtime.2.1.0
-> installed fmt.0.9.0
-> installed astring.0.8.5
-> installed logs.0.7.0
-> installed dune.3.16.0
-> installed domain_shims.0.1.0
-> installed backoff.0.1.0
-> installed result.1.5
-> installed csexp.1.5.2
-> installed ocaml-version.3.6.8
-> installed thread-table.1.0.0
-> installed camlp-streams.5.0.1
-> installed multicore-magic.2.3.0
-> installed domain-local-await.1.0.1
-> installed cppo.1.7.0
-> installed yojson.2.2.2
-> installed re.1.12.0
-> installed mdx.2.4.1
Done.
# Run eval $(opam env) to update the current shell environment
2024-09-11 20:18.47 ---> saved as "d0904b39cdd1b1bdf54750dd3e59a0e5e2f1a468cae17853a92d39a39256fb4b"
/: (copy (src .) (dst ./src))
2024-09-11 20:18.49 ---> saved as "a372b64951b31ec33dad3e3b903d43ae1d9c4f70bb88124d31f31553fa90a1a3"
/: (run (shell "cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
(cd _build/default/bench && ./main.exe -brief)
Atomic:
time per op/get:
1.62 ns
ops over time/get:
618.16 M/s
time per op/incr:
8.25 ns
ops over time/incr:
121.23 M/s
time per op/push & pop:
19.76 ns
ops over time/push & pop:
50.62 M/s
time per op/cas int:
12.94 ns
ops over time/cas int:
77.27 M/s
time per op/xchg int:
12.30 ns
ops over time/xchg int:
81.32 M/s
time per op/swap:
16.50 ns
ops over time/swap:
60.62 M/s
Atomic incr:
time per op/CAS, 1 domains:
14.14 ns
ops over time/CAS, 1 domains:
70.74 M/s
time per op/CAS, 2 domains:
138.31 ns
ops over time/CAS, 2 domains:
14.46 M/s
time per op/CAS, 4 domains:
391.86 ns
ops over time/CAS, 4 domains:
10.21 M/s
time per op/CAS, 8 domains:
1163.29 ns
ops over time/CAS, 8 domains:
6.88 M/s
time per op/CAS with backoff, 1 domains:
14.00 ns
ops over time/CAS with backoff, 1 domains:
71.44 M/s
time per op/CAS with backoff, 2 domains:
37.25 ns
ops over time/CAS with backoff, 2 domains:
53.69 M/s
time per op/CAS with backoff, 4 domains:
73.26 ns
ops over time/CAS with backoff, 4 domains:
54.60 M/s
time per op/CAS with backoff, 8 domains:
154.07 ns
ops over time/CAS with backoff, 8 domains:
51.93 M/s
time per op/Incr, 1 domains:
8.11 ns
ops over time/Incr, 1 domains:
123.33 M/s
time per op/Incr, 2 domains:
36.66 ns
ops over time/Incr, 2 domains:
54.55 M/s
time per op/Incr, 4 domains:
73.22 ns
ops over time/Incr, 4 domains:
54.63 M/s
time per op/Incr, 8 domains:
182.41 ns
ops over time/Incr, 8 domains:
43.86 M/s
Bounded_q:
time per message/one domain:
115.37 ns
messages over time/one domain:
8.67 M/s
time per message/1 adder, 1 taker:
462.29 ns
messages over time/1 adder, 1 taker:
4.33 M/s
time per message/1 adder, 2 takers:
1458.73 ns
messages over time/1 adder, 2 takers:
2.06 M/s
time per message/1 adder, 4 takers:
5640.11 ns
messages over time/1 adder, 4 takers:
0.89 M/s
time per message/2 adders, 1 taker:
845.83 ns
messages over time/2 adders, 1 taker:
3.55 M/s
time per message/2 adders, 2 takers:
1411.09 ns
messages over time/2 adders, 2 takers:
2.83 M/s
time per message/2 adders, 4 takers:
2868.95 ns
messages over time/2 adders, 4 takers:
2.09 M/s
time per message/4 adders, 1 taker:
1337.76 ns
messages over time/4 adders, 1 taker:
3.74 M/s
time per message/4 adders, 2 takers:
1999.34 ns
messages over time/4 adders, 2 takers:
3.00 M/s
time per message/4 adders, 4 takers:
3664.87 ns
messages over time/4 adders, 4 takers:
2.18 M/s
Hashtbl:
time per operation/one domain, 10% reads:
46.69 ns
operations over time/one domain, 10% reads:
21.42 M/s
time per operation/one domain, 50% reads:
46.06 ns
operations over time/one domain, 50% reads:
21.71 M/s
time per operation/one domain, 90% reads:
38.91 ns
operations over time/one domain, 90% reads:
25.70 M/s
time per operation/1 worker, 10% reads:
81.84 ns
operations over time/1 worker, 10% reads:
12.22 M/s
time per operation/2 workers, 10% reads:
518.05 ns
operations over time/2 workers, 10% reads:
3.86 M/s
time per operation/4 workers, 10% reads:
1182.53 ns
operations over time/4 workers, 10% reads:
3.38 M/s
time per operation/8 workers, 10% reads:
3511.48 ns
operations over time/8 workers, 10% reads:
2.28 M/s
time per operation/1 worker, 50% reads:
81.41 ns
operations over time/1 worker, 50% reads:
12.28 M/s
time per operation/2 workers, 50% reads:
499.89 ns
operations over time/2 workers, 50% reads:
4.00 M/s
time per operation/4 workers, 50% reads:
1096.62 ns
operations over time/4 workers, 50% reads:
3.65 M/s
time per operation/8 workers, 50% reads:
3424.78 ns
operations over time/8 workers, 50% reads:
2.34 M/s
time per operation/1 worker, 90% reads:
75.81 ns
operations over time/1 worker, 90% reads:
13.19 M/s
time per operation/2 workers, 90% reads:
425.50 ns
operations over time/2 workers, 90% reads:
4.70 M/s
time per operation/4 workers, 90% reads:
853.23 ns
operations over time/4 workers, 90% reads:
4.69 M/s
time per operation/8 workers, 90% reads:
2408.77 ns
operations over time/8 workers, 90% reads:
3.32 M/s
Queue:
time per message/one domain:
34.38 ns
messages over time/one domain:
29.08 M/s
Ref with Mutex:
time per op/get:
46.07 ns
ops over time/get:
21.70 M/s
time per op/incr:
46.08 ns
ops over time/incr:
21.70 M/s
time per op/push & pop:
54.75 ns
ops over time/push & pop:
18.27 M/s
time per op/cas int:
49.06 ns
ops over time/cas int:
20.38 M/s
time per op/xchg int:
49.06 ns
ops over time/xchg int:
20.38 M/s
time per op/swap:
51.79 ns
ops over time/swap:
19.31 M/s
Ref with [@poll error]:
time per op/get:
1.62 ns
ops over time/get:
618.11 M/s
time per op/incr:
1.94 ns
ops over time/incr:
515.39 M/s
time per op/push & pop:
15.13 ns
ops over time/push & pop:
66.10 M/s
time per op/cas int:
6.26 ns
ops over time/cas int:
159.62 M/s
time per op/xchg int:
6.33 ns
ops over time/xchg int:
158.10 M/s
time per op/swap:
9.58 ns
ops over time/swap:
104.38 M/s
Stack:
time per message/one domain:
27.81 ns
messages over time/one domain:
35.95 M/s
Unix:
time per blocking read/1 worker:
880.57 ns
blocking reads over time/1 worker:
1.14 M/s
time per blocking read/2 workers:
1007.37 ns
blocking reads over time/2 workers:
1.99 M/s
time per blocking read/4 workers:
1249.85 ns
blocking reads over time/4 workers:
3.20 M/s
2024-09-11 20:19.03 ---> saved as "e576850fc954fc8856c2f512cc9f238cfa84472ef0a6dc2a45f96b9cc1d8b7b9"
Job succeeded
2024-09-11 20:19.09: Job succeeded