Compare commits

Home / Compare 63e4a1b4 .. 41cf8bfd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.951=-0.157
σ0.108-0.103=0.005
min35.748-35.907=-0.160
max36.101-36.243=-0.142
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.074-0.076=-0.003
σ0.004-0.005=-0.001
min0.066-0.070=-0.004
max0.083-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.066-26.201=-0.135
σ0.003-0.006=-0.004
min26.062-26.195=-0.133
max26.070-26.212=-0.142
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.061-0.061=-0.000
σ0.002-0.004=-0.001
min0.059-0.059=0.000
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.238-1756.299=-5.061
σ0.363-0.368=-0.005
min1750.670-1755.724=-5.054
max1751.825-1756.893=-5.068
mean1662.700-1657.350=5.350
σ639.833-631.661=8.172
min676.000-611.000=65.000
max2693.000-2725.000=-32.000
mean2.895-2.348=0.547
σ0.096-0.081=0.014
min2.688-2.262=0.426
max3.095-2.580=0.515

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-278.791=-3.223
σ0.003-0.005=-0.002
min275.566-278.786=-3.219
max275.573-278.799=-3.226
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean0.403-0.412=-0.009
σ0.007-0.006=0.001
min0.396-0.408=-0.011
max0.412-0.423=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2268.884=-100.790
σ0.013-0.018=-0.004
min2168.080-2268.866=-100.787
max2168.111-2268.906=-100.794
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean2.986-3.046=-0.060
σ0.188-0.157=0.031
min2.658-2.865=-0.207
max3.127-3.240=-0.112
iters=5
new-facts=6402
prior-facts=1
mean5047.926-4954.250=93.676
σ0.880-0.896=-0.015
min5047.390-4953.754=93.636
max5049.492-4955.844=93.648
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean8.761-8.050=0.711
σ0.510-0.547=-0.037
min8.124-7.623=0.501
max9.368-9.002=0.366
iters=5
new-facts=6402
prior-facts=6402
mean5179.054-5168.793=10.260
σ0.084-0.089=-0.005
min5178.964-5168.723=10.241
max5179.145-5168.908=10.237
mean3222.800-3314.600=-91.800
σ364.863-396.651=-31.788
min2720.000-2923.000=-203.000
max3679.000-3716.000=-37.000
mean10.139-9.514=0.625
σ0.559-0.366=0.193
min9.594-9.117=0.476
max11.084-10.115=0.969

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.091-1.023=0.068
σ0.145-0.116=0.029
min0.947-0.944=0.003
max1.257-1.210=0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-459.811=3.397
σ572.659-571.585=1.074
min176.871-174.010=2.860
max1322.196-1317.187=5.008
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean0.558-0.543=0.015
σ0.566-0.549=0.017
min0.272-0.266=0.006
max1.407-1.367=0.040
policies=20
mean1768.946-1740.305=28.641
σ0.340-0.309=0.032
min1768.721-1740.127=28.594
max1769.452-1740.767=28.685
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean2.757-2.689=0.068
σ0.027-0.015=0.012
min2.725-2.672=0.054
max2.791-2.704=0.087
policies=200
mean17696.103-17410.095=286.008
σ0.410-0.541=-0.131
min17695.848-17409.747=286.100
max17696.710-17410.900=285.811
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2693.000-2725.000=-32.000
σ0.000
min2693.000-2725.000=-32.000
max2693.000-2725.000=-32.000
mean27.672-27.110=0.562
σ0.090-0.065=0.025
min27.549-27.066=0.483
max27.764-27.206=0.558