Compare commits

Home / Compare 68620317 .. caba06b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.728=0.001
σ0.053-0.047=0.005
min70.700-70.703=-0.003
max70.876-70.861=0.015
mean413.000
σ0.000
min413.000
max413.000
mean0.158-0.156=0.003
σ0.005-0.006=-0.001
min0.151-0.148=0.003
max0.164-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.449=-0.004
σ0.003-0.012=-0.009
min21.442-21.442=-0.000
max21.450-21.483=-0.034
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.064=-0.001
σ0.003-0.003=-0.000
min0.060-0.060=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.287-1754.527=0.759
σ0.360-0.360=0.000
min1754.720-1753.954=0.766
max1755.868-1755.111=0.757
mean1627.300-1645.950=-18.650
σ594.994-635.457=-40.462
min637.000-639.000=-2.000
max2422.000-2855.000=-433.000
mean2.830-2.783=0.047
σ0.169-0.204=-0.035
min2.398-2.330=0.068
max3.080-3.111=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.369-273.610=0.758
σ0.008-0.006=0.002
min274.361-273.602=0.760
max274.381-273.616=0.765
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean0.384-0.383=0.001
σ0.004-0.004=0.001
min0.382-0.381=0.001
max0.392-0.390=0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.752-1934.001=0.751
σ0.012-0.006=0.007
min1934.736-1933.993=0.742
max1934.768-1934.006=0.762
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean3.032-2.943=0.089
σ0.057-0.184=-0.128
min2.994-2.692=0.302
max3.131-3.129=0.003
iters=5
new-facts=6402
prior-facts=1
mean4755.474-4754.649=0.825
σ0.904-0.899=0.005
min4755.000-4753.956=1.044
max4757.084-4756.224=0.860
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean8.768-8.554=0.214
σ0.329-0.540=-0.211
min8.299-7.661=0.638
max9.045-8.933=0.112
iters=5
new-facts=6402
prior-facts=6402
mean4945.912-4945.221=0.691
σ0.174-0.019=0.154
min4945.604-4945.197=0.407
max4946.012-4945.243=0.769
mean2955.000-3066.000=-111.000
σ269.805-222.741=47.065
min2588.000-2855.000=-267.000
max3303.000-3298.000=5.000
mean8.452-8.697=-0.245
σ0.041-0.269=-0.228
min8.387-8.366=0.021
max8.490-9.070=-0.580

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-1.084=0.713
σ0.139-0.113=0.026
min1.635-0.944=0.691
max2.001-1.260=0.741

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.835-472.841=-0.006
σ574.922-574.930=-0.008
min185.369-185.372=-0.003
max1335.218-1335.236=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean0.568-0.490=0.078
σ0.561-0.381=0.180
min0.284-0.297=-0.013
max1.410-1.061=0.349
policies=20
mean1853.983-1854.013=-0.030
σ0.367-0.347=0.020
min1853.734-1853.774=-0.039
max1854.526-1854.524=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean2.864-2.957=-0.092
σ0.011-0.007=0.004
min2.851-2.950=-0.099
max2.877-2.964=-0.086
policies=200
mean18546.587-18546.606=-0.018
σ0.572-0.506=0.067
min18546.248-18546.195=0.052
max18547.440-18547.334=0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2422.000-2855.000=-433.000
σ0.000
min2422.000-2855.000=-433.000
max2422.000-2855.000=-433.000
mean28.841-29.139=-0.297
σ0.059-0.405=-0.346
min28.780-28.839=-0.059
max28.922-29.736=-0.814