Compare commits

Home / Compare 4e2943fd .. 08a9276c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.000
σ0.048-0.050=-0.002
min33.947-33.950=-0.003
max34.111-34.116=-0.006
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.082-0.082=0.001
σ0.005-0.005=-0.000
min0.077-0.076=0.001
max0.091-0.089=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.003-0.003=0.000
min23.312-23.313=-0.000
max23.323-23.322=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.064-0.064=-0.000
σ0.003-0.004=-0.001
min0.061-0.059=0.002
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.430=-0.002
σ0.366-0.363=0.002
min1756.855-1756.857=-0.003
max1758.018-1758.017=0.002
mean1651.050-1672.650=-21.600
σ639.991-619.332=20.660
min628.000-671.000=-43.000
max2789.000-2607.000=182.000
mean2.366-2.383=-0.017
σ0.127-0.162=-0.036
min2.158-2.269=-0.111
max2.630-3.005=-0.374

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.569=0.006
σ0.047-0.052=-0.005
min326.492-326.477=0.016
max326.608-326.599=0.009
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean0.423-0.425=-0.002
σ0.001-0.002=-0.001
min0.421-0.423=-0.002
max0.424-0.429=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.742-1988.741=0.001
σ0.010-0.006=0.004
min1988.726-1988.731=-0.006
max1988.752-1988.747=0.005
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean2.704-2.660=0.044
σ0.082-0.212=-0.130
min2.618-2.437=0.181
max2.836-3.002=-0.166
iters=5
new-facts=6402
prior-facts=1
mean4813.525-4813.471=0.053
σ7.763-7.801=-0.037
min4809.677-4809.505=0.172
max4827.406-4827.417=-0.011
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean8.253-8.971=-0.718
σ0.555-0.328=0.228
min7.851-8.586=-0.735
max9.218-9.303=-0.085
iters=5
new-facts=6402
prior-facts=6402
mean5001.138-5001.142=-0.004
σ0.021-0.036=-0.015
min5001.115-5001.106=0.009
max5001.162-5001.194=-0.031
mean3028.600-3019.600=9.000
σ295.535-292.486=3.048
min2789.000-2607.000=182.000
max3473.000-3391.000=82.000
mean9.747-9.651=0.096
σ0.072-0.383=-0.311
min9.622-9.138=0.483
max9.804-10.105=-0.301

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.243=-0.181
σ0.261-0.397=-0.136
min0.912-0.913=-0.002
max1.518-1.817=-0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.569=0.002
σ574.773-574.788=-0.015
min177.175-177.170=0.006
max1326.731-1326.751=-0.020
mean88.250
σ8.500
min84.000
max101.000
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean0.434-0.555=-0.121
σ0.307-0.556=-0.249
min0.278-0.276=0.002
max0.895-1.389=-0.494
policies=20
mean1772.072-1772.036=0.037
σ0.372-0.365=0.007
min1771.824-1771.789=0.035
max1772.625-1772.577=0.049
mean840.000
σ0.000
min840.000
max840.000
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean2.795-2.725=0.070
σ0.065-0.021=0.044
min2.756-2.703=0.054
max2.893-2.743=0.150
policies=200
mean17727.606-17727.547=0.059
σ0.542-0.402=0.141
min17727.265-17727.344=-0.079
max17728.406-17728.149=0.257
mean8400.000
σ0.000
min8400.000
max8400.000
mean2789.000-2607.000=182.000
σ0.000
min2789.000-2607.000=182.000
max2789.000-2607.000=182.000
mean27.521-27.392=0.129
σ0.198-0.107=0.091
min27.345-27.248=0.097
max27.799-27.506=0.293