Compare commits

Home / Compare c02c9ccb .. 3fda9439

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.770=0.000
σ0.046-0.045=0.001
min30.731-30.726=0.005
max30.899-30.893=0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.080-0.078=0.001
σ0.003-0.003=0.001
min0.077-0.075=0.002
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=-0.000
σ0.003-0.003=0.001
min21.055-21.057=-0.002
max21.066-21.065=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.063-0.063=-0.000
σ0.002-0.003=-0.001
min0.062-0.061=0.001
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=0.001
σ0.363-0.362=0.001
min1750.848-1750.847=0.001
max1751.997-1752.019=-0.022
mean1659.950-1652.250=7.700
σ631.777-625.168=6.609
min680.000-681.000=-1.000
max2689.000-2649.000=40.000
mean2.833-2.868=-0.035
σ0.171-0.165=0.006
min2.268-2.330=-0.062
max3.033-3.127=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.756=0.002
σ0.008-0.007=0.000
min275.749-275.747=0.002
max275.767-275.766=0.001
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean0.407-0.407=0.000
σ0.013-0.011=0.002
min0.397-0.394=0.003
max0.423-0.419=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.289-2168.267=0.022
σ0.003-0.018=-0.015
min2168.286-2168.245=0.040
max2168.294-2168.286=0.008
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean3.037-2.951=0.086
σ0.252-0.163=0.088
min2.720-2.739=-0.019
max3.404-3.167=0.237
iters=5
new-facts=6402
prior-facts=1
mean5047.973-5047.983=-0.010
σ0.646-0.657=-0.010
min5047.625-5047.520=0.105
max5049.127-5049.134=-0.007
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean8.770-9.012=-0.241
σ0.400-0.509=-0.109
min8.117-8.162=-0.046
max9.065-9.479=-0.413
iters=5
new-facts=6402
prior-facts=6402
mean5179.174-5179.156=0.019
σ0.200-0.203=-0.003
min5178.851-5178.812=0.040
max5179.367-5179.309=0.058
mean3230.000-3262.000=-32.000
σ388.469-372.131=16.338
min2689.000-2745.000=-56.000
max3720.000
mean9.989-9.841=0.148
σ0.532-0.143=0.390
min9.329-9.711=-0.382
max10.728-10.072=0.656

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.109-1.187=-0.078
σ0.114-0.317=-0.203
min0.949-0.940=0.009
max1.256-1.695=-0.439

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.577-463.574=0.003
σ572.662-572.663=-0.001
min177.236-177.238=-0.002
max1322.570-1322.569=0.001
mean79.750
σ7.500
min76.000
max91.000
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean0.551-0.546=0.005
σ0.536-0.536=-0.000
min0.276-0.275=0.001
max1.355-1.350=0.004
policies=20
mean1772.637-1772.641=-0.004
σ0.347-0.334=0.013
min1772.395-1772.418=-0.023
max1773.149-1773.136=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean2.754-2.746=0.007
σ0.024-0.008=0.016
min2.730-2.737=-0.007
max2.784-2.756=0.028
policies=200
mean17732.917-17733.052=-0.135
σ0.466-0.505=-0.039
min17732.595-17732.769=-0.174
max17733.600-17733.809=-0.209
mean7600.000
σ0.000
min7600.000
max7600.000
mean2689.000-2649.000=40.000
σ0.000
min2689.000-2649.000=40.000
max2689.000-2649.000=40.000
mean27.670-27.741=-0.071
σ0.114-0.163=-0.049
min27.598-27.585=0.013
max27.838-27.969=-0.131