Compare commits

Home / Compare 53765b68 .. b9d0f0d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.048-0.049=-0.000
min33.950-33.950=-0.001
max34.111-34.114=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=0.000
max0.089-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=0.000
min23.315-23.310=0.005
max23.324-23.321=0.004
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.065-0.064=0.001
σ0.003-0.003=0.000
min0.063-0.060=0.004
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.302=0.128
σ0.364-0.366=-0.002
min1756.855-1756.727=0.128
max1758.018-1757.893=0.125
mean1650.650-1636.000=14.650
σ637.866-633.115=4.751
min654.000-650.000=4.000
max2849.000-2838.000=11.000
mean2.383-2.346=0.037
σ0.102-0.077=0.025
min2.273-2.152=0.121
max2.684-2.485=0.198

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.576-326.435=0.142
σ0.051-0.057=-0.006
min326.485-326.338=0.147
max326.607-326.473=0.134
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean0.435-0.427=0.008
σ0.013-0.006=0.006
min0.423-0.419=0.003
max0.449-0.436=0.013
iters=5
new-facts=1
prior-facts=6402
mean1988.740-1988.615=0.125
σ0.007-0.005=0.002
min1988.734-1988.610=0.124
max1988.750-1988.622=0.128
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean2.701-2.718=-0.017
σ0.052-0.134=-0.082
min2.657-2.623=0.034
max2.789-2.938=-0.149
iters=5
new-facts=6402
prior-facts=1
mean4813.545-4813.338=0.206
σ7.484-7.477=0.007
min4810.026-4809.984=0.042
max4826.928-4826.713=0.215
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean8.547-8.926=-0.379
σ0.865-0.244=0.621
min7.815-8.557=-0.742
max9.561-9.150=0.412
iters=5
new-facts=6402
prior-facts=6402
mean5001.139-5000.945=0.193
σ0.022-0.162=-0.139
min5001.113-5000.660=0.453
max5001.167-5001.058=0.108
mean3061.000-3050.600=10.400
σ285.668-187.264=98.404
min2849.000-2838.000=11.000
max3505.000-3314.000=191.000
mean9.697-9.765=-0.068
σ0.099-0.308=-0.209
min9.558-9.270=0.288
max9.799-10.045=-0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.936=0.044
σ0.073-0.058=0.015
min0.919-0.894=0.025
max1.062-1.036=0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.574-464.437=0.137
σ574.771-574.767=0.004
min177.179-177.049=0.130
max1326.730-1326.587=0.143
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean0.432-0.435=-0.003
σ0.311-0.300=0.011
min0.259-0.285=-0.025
max0.898-0.885=0.013
policies=20
mean1772.074-1770.807=1.267
σ0.362-0.359=0.002
min1771.834-1770.567=1.267
max1772.611-1771.339=1.272
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean2.790-2.803=-0.013
σ0.011-0.011=-0.000
min2.776-2.789=-0.013
max2.801-2.816=-0.015
policies=200
mean17727.557-17714.919=12.638
σ0.336-0.507=-0.171
min17727.362-17714.595=12.766
max17728.059-17715.668=12.391
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2838.000=11.000
σ0.000
min2849.000-2838.000=11.000
max2849.000-2838.000=11.000
mean27.780-27.781=-0.001
σ0.393-0.374=0.019
min27.286-27.395=-0.109
max28.127-28.122=0.005