Compare commits

Home / Compare fb55cea4 .. 564c44f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.038-31.039=-0.001
σ0.048-0.049=-0.001
min30.999-31.001=-0.002
max31.171-31.176=-0.005
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.077-0.076=0.001
σ0.004-0.003=0.001
min0.072-0.071=0.001
max0.085-0.080=0.005
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.002=-0.000
min21.140-21.138=0.002
max21.145-21.145=0.000
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.062-0.063=-0.001
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.362-0.361=0.001
min1750.842-1750.846=-0.004
max1751.992-1751.979=0.014
mean1663.800-1652.000=11.800
σ629.348-645.383=-16.035
min633.000-648.000=-15.000
max2520.000-2846.000=-326.000
mean2.826-2.831=-0.005
σ0.162-0.196=-0.034
min2.348-2.270=0.078
max3.042-3.216=-0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.406-273.398=0.008
σ0.011-0.007=0.004
min273.391-273.390=0.002
max273.418-273.405=0.013
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean0.391-0.388=0.003
σ0.009-0.008=0.001
min0.379-0.379=0.000
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.844-1933.836=0.007
σ0.014-0.011=0.002
min1933.830-1933.825=0.005
max1933.862-1933.855=0.007
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean3.182-2.998=0.184
σ0.287-0.139=0.148
min3.008-2.772=0.236
max3.685-3.123=0.562
iters=5
new-facts=6402
prior-facts=1
mean4754.409-4754.377=0.032
σ0.781-0.850=-0.069
min4754.014-4753.928=0.086
max4755.802-4755.894=-0.092
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean8.033-8.245=-0.211
σ0.298-0.531=-0.233
min7.799-7.722=0.077
max8.544-9.049=-0.505
iters=5
new-facts=6402
prior-facts=6402
mean4944.799-4944.726=0.073
σ0.078-0.126=-0.047
min4944.733-4944.530=0.202
max4944.891-4944.880=0.012
mean2935.000-3058.600=-123.600
σ387.531-274.087=113.444
min2520.000-2846.000=-326.000
max3479.000-3480.000=-1.000
mean8.498-8.586=-0.087
σ0.155-0.420=-0.266
min8.334-8.355=-0.021
max8.703-9.336=-0.633

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.652-1.196=0.456
σ0.187-0.203=-0.016
min1.388-1.069=0.319
max1.850-1.535=0.315

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.341=-0.008
σ572.198-572.209=-0.011
min177.234-177.232=0.002
max1321.630-1321.654=-0.025
mean79.750
σ7.500
min76.000
max91.000
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean0.562-0.441=0.120
σ0.557-0.305=0.253
min0.276-0.286=-0.010
max1.398-0.898=0.499
policies=20
mean1772.571-1772.606=-0.035
σ0.334-0.341=-0.007
min1772.347-1772.360=-0.013
max1773.067-1773.106=-0.039
mean760.000
σ0.000
min760.000
max760.000
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean2.742-2.843=-0.101
σ0.007-0.007=0.000
min2.734-2.833=-0.099
max2.752-2.850=-0.098
policies=200
mean17732.393-17732.435=-0.042
σ0.420-0.422=-0.002
min17732.088-17731.952=0.136
max17733.001-17732.981=0.020
mean7600.000
σ0.000
min7600.000
max7600.000
mean2520.000-2846.000=-326.000
σ0.000
min2520.000-2846.000=-326.000
max2520.000-2846.000=-326.000
mean27.658-28.150=-0.492
σ0.091-0.536=-0.445
min27.602-27.603=-0.001
max27.794-28.619=-0.824