Compare commits

Home / Compare 82213ba8 .. bd28a7af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.982
σ0.098
min35.935
max36.260
mean3987.000
σ0.000
min3987.000
max3987.000
mean0.075
σ0.001
min0.074
max0.076
cache=y
dps=1
iters=10
policies=100
mean26.210
σ0.004
min26.203
max26.216
mean3987.000
σ0.000
min3987.000
max3987.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1755.332=1.038
σ0.372-0.368=0.004
min1755.794-1754.756=1.038
max1756.968-1755.921=1.046
mean1657.250-1653.200=4.050
σ630.194-630.061=0.132
min611.000-619.000=-8.000
max2659.000-2668.000=-9.000
mean2.300-2.285=0.015
σ0.178-0.110=0.068
min2.152-2.171=-0.019
max2.783-2.626=0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-277.721=0.975
σ0.012-0.008=0.004
min278.687-277.712=0.975
max278.718-277.733=0.985
mean2659.000-2668.000=-9.000
σ0.000
min2659.000-2668.000=-9.000
max2659.000-2668.000=-9.000
mean0.415-0.408=0.008
σ0.001-0.001=0.000
min0.414-0.407=0.008
max0.417-0.409=0.008
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2267.891=0.981
σ0.003-0.007=-0.004
min2268.869-2267.881=0.988
max2268.876-2267.896=0.980
mean2659.000-2668.000=-9.000
σ0.000
min2659.000-2668.000=-9.000
max2659.000-2668.000=-9.000
mean2.891-3.085=-0.194
σ0.027-0.176=-0.149
min2.868-2.846=0.022
max2.934-3.239=-0.305
iters=5
new-facts=6402
prior-facts=1
mean4952.218-4955.080=-2.862
σ0.762-0.806=-0.044
min4951.859-4954.618=-2.759
max4953.580-4956.517=-2.937
mean2659.000-2668.000=-9.000
σ0.000
min2659.000-2668.000=-9.000
max2659.000-2668.000=-9.000
mean7.745-7.868=-0.123
σ0.090-0.178=-0.087
min7.605-7.668=-0.063
max7.841-8.010=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean5166.920-5169.793=-2.873
σ0.009-0.084=-0.075
min5166.909-5169.700=-2.791
max5166.933-5169.868=-2.935
mean3399.400-3425.000=-25.600
σ459.749-501.460=-41.711
min2782.000-2830.000=-48.000
max3987.000-4163.000=-176.000
mean9.464-9.268=0.196
σ0.363-0.308=0.055
min8.976-8.979=-0.003
max9.968-9.787=0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.028=0.002
σ0.133-0.139=-0.006
min0.929-0.928=0.001
max1.242-1.253=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.260-456.317=3.943
σ572.607-572.591=0.016
min173.955-170.021=3.934
max1319.170-1315.203=3.967
mean79.500
σ7.000
min76.000
max90.000
mean435.000-431.000=4.000
σ0.000
min435.000-431.000=4.000
max435.000-431.000=4.000
mean0.558-0.548=0.009
σ0.564-0.565=-0.001
min0.272-0.264=0.008
max1.404-1.397=0.007
policies=20
mean1740.057-1700.725=39.332
σ0.324-0.300=0.024
min1739.816-1700.499=39.317
max1740.530-1701.163=39.367
mean760.000
σ0.000
min760.000
max760.000
mean445.500-443.500=2.000
σ9.950-11.240=-1.290
min435.000-431.000=4.000
max454.000-453.000=1.000
mean2.646-2.616=0.029
σ0.008-0.024=-0.016
min2.638-2.593=0.045
max2.656-2.643=0.013
policies=200
mean17409.791-17016.858=392.933
σ0.100-0.157=-0.057
min17409.707-17016.628=393.079
max17409.915-17016.974=392.941
mean7600.000
σ0.000
min7600.000
max7600.000
mean487.500-488.500=-1.000
σ2.517-2.380=0.136
min485.000-486.000=-1.000
max491.000
mean26.831-26.374=0.457
σ0.056-0.036=0.019
min26.786-26.322=0.465
max26.912-26.401=0.511