Compare commits

Home / Compare e1e933ac .. bea91749

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.375=0.001
σ0.057-0.057=-0.001
min70.340-70.337=0.003
max70.535-70.535=0.000
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.160-0.159=0.001
σ0.003-0.003=-0.000
min0.157-0.156=0.001
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.003-0.001=0.002
min21.139-21.141=-0.002
max21.147-21.145=0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.063-0.064=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1714.271=37.928
σ0.359-169.514=-169.155
min1751.625-994.087=757.539
max1752.763-1752.788=-0.024
mean1638.600-1655.450=-16.850
σ614.211-617.148=-2.937
min627.000-641.000=-14.000
max2469.000-2493.000=-24.000
mean2.823-2.759=0.065
σ0.170-0.349=-0.179
min2.166-1.372=0.794
max2.980-2.967=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.932=0.000
σ0.008-0.007=0.001
min269.924-269.924=-0.000
max269.941-269.943=-0.002
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean0.377-0.371=0.006
σ0.001-0.005=-0.003
min0.375-0.369=0.006
max0.379-0.380=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1930.388=0.005
σ0.011-0.017=-0.006
min1930.375-1930.363=0.012
max1930.399-1930.407=-0.007
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean2.612-2.554=0.058
σ0.098-0.164=-0.066
min2.507-2.444=0.063
max2.740-2.844=-0.104
iters=5
new-facts=6402
prior-facts=1
mean4750.783-4750.855=-0.072
σ0.906-0.810=0.096
min4749.796-4750.263=-0.467
max4752.272-4752.271=0.001
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean8.154-8.589=-0.435
σ0.341-0.340=0.001
min7.837-8.264=-0.427
max8.596-9.125=-0.528
iters=5
new-facts=6402
prior-facts=6402
mean4941.329-4941.332=-0.003
σ0.078-0.087=-0.009
min4941.249-4941.253=-0.004
max4941.413-4941.430=-0.016
mean2955.600-2991.000=-35.400
σ420.489-283.603=136.886
min2476.000-2603.000=-127.000
max3525.000-3326.000=199.000
mean8.484-8.527=-0.043
σ0.159-0.181=-0.022
min8.321-8.357=-0.036
max8.746-8.734=0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.782-1.551=0.231
σ0.090-0.300=-0.210
min1.679-1.248=0.432
max1.926-1.963=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.899-465.903=-0.004
σ575.752-575.760=-0.008
min178.021-178.017=0.004
max1329.527-1329.543=-0.016
mean81.750
σ7.500
min78.000
max93.000
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean0.574-0.546=0.028
σ0.591-0.532=0.059
min0.275-0.275=-0.000
max1.460-1.344=0.116
policies=20
mean1780.434-1780.453=-0.019
σ0.371-0.358=0.013
min1780.185-1780.208=-0.023
max1780.984-1780.982=0.002
mean780.000
σ0.000
min780.000
max780.000
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean2.765-2.788=-0.023
σ0.019-0.072=-0.053
min2.737-2.736=0.001
max2.777-2.895=-0.118
policies=200
mean17811.205-17811.337=-0.133
σ0.393-0.470=-0.077
min17810.892-17811.063=-0.171
max17811.779-17812.039=-0.260
mean7800.000
σ0.000
min7800.000
max7800.000
mean2469.000-2493.000=-24.000
σ0.000
min2469.000-2493.000=-24.000
max2469.000-2493.000=-24.000
mean27.871-27.843=0.028
σ0.099-0.117=-0.018
min27.760-27.732=0.028
max28.002-27.989=0.013