Compare commits

Home / Compare 3a89270b .. 9adf57cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.377-70.375=0.002
σ0.058-0.057=0.001
min70.336-70.338=-0.002
max70.538-70.533=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.161-0.157=0.005
σ0.004-0.004=-0.001
min0.155-0.150=0.006
max0.168-0.163=0.005
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.000
σ0.003-0.002=0.001
min21.137-21.139=-0.002
max21.149-21.147=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.064=-0.004
σ0.003-0.003=-0.001
min0.058-0.060=-0.003
max0.066-0.073=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.197-1752.199=-0.002
σ0.362-0.361=0.001
min1751.631-1751.627=0.004
max1752.768-1752.781=-0.013
mean1632.900-1632.950=-0.050
σ597.743-623.681=-25.938
min626.000-621.000=5.000
max2420.000-2769.000=-349.000
mean2.795-2.827=-0.032
σ0.204-0.177=0.026
min2.303-2.203=0.099
max3.033-3.037=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.936-269.929=0.007
σ0.009-0.009=0.000
min269.924-269.923=0.001
max269.949-269.945=0.004
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean0.382-0.373=0.010
σ0.007-0.007=-0.000
min0.378-0.369=0.009
max0.394-0.385=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.391-1930.384=0.007
σ0.023-0.017=0.006
min1930.355-1930.369=-0.014
max1930.409-1930.403=0.006
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean2.556-2.549=0.007
σ0.158-0.201=-0.043
min2.444-2.299=0.145
max2.812-2.813=-0.002
iters=5
new-facts=6402
prior-facts=1
mean4750.838-4750.817=0.021
σ0.820-0.846=-0.026
min4750.300-4750.155=0.145
max4752.281-4752.298=-0.017
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean8.682-8.059=0.623
σ0.262-0.397=-0.135
min8.433-7.662=0.772
max9.027-8.531=0.496
iters=5
new-facts=6402
prior-facts=6402
mean4941.262-4941.325=-0.063
σ0.203-0.082=0.120
min4940.927-4941.257=-0.330
max4941.427-4941.420=0.007
mean2969.000-3045.000=-76.000
σ257.671-340.348=-82.676
min2645.000-2769.000=-124.000
max3316.000-3557.000=-241.000
mean8.452-8.401=0.050
σ0.048-0.110=-0.062
min8.400-8.271=0.129
max8.511-8.564=-0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.809-1.030=0.779
σ0.037-0.135=-0.098
min1.771-0.940=0.831
max1.867-1.248=0.619

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.901-465.929=-0.029
σ575.754-575.794=-0.040
min178.021-178.023=-0.003
max1329.531-1329.620=-0.089
mean81.750
σ7.500
min78.000
max93.000
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean0.558-0.577=-0.019
σ0.557-0.593=-0.037
min0.279-0.279=0.000
max1.393-1.467=-0.073
policies=20
mean1780.447-1780.460=-0.013
σ0.352-0.354=-0.002
min1780.205-1780.231=-0.026
max1780.969-1780.987=-0.018
mean780.000
σ0.000
min780.000
max780.000
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean2.759-2.771=-0.012
σ0.007-0.015=-0.008
min2.752-2.758=-0.006
max2.766-2.789=-0.023
policies=200
mean17811.190-17811.149=0.041
σ0.578-0.429=0.149
min17810.869-17810.851=0.018
max17812.056-17811.772=0.284
mean7800.000
σ0.000
min7800.000
max7800.000
mean2420.000-2769.000=-349.000
σ0.000
min2420.000-2769.000=-349.000
max2420.000-2769.000=-349.000
mean27.823-27.865=-0.041
σ0.196-0.127=0.069
min27.686-27.739=-0.053
max28.106-28.036=0.070