Compare commits

Home / Compare 94583148 .. 5479a1b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.045-0.045=0.000
min70.351-70.353=-0.002
max70.505-70.505=0.001
mean415.600-414.000=1.600
σ0.516-0.000=0.516
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.160-0.159=0.001
σ0.004-0.005=-0.001
min0.155-0.150=0.005
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.004=-0.001
min21.140-21.137=0.002
max21.149-21.149=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.066-0.062=0.003
σ0.002-0.004=-0.002
min0.063-0.059=0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.386=-0.001
σ0.360-0.359=0.001
min1751.816-1751.819=-0.003
max1752.948-1752.967=-0.019
mean1638.300-1661.750=-23.450
σ614.647-641.739=-27.092
min629.000-619.000=10.000
max2472.000-2835.000=-363.000
mean2.812-2.799=0.013
σ0.155-0.189=-0.034
min2.374-2.163=0.212
max3.004-2.949=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.126=0.003
σ0.008-0.011=-0.004
min270.118-270.107=0.011
max270.139-270.136=0.003
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean0.378-0.376=0.002
σ0.004-0.005=-0.001
min0.372-0.372=-0.000
max0.381-0.382=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.593-1930.585=0.008
σ0.003-0.017=-0.014
min1930.590-1930.560=0.029
max1930.596-1930.607=-0.011
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean2.533-2.475=0.058
σ0.100-0.088=0.012
min2.453-2.377=0.076
max2.681-2.576=0.104
iters=5
new-facts=6402
prior-facts=1
mean4750.990-4751.127=-0.138
σ0.970-0.784=0.186
min4750.012-4750.645=-0.632
max4752.614-4752.520=0.094
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean8.292-8.125=0.166
σ0.483-0.379=0.104
min7.720-7.694=0.026
max8.851-8.528=0.322
iters=5
new-facts=6402
prior-facts=6402
mean4941.526-4941.523=0.002
σ0.085-0.080=0.005
min4941.459-4941.450=0.009
max4941.626-4941.611=0.014
mean2947.400-3049.400=-102.000
σ415.852-275.915=139.937
min2472.000-2835.000=-363.000
max3513.000-3470.000=43.000
mean8.572-8.421=0.151
σ0.207-0.098=0.109
min8.321-8.349=-0.028
max8.784-8.593=0.191

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.864-1.065=0.798
σ0.020-0.129=-0.108
min1.839-0.947=0.892
max1.890-1.262=0.628

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.365=-0.002
σ575.938-575.938=0.000
min178.392-178.393=-0.001
max1330.270-1330.271=-0.001
mean84.250
σ8.500
min80.000
max97.000
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean0.557-0.445=0.113
σ0.549-0.310=0.240
min0.280-0.288=-0.007
max1.381-0.909=0.472
policies=20
mean1784.228-1784.266=-0.038
σ0.362-0.350=0.011
min1783.997-1784.027=-0.030
max1784.766-1784.783=-0.017
mean800.000
σ0.000
min800.000
max800.000
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean2.786-2.850=-0.063
σ0.017-0.028=-0.011
min2.764-2.809=-0.045
max2.805-2.874=-0.070
policies=200
mean17848.896-17848.895=0.001
σ0.443-0.516=-0.073
min17848.615-17848.603=0.012
max17849.553-17849.668=-0.115
mean8000.000
σ0.000
min8000.000
max8000.000
mean2472.000-2835.000=-363.000
σ0.000
min2472.000-2835.000=-363.000
max2472.000-2835.000=-363.000
mean28.050-28.013=0.037
σ0.015-0.168=-0.152
min28.038-27.866=0.172
max28.072-28.180=-0.108