Compare commits

Home / Compare 972e9d80 .. 8e1f2013

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-35.617=-1.638
σ0.050-0.053=-0.003
min33.943-35.591=-1.648
max34.118-35.768=-1.650
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.082-0.082=-0.000
σ0.004-0.004=-0.000
min0.077-0.076=0.001
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-24.048=-0.729
σ0.004-0.003=0.000
min23.312-24.044=-0.731
max23.322-24.054=-0.732
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.068=-0.005
σ0.003-0.003=0.000
min0.059-0.067=-0.007
max0.069-0.075=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1756.487=0.815
σ0.366-0.365=0.001
min1756.737-1755.912=0.825
max1757.895-1757.072=0.823
mean1653.450-1654.050=-0.600
σ638.013-643.499=-5.486
min628.000
max2757.000-2841.000=-84.000
mean2.417-2.347=0.070
σ0.190-0.079=0.111
min2.287-2.265=0.022
max3.099-2.534=0.564

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-324.765=1.680
σ0.053-0.045=0.008
min326.352-324.684=1.667
max326.484-324.792=1.691
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean0.424-0.416=0.008
σ0.002-0.001=0.001
min0.422-0.415=0.007
max0.426-0.418=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1985.317=3.299
σ0.007-0.016=-0.010
min1988.606-1985.287=3.318
max1988.623-1985.326=3.298
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean2.683-2.742=-0.059
σ0.052-0.142=-0.090
min2.626-2.599=0.027
max2.761-2.949=-0.188
iters=5
new-facts=6402
prior-facts=1
mean4813.496-4809.105=4.391
σ7.714-7.648=0.066
min4809.914-4805.580=4.334
max4827.294-4822.784=4.509
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean8.282-8.824=-0.542
σ0.605-0.314=0.291
min7.703-8.477=-0.774
max9.197-9.194=0.003
iters=5
new-facts=6402
prior-facts=6402
mean5001.021-4996.631=4.390
σ0.034-0.020=0.014
min5000.982-4996.610=4.372
max5001.067-4996.660=4.407
mean3014.400-3078.800=-64.400
σ320.136-255.919=64.216
min2757.000-2841.000=-84.000
max3503.000-3348.000=155.000
mean9.634-8.720=0.914
σ0.594-0.125=0.469
min8.595-8.527=0.068
max10.111-8.827=1.283

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-0.953=-0.004
σ0.058-0.056=0.002
min0.908-0.918=-0.010
max1.050-1.052=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.433-463.204=1.229
σ574.776-574.773=0.002
min177.041-175.811=1.230
max1326.596-1325.364=1.232
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean0.430-0.431=-0.000
σ0.305-0.299=0.005
min0.277-0.279=-0.002
max0.887-0.880=0.008
policies=20
mean1770.846-1758.496=12.350
σ0.346-0.344=0.003
min1770.565-1758.262=12.303
max1771.326-1759.004=12.322
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean2.837-2.795=0.042
σ0.125-0.016=0.110
min2.695-2.778=-0.083
max3.000-2.815=0.185
policies=200
mean17714.796-17592.058=122.738
σ0.557-0.512=0.045
min17714.487-17591.715=122.772
max17715.631-17592.819=122.811
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2757.000-2841.000=-84.000
σ0.000
min2757.000-2841.000=-84.000
max2757.000-2841.000=-84.000
mean27.500-27.780=-0.280
σ0.149-0.353=-0.204
min27.370-27.358=0.012
max27.650-28.164=-0.513