Compare commits

Home / Compare ba0454d6 .. 882caef0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.050-0.050=0.001
min33.943-33.942=0.001
max34.118-34.119=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.082-0.085=-0.003
σ0.004-0.003=0.001
min0.077-0.082=-0.006
max0.088-0.090=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.001
σ0.004-0.003=0.001
min23.312-23.313=-0.000
max23.322-23.322=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.063=0.000
σ0.003-0.004=-0.001
min0.059-0.060=-0.000
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.303=-0.001
σ0.366-0.365=0.001
min1756.737-1756.729=0.009
max1757.895-1757.894=0.001
mean1653.450-1654.500=-1.050
σ638.013-633.076=4.937
min628.000-636.000=-8.000
max2757.000-2850.000=-93.000
mean2.417-2.375=0.042
σ0.190-0.086=0.104
min2.287-2.277=0.011
max3.099-2.575=0.524

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-326.453=-0.008
σ0.053-0.028=0.025
min326.352-326.405=-0.053
max326.484-326.470=0.013
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean0.424-0.426=-0.002
σ0.002-0.005=-0.003
min0.422-0.422=0.000
max0.426-0.433=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1988.616=-0.000
σ0.007-0.009=-0.002
min1988.606-1988.606=-0.000
max1988.623-1988.627=-0.004
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean2.683-2.723=-0.039
σ0.052-0.117=-0.066
min2.626-2.626=0.000
max2.761-2.926=-0.165
iters=5
new-facts=6402
prior-facts=1
mean4813.496-4813.448=0.048
σ7.714-7.674=0.040
min4809.914-4809.986=-0.072
max4827.294-4827.176=0.117
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean8.282-8.597=-0.314
σ0.605-0.115=0.490
min7.703-8.429=-0.726
max9.197-8.752=0.444
iters=5
new-facts=6402
prior-facts=6402
mean5001.021-5000.946=0.074
σ0.034-0.176=-0.142
min5000.982-5000.634=0.347
max5001.067-5001.065=0.002
mean3014.400-3042.600=-28.200
σ320.136-184.975=135.160
min2757.000-2850.000=-93.000
max3503.000-3310.000=193.000
mean9.634-9.771=-0.137
σ0.594-0.293=0.301
min8.595-9.281=-0.686
max10.111-10.065=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-1.020=-0.070
σ0.058-0.166=-0.108
min0.908-0.903=0.006
max1.050-1.297=-0.247

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.433-464.442=-0.009
σ574.776-574.774=0.001
min177.041-177.046=-0.005
max1326.596-1326.604=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean0.430-0.436=-0.006
σ0.305-0.304=0.001
min0.277-0.279=-0.002
max0.887-0.892=-0.004
policies=20
mean1770.846-1770.796=0.050
σ0.346-0.377=-0.030
min1770.565-1770.540=0.025
max1771.326-1771.351=-0.025
mean840.000
σ0.000
min840.000
max840.000
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean2.837-2.813=0.024
σ0.125-0.025=0.101
min2.695-2.789=-0.094
max3.000-2.837=0.163
policies=200
mean17714.796-17715.005=-0.209
σ0.557-0.502=0.056
min17714.487-17714.612=-0.125
max17715.631-17715.730=-0.099
mean8400.000
σ0.000
min8400.000
max8400.000
mean2757.000-2850.000=-93.000
σ0.000
min2757.000-2850.000=-93.000
max2757.000-2850.000=-93.000
mean27.500-28.106=-0.606
σ0.149-0.382=-0.233
min27.370-27.659=-0.289
max27.650-28.586=-0.936