Compare commits

Home / Compare 1fc1b3d3 .. 433f9eac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.779-70.781=-0.002
σ0.052-0.052=-0.000
min70.747-70.747=0.000
max70.922-70.925=-0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.160-0.158=0.002
σ0.003-0.004=-0.001
min0.156-0.151=0.005
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.495=-0.001
σ0.002-0.002=0.000
min21.491-21.492=-0.001
max21.497-21.499=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.065-0.066=-0.001
σ0.002-0.002=-0.000
min0.063-0.064=-0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.882=-0.001
σ0.361-0.359=0.002
min1751.314-1751.317=-0.003
max1752.470-1752.462=0.008
mean1638.700-1662.350=-23.650
σ628.493-626.603=1.890
min626.000-650.000=-24.000
max2772.000-2505.000=267.000
mean2.854-2.841=0.012
σ0.178-0.104=0.074
min2.264-2.682=-0.418
max3.052-3.163=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-269.376=0.003
σ0.006-0.005=0.002
min269.372-269.368=0.004
max269.388-269.381=0.008
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean0.379-0.381=-0.002
σ0.008-0.005=0.003
min0.374-0.376=-0.002
max0.394-0.387=0.006
iters=5
new-facts=1
prior-facts=6402
mean1929.748-1929.742=0.007
σ0.011-0.015=-0.004
min1929.732-1929.717=0.015
max1929.761-1929.758=0.003
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean3.132-3.016=0.116
σ0.146-0.035=0.111
min2.943-2.969=-0.026
max3.323-3.042=0.281
iters=5
new-facts=6402
prior-facts=1
mean4750.530-4750.528=0.002
σ0.908-0.847=0.061
min4750.012-4750.034=-0.022
max4752.145-4752.037=0.108
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean8.445-8.312=0.133
σ0.497-0.454=0.043
min7.746-7.682=0.064
max8.995-8.924=0.070
iters=5
new-facts=6402
prior-facts=6402
mean4940.975-4940.981=-0.006
σ0.020-0.016=0.004
min4940.959-4940.963=-0.005
max4940.998-4940.998=-0.001
mean3053.400-2926.400=127.000
σ338.635-367.076=-28.441
min2772.000-2505.000=267.000
max3556.000-3423.000=133.000
mean8.405-8.400=0.005
σ0.109-0.092=0.017
min8.326-8.267=0.058
max8.596-8.516=0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.672=-0.671
σ0.135-0.279=-0.144
min0.938-1.247=-0.309
max1.243-1.914=-0.670

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.076-466.058=0.018
σ574.964-574.924=0.040
min178.587-178.590=-0.003
max1328.523-1328.445=0.078
mean86.250
σ8.500
min82.000
max99.000
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean0.569-0.540=0.029
σ0.571-0.527=0.045
min0.279-0.277=0.003
max1.426-1.330=0.096
policies=20
mean1786.143-1786.122=0.021
σ0.371-0.359=0.012
min1785.898-1785.926=-0.028
max1786.695-1786.660=0.035
mean820.000
σ0.000
min820.000
max820.000
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean2.775-2.782=-0.007
σ0.021-0.014=0.007
min2.760-2.765=-0.005
max2.806-2.799=0.007
policies=200
mean17868.389-17868.403=-0.014
σ0.469-0.588=-0.120
min17868.039-17868.002=0.037
max17869.068-17869.262=-0.194
mean8200.000
σ0.000
min8200.000
max8200.000
mean2772.000-2505.000=267.000
σ0.000
min2772.000-2505.000=267.000
max2772.000-2505.000=267.000
mean27.960-27.852=0.108
σ0.158-0.058=0.100
min27.824-27.797=0.027
max28.179-27.927=0.252