Compare commits

Home / Compare be75fdf5 .. 5d7e330d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.001
σ0.054-0.050=0.005
min70.737-70.751=-0.014
max70.931-70.919=0.013
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.155-0.158=-0.004
σ0.005-0.005=0.001
min0.149-0.150=-0.002
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.001
σ0.003-0.003=0.000
min21.489-21.487=0.001
max21.498-21.498=0.000
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.066-0.063=0.002
σ0.003-0.004=-0.002
min0.064-0.058=0.006
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.880=0.000
σ0.360-0.359=0.000
min1751.307-1751.309=-0.002
max1752.450-1752.464=-0.014
mean1663.550-1671.200=-7.650
σ638.591-638.042=0.550
min676.000-682.000=-6.000
max2695.000-2698.000=-3.000
mean2.799-2.820=-0.020
σ0.154-0.109=0.045
min2.382-2.575=-0.193
max3.024-2.977=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.376-269.381=-0.005
σ0.005-0.007=-0.002
min269.369-269.372=-0.003
max269.383-269.388=-0.005
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean0.377-0.379=-0.001
σ0.006-0.007=-0.001
min0.374-0.374=-0.001
max0.388-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1929.748-1929.744=0.004
σ0.008-0.016=-0.008
min1929.741-1929.720=0.020
max1929.761-1929.759=0.002
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean2.874-3.124=-0.249
σ0.246-0.144=0.102
min2.511-3.003=-0.492
max3.146-3.369=-0.223
iters=5
new-facts=6402
prior-facts=1
mean4750.424-4750.496=-0.073
σ0.926-0.875=0.051
min4749.711-4750.075=-0.365
max4752.046-4752.061=-0.015
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean8.314-8.609=-0.295
σ0.434-0.225=0.209
min7.613-8.288=-0.675
max8.773-8.924=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean4940.919-4940.984=-0.064
σ0.138-0.017=0.121
min4940.674-4940.964=-0.290
max4940.997-4941.000=-0.004
mean2968.400-3010.000=-41.600
σ327.440-341.239=-13.799
min2695.000-2698.000=-3.000
max3465.000-3512.000=-47.000
mean8.439-8.466=-0.027
σ0.129-0.151=-0.022
min8.290-8.319=-0.029
max8.633-8.702=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.097-1.092=0.005
σ0.178-0.235=-0.056
min0.932-0.933=-0.001
max1.321-1.461=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.699-462.699=-0.000
σ574.940-574.935=0.006
min175.225-175.221=0.003
max1325.109-1325.101=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean0.548-0.548=0.000
σ0.537-0.530=0.006
min0.274-0.277=-0.003
max1.353-1.343=0.010
policies=20
mean1752.504-1752.485=0.019
σ0.365-0.348=0.017
min1752.269-1752.257=0.011
max1753.048-1753.003=0.045
mean820.000
σ0.000
min820.000
max820.000
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean2.748-2.714=0.034
σ0.009-0.035=-0.025
min2.736-2.666=0.070
max2.757-2.746=0.012
policies=200
mean17532.146-17532.208=-0.062
σ0.419-0.449=-0.030
min17531.925-17531.877=0.048
max17532.774-17532.862=-0.087
mean8200.000
σ0.000
min8200.000
max8200.000
mean2695.000-2698.000=-3.000
σ0.000
min2695.000-2698.000=-3.000
max2695.000-2698.000=-3.000
mean27.602-27.502=0.100
σ0.140-0.150=-0.010
min27.489-27.373=0.116
max27.802-27.694=0.108