Compare commits

Home / Compare 264b2282 .. 738fd0ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.686-70.687=-0.001
σ0.045-0.048=-0.003
min70.663-70.661=0.002
max70.813-70.823=-0.010
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.161=0.000
σ0.003-0.004=-0.001
min0.158-0.157=0.001
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=-0.000
σ0.004-0.003=0.001
min21.415-21.416=-0.001
max21.426-21.425=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.001
min0.060-0.063=-0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.459=-0.002
σ0.357-0.361=-0.004
min1753.887-1753.889=-0.002
max1755.030-1755.039=-0.009
mean1673.200-1638.300=34.900
σ651.225-628.609=22.616
min625.000-639.000=-14.000
max2843.000-2847.000=-4.000
mean2.813-2.826=-0.012
σ0.126-0.176=-0.051
min2.529-2.309=0.220
max2.970-3.164=-0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-273.504=-0.002
σ0.005-0.008=-0.002
min273.495-273.495=0.000
max273.508-273.514=-0.007
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean0.376-0.387=-0.010
σ0.006-0.004=0.002
min0.373-0.384=-0.012
max0.387-0.394=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.895-1933.902=-0.007
σ0.008-0.016=-0.008
min1933.886-1933.885=0.001
max1933.905-1933.928=-0.023
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean2.924-2.925=-0.002
σ0.271-0.267=0.005
min2.564-2.461=0.103
max3.290-3.122=0.168
iters=5
new-facts=6402
prior-facts=1
mean4754.587-4754.731=-0.144
σ0.883-0.781=0.102
min4753.889-4754.349=-0.459
max4756.126-4756.126=0.000
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean8.130-7.970=0.160
σ0.501-0.299=0.202
min7.711-7.717=-0.006
max8.901-8.314=0.587
iters=5
new-facts=6402
prior-facts=6402
mean4945.120-4945.043=0.077
σ0.011-0.159=-0.148
min4945.110-4944.758=0.352
max4945.138-4945.124=0.014
mean3082.600-3051.000=31.600
σ318.285-275.778=42.507
min2843.000-2847.000=-4.000
max3570.000-3469.000=101.000
mean8.585-8.434=0.152
σ0.298-0.089=0.209
min8.347-8.365=-0.018
max9.085-8.587=0.498

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.030=-0.002
σ0.146-0.153=-0.006
min0.935-0.934=0.001
max1.269-1.284=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.566-472.566=-0.000
σ574.929-574.931=-0.001
min185.099-185.096=0.003
max1334.960-1334.962=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean0.450-0.454=-0.003
σ0.302-0.299=0.003
min0.293-0.300=-0.006
max0.903-0.902=0.001
policies=20
mean1851.279-1851.305=-0.026
σ0.371-0.371=0.000
min1851.009-1851.028=-0.019
max1851.819-1851.842=-0.024
mean840.000
σ0.000
min840.000
max840.000
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean2.970-2.961=0.008
σ0.035-0.015=0.021
min2.935-2.947=-0.012
max3.016-2.982=0.034
policies=200
mean18519.369-18519.480=-0.112
σ0.422-0.477=-0.055
min18519.099-18519.168=-0.069
max18519.998-18520.189=-0.191
mean8400.000
σ0.000
min8400.000
max8400.000
mean2843.000-2847.000=-4.000
σ0.000
min2843.000-2847.000=-4.000
max2843.000-2847.000=-4.000
mean29.087-29.259=-0.172
σ0.473-0.567=-0.095
min28.832-28.967=-0.135
max29.795-30.110=-0.314