Compare commits

Home / Compare 3a8985f6 .. aad4dead

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.967=0.008
σ0.106-0.102=0.004
min35.931-35.924=0.007
max36.276-36.254=0.021
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.077-0.078=-0.001
σ0.004-0.004=-0.001
min0.075-0.075=0.000
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.004-0.003=0.002
min26.201-26.206=-0.004
max26.215-26.214=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.061-0.060=0.001
σ0.003-0.003=-0.000
min0.059-0.057=0.002
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1720.322-1756.313=-35.990
σ170.103-0.366=169.737
min997.635-1755.740=-758.105
max1758.975-1756.908=2.067
mean1639.300-1658.600=-19.300
σ603.693-637.262=-33.569
min687.000-612.000=75.000
max2759.000-2692.000=67.000
mean2.333-2.394=-0.061
σ0.258-0.175=0.083
min1.329-2.276=-0.947
max2.611-3.066=-0.455

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.555-278.846=0.709
σ0.008-0.005=0.003
min279.544-278.837=0.707
max279.563-278.850=0.714
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean0.410-0.412=-0.002
σ0.005-0.007=-0.002
min0.406-0.406=0.000
max0.419-0.422=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.481-2268.909=-90.428
σ0.015-0.005=0.010
min2178.461-2268.902=-90.441
max2178.494-2268.915=-90.421
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean3.293-3.007=0.286
σ0.183-0.133=0.050
min3.014-2.900=0.114
max3.468-3.169=0.299
iters=5
new-facts=6402
prior-facts=1
mean5056.429-4954.038=102.391
σ0.982-1.005=-0.023
min5055.810-4953.241=102.570
max5058.173-4955.744=102.428
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean9.003-8.047=0.956
σ0.627-0.176=0.452
min8.265-7.862=0.403
max9.703-8.235=1.468
iters=5
new-facts=6402
prior-facts=6402
mean5193.808-5168.813=24.995
σ0.088-0.080=0.009
min5193.737-5168.744=24.993
max5193.907-5168.902=25.005
mean3291.600-3479.600=-188.000
σ397.385-475.204=-77.820
min2759.000-2849.000=-90.000
max3667.000-4127.000=-460.000
mean9.028-9.215=-0.187
σ0.289-0.300=-0.011
min8.752-8.920=-0.168
max9.496-9.686=-0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.172=-0.195
σ0.058-0.369=-0.312
min0.941-0.934=0.007
max1.077-1.823=-0.746

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.550-460.358=5.192
σ572.660-572.650=0.010
min179.217-174.024=5.193
max1324.541-1319.334=5.207
mean79.500
σ7.000
min76.000
max90.000
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean0.477-0.533=-0.056
σ0.377-0.537=-0.159
min0.287-0.263=0.024
max1.043-1.338=-0.295
policies=20
mean1792.450-1740.482=51.968
σ0.351-0.326=0.025
min1792.202-1740.276=51.926
max1792.964-1740.968=51.996
mean760.000
σ0.000
min760.000
max760.000
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean2.890-2.697=0.193
σ0.004-0.014=-0.009
min2.885-2.682=0.203
max2.894-2.713=0.182
policies=200
mean17929.651-17411.848=517.803
σ0.438-0.438=0.000
min17929.199-17411.507=517.692
max17930.077-17412.491=517.586
mean7600.000
σ0.000
min7600.000
max7600.000
mean2759.000-2692.000=67.000
σ0.000
min2759.000-2692.000=67.000
max2759.000-2692.000=67.000
mean28.448-26.987=1.461
σ0.231-0.075=0.156
min28.270-26.900=1.370
max28.787-27.056=1.731