Compare commits

Home / Compare b743f6ae .. 72a780c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.966=0.009
σ0.107-0.102=0.005
min35.929-35.926=0.002
max36.279-36.255=0.024
mean415.000-413.900=1.100
σ0.000-0.316=-0.316
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.077-0.075=0.002
σ0.003-0.004=-0.001
min0.075-0.070=0.004
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.003-0.006=-0.002
min26.204-26.201=0.003
max26.213-26.219=-0.006
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.058-0.061=-0.003
σ0.003-0.002=0.000
min0.056-0.058=-0.002
max0.065-0.067=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1757.761=0.616
σ0.369-0.369=-0.001
min1757.798-1757.180=0.618
max1758.972-1758.355=0.618
mean1659.100-1663.750=-4.650
σ632.828-621.341=11.486
min672.000-661.000=11.000
max2746.000-2610.000=136.000
mean2.360-2.352=0.008
σ0.071-0.116=-0.045
min2.270-2.197=0.073
max2.482-2.622=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.558-280.290=-0.733
σ0.008-0.012=-0.004
min279.550-280.275=-0.725
max279.568-280.303=-0.735
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean0.415-0.414=0.001
σ0.008-0.007=0.001
min0.407-0.406=0.001
max0.424-0.422=0.002
iters=5
new-facts=1
prior-facts=6402
mean2178.496-2270.305=-91.808
σ0.014-0.016=-0.002
min2178.482-2270.279=-91.797
max2178.516-2270.319=-91.803
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean3.406-3.123=0.283
σ0.097-0.157=-0.060
min3.262-2.915=0.347
max3.536-3.340=0.195
iters=5
new-facts=6402
prior-facts=1
mean5056.427-5147.587=-91.159
σ1.021-1.015=0.006
min5055.827-5146.982=-91.155
max5058.237-5149.392=-91.156
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean9.234-8.921=0.314
σ0.493-0.703=-0.209
min8.555-8.144=0.412
max9.836-9.907=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean5193.666-5285.634=-91.968
σ0.101-0.083=0.018
min5193.553-5285.562=-92.009
max5193.741-5285.727=-91.986
mean3292.600-3493.000=-200.400
σ400.553-534.992=-134.438
min2746.000-2780.000=-34.000
max3666.000-4002.000=-336.000
mean8.932-9.814=-0.881
σ0.295-0.500=-0.205
min8.670-8.955=-0.285
max9.414-10.257=-0.843

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.245=-0.243
σ0.074-0.391=-0.317
min0.941-0.934=0.008
max1.082-1.836=-0.754

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.534-464.304=1.230
σ572.662-572.672=-0.010
min179.196-177.964=1.232
max1324.527-1323.312=1.215
mean79.500-81.500=-2.000
σ7.000
min76.000-78.000=-2.000
max90.000-92.000=-2.000
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean0.469-0.558=-0.088
σ0.381-0.558=-0.177
min0.272-0.273=-0.001
max1.041-1.395=-0.354
policies=20
mean1792.282-1779.886=12.396
σ0.333-0.372=-0.039
min1792.089-1779.662=12.428
max1792.780-1780.442=12.338
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean2.789-2.796=-0.007
σ0.016-0.042=-0.026
min2.771-2.767=0.004
max2.807-2.858=-0.050
policies=200
mean17929.581-17805.839=123.741
σ0.506-0.461=0.045
min17929.314-17805.479=123.835
max17930.339-17806.515=123.824
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean2746.000-2610.000=136.000
σ0.000
min2746.000-2610.000=136.000
max2746.000-2610.000=136.000
mean28.174-27.840=0.334
σ0.077-0.097=-0.020
min28.097-27.713=0.384
max28.277-27.933=0.343