Compare commits

Home / Compare 7dc09f4d .. d65b1fc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.000
σ0.053-0.055=-0.003
min35.591-35.587=0.004
max35.766-35.774=-0.008
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.085-0.084=0.001
σ0.005-0.005=-0.000
min0.079-0.076=0.003
max0.093-0.090=0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=0.001
σ0.002-0.003=-0.001
min24.044-24.042=0.002
max24.051-24.052=-0.000
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.066-0.068=-0.002
σ0.005-0.003=0.002
min0.062-0.066=-0.005
max0.075-0.077=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.002
σ0.363-0.366=-0.002
min1755.916-1755.915=0.001
max1757.078-1757.080=-0.002
mean1652.100-1643.050=9.050
σ640.052-603.528=36.524
min636.000-646.000=-10.000
max2830.000-2460.000=370.000
mean2.354-2.332=0.023
σ0.074-0.100=-0.026
min2.241-2.157=0.085
max2.461-2.621=-0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.774-324.766=0.008
σ0.024-0.050=-0.026
min324.735-324.678=0.056
max324.797-324.794=0.003
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean0.417-0.433=-0.017
σ0.003-0.011=-0.007
min0.412-0.422=-0.010
max0.421-0.445=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.320-1985.324=-0.004
σ0.021-0.011=0.011
min1985.296-1985.309=-0.013
max1985.341-1985.335=0.006
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean2.625-2.651=-0.026
σ0.168-0.195=-0.027
min2.490-2.499=-0.008
max2.898-2.987=-0.089
iters=5
new-facts=6402
prior-facts=1
mean4809.091-4809.079=0.012
σ7.712-7.731=-0.019
min4805.605-4805.613=-0.008
max4822.886-4822.908=-0.022
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean8.939-8.780=0.159
σ0.318-0.624=-0.306
min8.410-7.683=0.727
max9.183-9.246=-0.063
iters=5
new-facts=6402
prior-facts=6402
mean4996.625-4996.551=0.075
σ0.029-0.137=-0.108
min4996.589-4996.308=0.281
max4996.652-4996.632=0.020
mean3058.600-2951.600=107.000
σ298.359-441.715=-143.357
min2830.000-2460.000=370.000
max3516.000-3546.000=-30.000
mean8.534-8.489=0.045
σ0.114-0.119=-0.006
min8.412-8.415=-0.002
max8.703-8.700=0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.655=-0.624
σ0.125-0.244=-0.119
min0.916-1.253=-0.338
max1.222-1.865=-0.642

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.200=0.009
σ574.773-574.763=0.009
min175.816-175.811=0.005
max1325.368-1325.345=0.023
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean0.432-0.518=-0.086
σ0.305-0.490=-0.185
min0.276-0.272=0.004
max0.889-1.253=-0.364
policies=20
mean1758.502-1758.492=0.010
σ0.347-0.367=-0.020
min1758.270-1758.236=0.035
max1759.017-1759.033=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean2.745-2.759=-0.014
σ0.125-0.038=0.086
min2.564-2.726=-0.162
max2.845-2.813=0.032
policies=200
mean17592.160-17592.026=0.134
σ0.487-0.445=0.043
min17591.839-17591.669=0.170
max17592.872-17592.675=0.197
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2460.000=370.000
σ0.000
min2830.000-2460.000=370.000
max2830.000-2460.000=370.000
mean27.862-27.526=0.335
σ0.365-0.180=0.185
min27.566-27.348=0.217
max28.341-27.733=0.608