Compare commits

Home / Compare 12bf96fb .. 7289f62f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=0.000
σ0.053-0.055=-0.002
min35.591-35.587=0.003
max35.768-35.773=-0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.082-0.084=-0.002
σ0.004-0.005=-0.001
min0.076-0.078=-0.002
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.003-0.003=0.000
min24.044-24.043=0.001
max24.054-24.051=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.068-0.065=0.004
σ0.003-0.003=-0.000
min0.067-0.061=0.005
max0.075-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.489=-0.002
σ0.365-0.365=0.000
min1755.912-1755.915=-0.003
max1757.072-1757.081=-0.009
mean1654.050-1655.850=-1.800
σ643.499-641.870=1.629
min628.000-623.000=5.000
max2841.000-2848.000=-7.000
mean2.347-2.354=-0.007
σ0.079-0.068=0.011
min2.265-2.266=-0.001
max2.534-2.507=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.762=0.003
σ0.045-0.056=-0.010
min324.684-324.663=0.021
max324.792-324.793=-0.001
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean0.416-0.429=-0.013
σ0.001-0.009=-0.008
min0.415-0.424=-0.009
max0.418-0.445=-0.028
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.316=0.000
σ0.016-0.015=0.001
min1985.287-1985.298=-0.011
max1985.326-1985.332=-0.006
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean2.742-2.658=0.085
σ0.142-0.105=0.036
min2.599-2.567=0.032
max2.949-2.778=0.172
iters=5
new-facts=6402
prior-facts=1
mean4809.105-4809.000=0.104
σ7.648-7.774=-0.127
min4805.580-4805.014=0.566
max4822.784-4822.897=-0.112
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean8.824-8.795=0.028
σ0.314-0.409=-0.095
min8.477-8.075=0.402
max9.194-9.056=0.137
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.489=0.142
σ0.020-0.192=-0.172
min4996.610-4996.256=0.354
max4996.660-4996.647=0.013
mean3078.800-3067.000=11.800
σ255.919-291.781=-35.861
min2841.000-2848.000=-7.000
max3348.000-3517.000=-169.000
mean8.720-8.543=0.177
σ0.125-0.132=-0.007
min8.527-8.465=0.062
max8.827-8.777=0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-1.009=-0.056
σ0.056-0.118=-0.062
min0.918-0.928=-0.010
max1.052-1.194=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.209=-0.006
σ574.773-574.767=0.006
min175.811-175.816=-0.004
max1325.364-1325.360=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean0.431-0.435=-0.005
σ0.299-0.301=-0.002
min0.279-0.283=-0.004
max0.880-0.887=-0.007
policies=20
mean1758.496-1758.501=-0.005
σ0.344-0.352=-0.008
min1758.262-1758.253=0.009
max1759.004-1759.020=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean2.795-2.791=0.004
σ0.016-0.004=0.012
min2.778-2.786=-0.008
max2.815-2.795=0.021
policies=200
mean17592.058-17592.131=-0.073
σ0.512-0.512=0.000
min17591.715-17591.834=-0.119
max17592.819-17592.897=-0.077
mean8200.000
σ0.000
min8200.000
max8200.000
mean2841.000-2848.000=-7.000
σ0.000
min2841.000-2848.000=-7.000
max2841.000-2848.000=-7.000
mean27.780-28.030=-0.250
σ0.353-0.376=-0.022
min27.358-27.662=-0.304
max28.164-28.494=-0.330