Compare commits

Home / Compare d384c6f9 .. 33073bbb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.263=0.354
σ0.053-0.054=-0.001
min35.591-35.239=0.352
max35.768-35.417=0.352
mean415.000
σ0.000
min415.000
max415.000
mean0.082-0.083=-0.000
σ0.004-0.004=0.001
min0.076-0.077=-0.001
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-23.770=0.278
σ0.003-0.002=0.001
min24.044-23.766=0.278
max24.054-23.773=0.281
mean415.000
σ0.000
min415.000
max415.000
mean0.068-0.068=-0.000
σ0.003-0.003=-0.000
min0.067-0.067=-0.000
max0.075-0.077=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.470=0.017
σ0.365-0.364=0.000
min1755.912-1755.895=0.017
max1757.072-1757.067=0.005
mean1654.050-1647.050=7.000
σ643.499-635.198=8.301
min628.000-627.000=1.000
max2841.000-2834.000=7.000
mean2.347-2.329=0.017
σ0.079-0.081=-0.003
min2.265-2.248=0.017
max2.534-2.548=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.693=0.072
σ0.045-0.047=-0.001
min324.684-324.611=0.073
max324.792-324.728=0.065
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean0.416-0.425=-0.008
σ0.001-0.002=-0.001
min0.415-0.423=-0.008
max0.418-0.427=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.246=0.071
σ0.016-0.023=-0.007
min1985.287-1985.207=0.081
max1985.326-1985.262=0.063
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean2.742-2.597=0.145
σ0.142-0.067=0.075
min2.599-2.542=0.057
max2.949-2.690=0.259
iters=5
new-facts=6402
prior-facts=1
mean4809.105-4808.841=0.264
σ7.648-7.680=-0.033
min4805.580-4805.378=0.203
max4822.784-4822.580=0.204
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean8.824-8.871=-0.047
σ0.314-0.135=0.178
min8.477-8.663=-0.186
max9.194-9.028=0.166
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.388=0.242
σ0.020-0.149=-0.129
min4996.610-4996.124=0.486
max4996.660-4996.484=0.176
mean3078.800-3042.200=36.600
σ255.919-216.117=39.802
min2841.000-2834.000=7.000
max3348.000-3349.000=-1.000
mean8.720-8.572=0.148
σ0.125-0.087=0.038
min8.527-8.441=0.086
max8.827-8.684=0.144

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-0.953=0.001
σ0.056-0.067=-0.011
min0.918-0.907=0.010
max1.052-1.070=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-462.947=0.257
σ574.773-574.248=0.526
min175.811-175.817=-0.006
max1325.364-1324.318=1.045
mean86.250
σ8.500
min82.000
max99.000
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean0.431-0.399=0.032
σ0.299-0.261=0.039
min0.279-0.263=0.017
max0.880-0.790=0.090
policies=20
mean1758.496-1758.501=-0.005
σ0.344-0.359=-0.015
min1758.262-1758.277=-0.015
max1759.004-1759.036=-0.032
mean820.000
σ0.000
min820.000
max820.000
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean2.795-2.806=-0.010
σ0.016-0.017=-0.001
min2.778-2.787=-0.010
max2.815-2.821=-0.006
policies=200
mean17592.058-17591.034=1.023
σ0.512-0.759=-0.247
min17591.715-17590.083=1.631
max17592.819-17591.666=1.153
mean8200.000
σ0.000
min8200.000
max8200.000
mean2841.000-2834.000=7.000
σ0.000
min2841.000-2834.000=7.000
max2841.000-2834.000=7.000
mean27.780-27.955=-0.175
σ0.353-0.336=0.017
min27.358-27.657=-0.299
max28.164-28.344=-0.180