Compare commits

Home / Compare 575a6858 .. c8f41585

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.987-33.986=0.002
σ0.055-0.054=0.001
min33.953-33.954=-0.001
max34.142-34.138=0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.082-0.082=0.000
σ0.005-0.004=0.001
min0.075-0.076=-0.001
max0.092-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.003-0.003=0.000
min23.320-23.319=0.001
max23.329-23.328=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.061=0.004
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.073-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.727-1756.725=0.002
σ0.366-0.366=-0.000
min1756.150-1756.151=-0.000
max1757.319-1757.317=0.002
mean1644.550-1675.900=-31.350
σ621.909-634.669=-12.759
min654.000-671.000=-17.000
max2827.000-2690.000=137.000
mean2.338-2.357=-0.019
σ0.065-0.100=-0.034
min2.260-2.244=0.016
max2.485-2.638=-0.153

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.325-325.314=0.012
σ0.043-0.052=-0.009
min325.252-325.221=0.030
max325.364-325.341=0.023
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean0.431-0.427=0.004
σ0.006-0.001=0.005
min0.425-0.426=-0.002
max0.441-0.429=0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.875-1985.878=-0.003
σ0.020-0.013=0.006
min1985.841-1985.854=-0.013
max1985.888-1985.885=0.003
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean2.669-2.721=-0.052
σ0.087-0.096=-0.009
min2.561-2.602=-0.040
max2.804-2.848=-0.045
iters=5
new-facts=6402
prior-facts=1
mean4809.533-4809.634=-0.101
σ7.745-7.713=0.032
min4805.571-4806.170=-0.599
max4823.377-4823.431=-0.053
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean8.879-8.951=-0.072
σ0.324-0.164=0.160
min8.434-8.677=-0.244
max9.192-9.088=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4997.040-4997.115=-0.075
σ0.185-0.172=0.013
min4996.821-4996.810=0.011
max4997.184-4997.213=-0.029
mean3050.600-2964.800=85.800
σ222.029-323.851=-101.823
min2827.000-2690.000=137.000
max3271.000-3443.000=-172.000
mean8.903-8.525=0.378
σ0.341-0.073=0.268
min8.606-8.443=0.163
max9.436-8.625=0.811

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-1.014=-0.036
σ0.068-0.145=-0.077
min0.922-0.917=0.005
max1.053-1.254=-0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.381-463.372=0.009
σ574.771-574.777=-0.006
min175.988-175.977=0.011
max1325.537-1325.538=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean0.432-0.551=-0.119
σ0.304-0.550=-0.246
min0.274-0.272=0.002
max0.888-1.376=-0.488
policies=20
mean1760.157-1760.132=0.025
σ0.352-0.350=0.002
min1759.918-1759.900=0.018
max1760.679-1760.652=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean2.805-2.721=0.084
σ0.015-0.035=-0.020
min2.795-2.695=0.100
max2.827-2.773=0.054
policies=200
mean17608.289-17608.406=-0.117
σ0.518-0.510=0.008
min17607.960-17608.103=-0.143
max17609.060-17609.169=-0.109
mean8200.000
σ0.000
min8200.000
max8200.000
mean2827.000-2690.000=137.000
σ0.000
min2827.000-2690.000=137.000
max2827.000-2690.000=137.000
mean27.915-27.562=0.353
σ0.430-0.179=0.252
min27.505-27.378=0.127
max28.431-27.791=0.640