Compare commits

Home / Compare 47316f46 .. 1e8fea50

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.062-70.700=2.362
σ0.053-0.046=0.007
min73.038-70.671=2.366
max73.213-70.829=2.384
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.154=0.003
σ0.007-0.005=0.002
min0.140-0.147=-0.007
max0.165-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean23.755-21.409=2.345
σ0.003-0.003=-0.000
min23.750-21.404=2.346
max23.759-21.413=2.346
mean414.500-413.000=1.500
σ0.527-0.000=0.527
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.068-0.064=0.004
σ0.003-0.003=-0.000
min0.066-0.058=0.008
max0.075-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1754.931=0.888
σ0.361-0.361=0.000
min1755.246-1754.370=0.876
max1756.400-1755.513=0.887
mean1639.000-1648.800=-9.800
σ596.732-623.938=-27.206
min677.000-625.000=52.000
max2425.000-2771.000=-346.000
mean2.794-2.875=-0.082
σ0.140-0.118=0.022
min2.381-2.675=-0.293
max3.007-3.184=-0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.041-272.793=48.248
σ0.057-0.006=0.051
min320.939-272.783=48.156
max321.070-272.800=48.270
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean0.426-0.376=0.050
σ0.006-0.002=0.004
min0.420-0.374=0.045
max0.432-0.380=0.052
iters=5
new-facts=1
prior-facts=6402
mean1981.620-1933.221=48.399
σ0.011-0.021=-0.011
min1981.603-1933.194=48.410
max1981.632-1933.250=48.382
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean2.582-3.031=-0.449
σ0.082-0.126=-0.044
min2.488-2.849=-0.361
max2.666-3.157=-0.491
iters=5
new-facts=6402
prior-facts=1
mean4805.277-4756.719=48.558
σ7.842-7.390=0.453
min4801.719-4752.932=48.787
max4819.306-4769.929=49.377
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean9.090-8.502=0.588
σ0.416-0.476=-0.061
min8.739-7.734=1.005
max9.789-8.920=0.869
iters=5
new-facts=6402
prior-facts=6402
mean4992.752-4944.457=48.295
σ0.155-0.017=0.137
min4992.478-4944.433=48.045
max4992.851-4944.475=48.376
mean2999.400-2965.000=34.400
σ281.552-264.908=16.644
min2614.000-2771.000=-157.000
max3317.000-3383.000=-66.000
mean8.613-8.388=0.226
σ0.126-0.062=0.064
min8.489-8.314=0.174
max8.773-8.481=0.292

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.709-0.979=0.730
σ0.131-0.138=-0.007
min1.554-0.915=0.639
max1.853-1.225=0.628

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.395-468.330=-5.936
σ574.228-574.226=0.002
min175.277-181.204=-5.928
max1323.736-1329.669=-5.933
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean0.545-0.430=0.115
σ0.544-0.277=0.267
min0.271-0.287=-0.016
max1.361-0.845=0.516
policies=20
mean1753.034-1812.355=-59.321
σ0.362-0.389=-0.027
min1752.808-1812.102=-59.294
max1753.575-1812.930=-59.356
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean2.724-2.878=-0.153
σ0.021-0.019=0.002
min2.699-2.861=-0.162
max2.750-2.904=-0.154
policies=200
mean17537.534-18129.103=-591.569
σ0.457-0.452=0.004
min17537.167-18128.713=-591.546
max17538.199-18129.719=-591.520
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2425.000-2771.000=-346.000
σ0.000
min2425.000-2771.000=-346.000
max2425.000-2771.000=-346.000
mean27.397-28.449=-1.052
σ0.157-0.202=-0.045
min27.277-28.266=-0.989
max27.628-28.703=-1.075