Compare commits

Home / Compare 3fa9252f .. 123c75f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.563=0.166
σ0.046-0.044=0.003
min70.704-70.539=0.165
max70.859-70.686=0.174
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.159-0.158=0.001
σ0.003-0.005=-0.002
min0.156-0.149=0.007
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.447-21.291=0.156
σ0.003-0.010=-0.007
min21.443-21.284=0.159
max21.452-21.318=0.135
mean416.000-413.800=2.200
σ0.000-0.422=-0.422
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.065-0.063=0.002
σ0.004-0.003=0.001
min0.061-0.058=0.003
max0.074-0.066=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1753.566=0.964
σ0.361-0.362=-0.000
min1753.953-1752.994=0.959
max1755.113-1754.131=0.982
mean1658.500-1653.800=4.700
σ637.284-622.823=14.461
min641.000-625.000=16.000
max2835.000-2845.000=-10.000
mean2.832-2.750=0.082
σ0.175-0.184=-0.009
min2.311-2.307=0.004
max3.092-3.043=0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-272.012=1.598
σ0.009-0.008=0.001
min273.602-272.002=1.600
max273.624-272.021=1.603
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean0.384-0.382=0.002
σ0.005-0.008=-0.003
min0.381-0.376=0.005
max0.394-0.396=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.004-1932.434=1.570
σ0.009-0.003=0.006
min1933.996-1932.429=1.568
max1934.015-1932.437=1.578
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean2.941-3.016=-0.075
σ0.213-0.057=0.156
min2.703-2.946=-0.242
max3.247-3.087=0.160
iters=5
new-facts=6402
prior-facts=1
mean4754.541-4753.066=1.476
σ1.084-0.581=0.503
min4753.199-4752.686=0.513
max4756.226-4754.098=2.128
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean8.469-8.509=-0.040
σ0.491-0.233=0.258
min7.721-8.249=-0.527
max8.938-8.873=0.066
iters=5
new-facts=6402
prior-facts=6402
mean4945.081-4943.627=1.454
σ0.192-0.020=0.172
min4944.859-4943.609=1.250
max4945.250-4943.650=1.600
mean3077.000-3052.800=24.200
σ230.880-217.173=13.707
min2835.000-2845.000=-10.000
max3414.000-3364.000=50.000
mean8.679-8.573=0.106
σ0.200-0.147=0.054
min8.462-8.402=0.060
max8.948-8.770=0.178

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.072=-0.029
σ0.187-0.111=0.075
min0.928-0.929=-0.001
max1.361-1.241=0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.846-473.080=-0.234
σ574.928-575.915=-0.987
min185.377-185.116=0.261
max1335.238-1336.953=-1.715
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean0.449-0.485=-0.036
σ0.300-0.375=-0.076
min0.295-0.294=0.001
max0.899-1.048=-0.149
policies=20
mean1854.018-1851.439=2.580
σ0.371-0.361=0.010
min1853.730-1851.180=2.550
max1854.553-1851.965=2.588
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean2.964-2.942=0.022
σ0.014-0.004=0.010
min2.951-2.936=0.016
max2.984-2.946=0.039
policies=200
mean18546.790-18521.058=25.731
σ0.463-0.426=0.037
min18546.532-18520.807=25.725
max18547.483-18521.693=25.790
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2845.000=-10.000
σ0.000
min2835.000-2845.000=-10.000
max2835.000-2845.000=-10.000
mean29.293-29.085=0.207
σ0.485-0.532=-0.047
min28.874-28.529=0.345
max29.824-29.632=0.193