Compare commits

Home / Compare de10a38d .. 2f083f98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.045-0.047=-0.002
min70.749-70.747=0.002
max70.908-70.911=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.160=-0.002
σ0.005-0.004=0.001
min0.151-0.157=-0.006
max0.169-0.169=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.002=0.000
min21.489-21.491=-0.002
max21.495-21.496=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.001
min0.059-0.063=-0.005
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.002
σ0.360-0.361=-0.001
min1753.531-1753.529=0.003
max1754.672-1754.676=-0.005
mean1643.950-1643.400=0.550
σ634.514-604.721=29.792
min640.000-655.000=-15.000
max2845.000-2458.000=387.000
mean2.792-2.848=-0.056
σ0.150-0.169=-0.019
min2.388-2.277=0.111
max2.976-3.190=-0.214

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.951=0.002
σ0.007-0.006=0.001
min271.941-271.944=-0.002
max271.959-271.958=0.001
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean0.380-0.380=0.000
σ0.003-0.002=0.001
min0.377-0.378=-0.001
max0.383-0.383=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.325-1932.329=-0.004
σ0.002-0.010=-0.008
min1932.323-1932.319=0.003
max1932.328-1932.342=-0.014
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean3.122-2.966=0.156
σ0.119-0.138=-0.019
min3.033-2.727=0.306
max3.279-3.084=0.196
iters=5
new-facts=6402
prior-facts=1
mean4752.944-4752.948=-0.004
σ0.976-0.995=-0.019
min4752.235-4752.153=0.082
max4754.665-4754.685=-0.020
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean8.699-8.644=0.055
σ0.500-0.556=-0.055
min7.963-7.772=0.192
max9.322-9.240=0.082
iters=5
new-facts=6402
prior-facts=6402
mean4943.486-4943.489=-0.002
σ0.151-0.152=-0.001
min4943.217-4943.218=-0.001
max4943.572-4943.577=-0.005
mean3054.000-2979.000=75.000
σ194.282-256.990=-62.708
min2845.000-2638.000=207.000
max3328.000-3300.000=28.000
mean8.616-8.458=0.158
σ0.250-0.096=0.154
min8.446-8.311=0.135
max9.041-8.552=0.489

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.987-1.831=-0.844
σ0.139-0.099=0.040
min0.923-1.740=-0.818
max1.235-1.986=-0.751

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.636-468.627=0.009
σ574.923-574.923=0.001
min181.162-181.164=-0.002
max1331.021-1331.011=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean0.443-0.579=-0.135
σ0.297-0.571=-0.274
min0.292-0.288=0.004
max0.889-1.435=-0.545
policies=20
mean1811.973-1811.914=0.059
σ0.388-0.372=0.017
min1811.698-1811.689=0.009
max1812.540-1812.465=0.075
mean840.000
σ0.000
min840.000
max840.000
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean2.917-2.820=0.097
σ0.013-0.036=-0.023
min2.902-2.773=0.129
max2.932-2.860=0.072
policies=200
mean18126.693-18126.656=0.037
σ0.390-0.535=-0.145
min18126.315-18126.243=0.073
max18127.234-18127.418=-0.184
mean8400.000
σ0.000
min8400.000
max8400.000
mean2845.000-2458.000=387.000
σ0.000
min2845.000-2458.000=387.000
max2845.000-2458.000=387.000
mean29.006-28.602=0.404
σ0.506-0.085=0.421
min28.566-28.509=0.057
max29.454-28.688=0.766