Compare commits

Home / Compare e6bd50fb .. 2124ed51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.687-70.380=0.307
σ0.048-0.046=0.002
min70.661-70.350=0.311
max70.822-70.509=0.313
mean413.000-415.800=-2.800
σ0.000-0.422=-0.422
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.160-0.162=-0.002
σ0.004-0.003=0.001
min0.156-0.159=-0.003
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.144=0.276
σ0.004-0.003=0.001
min21.414-21.140=0.274
max21.424-21.149=0.275
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.059-0.061=-0.002
max0.072-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1752.387=2.072
σ0.362-0.360=0.002
min1753.886-1751.822=2.064
max1755.042-1752.983=2.058
mean1659.300-1652.750=6.550
σ626.824-641.618=-14.793
min624.000-621.000=3.000
max2837.000-2771.000=66.000
mean2.781-2.770=0.010
σ0.153-0.231=-0.078
min2.368-2.194=0.174
max2.959-3.190=-0.232

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-270.125=3.380
σ0.007-0.006=0.001
min273.499-270.117=3.382
max273.517-270.133=3.383
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean0.385-0.382=0.003
σ0.005-0.007=-0.002
min0.380-0.377=0.003
max0.393-0.394=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.898-1930.595=3.303
σ0.007-0.009=-0.001
min1933.889-1930.585=3.304
max1933.908-1930.605=3.304
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean2.972-2.525=0.447
σ0.069-0.135=-0.066
min2.890-2.384=0.507
max3.065-2.733=0.332
iters=5
new-facts=6402
prior-facts=1
mean4754.578-4751.104=3.475
σ0.911-0.802=0.108
min4753.853-4750.724=3.128
max4756.165-4752.539=3.626
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean8.300-8.219=0.081
σ0.536-0.450=0.087
min7.806-7.698=0.108
max9.087-8.829=0.258
iters=5
new-facts=6402
prior-facts=6402
mean4945.118-4941.461=3.657
σ0.013-0.209=-0.196
min4945.099-4941.114=3.985
max4945.131-4941.627=3.504
mean3073.200-3047.000=26.200
σ305.995-209.892=96.104
min2837.000-2771.000=66.000
max3541.000-3324.000=217.000
mean8.570-8.904=-0.334
σ0.322-0.260=0.062
min8.408-8.574=-0.165
max9.145-9.218=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.096-0.989=0.107
σ0.125-0.109=0.016
min0.946-0.935=0.011
max1.294-1.184=0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.572-466.377=6.196
σ574.937-575.932=-0.995
min185.099-178.408=6.690
max1334.978-1330.275=4.702
mean88.250-84.000=4.250
σ8.500-8.000=0.500
min84.000-80.000=4.000
max101.000-96.000=5.000
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean0.487-0.444=0.043
σ0.375-0.304=0.071
min0.296-0.291=0.006
max1.049-0.900=0.150
policies=20
mean1851.295-1784.437=66.858
σ0.375-0.365=0.011
min1851.014-1784.193=66.821
max1851.841-1784.976=66.865
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean2.955-2.856=0.098
σ0.015-0.096=-0.081
min2.937-2.782=0.155
max2.970-2.990=-0.020
policies=200
mean18519.483-17850.408=669.075
σ0.339-0.625=-0.286
min18519.248-17850.046=669.201
max18519.986-17851.340=668.646
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2837.000-2771.000=66.000
σ0.000
min2837.000-2771.000=66.000
max2837.000-2771.000=66.000
mean29.370-28.113=1.257
σ0.442-0.173=0.269
min28.933-28.000=0.933
max29.901-28.365=1.535