Compare commits

Home / Compare 9f494530 .. 45650086

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.379=0.002
σ0.047-0.045=0.002
min70.352-70.349=0.003
max70.514-70.505=0.009
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.154=0.007
σ0.002-0.004=-0.002
min0.158-0.149=0.009
max0.164-0.160=0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.001=0.001
min21.141-21.140=0.001
max21.149-21.145=0.005
mean414.700-413.000=1.700
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.060-0.058=0.002
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.388=-0.003
σ0.361-0.360=0.001
min1751.818-1751.819=-0.002
max1752.967-1752.974=-0.007
mean1632.150-1637.550=-5.400
σ612.649-616.313=-3.665
min632.000-630.000=2.000
max2464.000-2474.000=-10.000
mean2.718-2.806=-0.088
σ0.272-0.167=0.106
min2.182-2.325=-0.143
max3.048-3.014=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.124=0.001
σ0.007-0.006=0.001
min270.118-270.115=0.002
max270.131-270.131=0.000
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean0.373-0.372=0.001
σ0.004-0.005=-0.000
min0.368-0.369=-0.001
max0.380-0.380=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1930.586=0.010
σ0.012-0.016=-0.004
min1930.577-1930.564=0.013
max1930.607-1930.601=0.005
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean2.637-2.600=0.037
σ0.088-0.119=-0.031
min2.503-2.462=0.042
max2.747-2.723=0.024
iters=5
new-facts=6402
prior-facts=1
mean4751.068-4751.079=-0.011
σ0.907-0.861=0.046
min4750.482-4750.578=-0.095
max4752.678-4752.601=0.077
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean8.784-8.423=0.362
σ0.527-0.423=0.104
min7.901-7.929=-0.028
max9.227-8.905=0.322
iters=5
new-facts=6402
prior-facts=6402
mean4941.535-4941.458=0.077
σ0.087-0.206=-0.119
min4941.467-4941.120=0.347
max4941.634-4941.637=-0.003
mean3018.400-2938.000=80.400
σ419.832-378.806=41.026
min2464.000-2474.000=-10.000
max3560.000-3424.000=136.000
mean8.722-8.410=0.311
σ0.228-0.113=0.115
min8.562-8.282=0.279
max9.114-8.576=0.538

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.838-1.535=0.303
σ0.076-0.122=-0.046
min1.715-1.389=0.326
max1.916-1.678=0.238

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.352-466.355=-0.003
σ575.918-575.923=-0.005
min178.390-178.387=0.003
max1330.229-1330.239=-0.010
mean84.000
σ8.000
min80.000
max96.000
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean0.569-0.549=0.020
σ0.577-0.538=0.039
min0.278-0.272=0.005
max1.435-1.355=0.079
policies=20
mean1784.222-1784.225=-0.003
σ0.360-0.356=0.004
min1783.974-1783.991=-0.017
max1784.756-1784.755=0.001
mean800.000
σ0.000
min800.000
max800.000
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean2.785-2.760=0.025
σ0.033-0.014=0.018
min2.746-2.747=-0.001
max2.825-2.778=0.048
policies=200
mean17848.900-17848.798=0.101
σ0.480-0.386=0.093
min17848.596-17848.582=0.014
max17849.614-17849.377=0.237
mean8000.000
σ0.000
min8000.000
max8000.000
mean2464.000-2474.000=-10.000
σ0.000
min2464.000-2474.000=-10.000
max2464.000-2474.000=-10.000
mean27.919-27.873=0.046
σ0.150-0.089=0.061
min27.813-27.809=0.004
max28.135-28.001=0.134