Compare commits

Home / Compare 507c594a .. 19273456

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.387-70.380=0.007
σ0.045-0.047=-0.001
min70.359-70.344=0.014
max70.514-70.510=0.004
mean415.100-412.000=3.100
σ0.316-0.000=0.316
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.155-0.161=-0.006
σ0.005-0.003=0.002
min0.149-0.157=-0.008
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.003=-0.001
min21.140-21.138=0.002
max21.147-21.149=-0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.000
min0.060-0.063=-0.003
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.389=0.007
σ0.359-0.362=-0.003
min1751.824-1751.818=0.006
max1752.957-1752.968=-0.011
mean1628.350-1636.650=-8.300
σ589.738-614.392=-24.654
min626.000-622.000=4.000
max2416.000-2470.000=-54.000
mean2.812-2.828=-0.016
σ0.160-0.118=0.042
min2.323-2.444=-0.120
max3.053-3.012=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.129=0.015
σ0.005-0.007=-0.002
min270.135-270.121=0.015
max270.148-270.136=0.012
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean0.385-0.380=0.005
σ0.006-0.001=0.006
min0.381-0.379=0.001
max0.396-0.381=0.016
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.593=0.016
σ0.007-0.014=-0.007
min1930.601-1930.568=0.033
max1930.617-1930.603=0.015
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean2.490-2.547=-0.057
σ0.125-0.062=0.062
min2.338-2.506=-0.167
max2.671-2.653=0.018
iters=5
new-facts=6402
prior-facts=1
mean4751.177-4751.097=0.080
σ1.041-0.859=0.182
min4750.274-4750.660=-0.386
max4752.973-4752.632=0.341
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean8.802-8.292=0.510
σ0.334-0.636=-0.302
min8.446-7.712=0.733
max9.187-9.003=0.184
iters=5
new-facts=6402
prior-facts=6402
mean4941.778-4941.527=0.251
σ0.021-0.087=-0.066
min4941.753-4941.450=0.303
max4941.805-4941.628=0.177
mean2989.000-2942.800=46.200
σ284.694-395.415=-110.721
min2600.000-2470.000=130.000
max3326.000-3460.000=-134.000
mean8.707-8.536=0.171
σ0.436-0.168=0.267
min8.357-8.330=0.027
max9.431-8.753=0.678

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.825-1.700=0.125
σ0.166-0.157=0.009
min1.565-1.485=0.080
max1.965-1.837=0.128

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.353=0.008
σ575.916-575.920=-0.005
min178.399-178.390=0.010
max1330.235-1330.234=0.001
mean84.000
σ8.000
min80.000
max96.000
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean0.556-0.557=-0.001
σ0.547-0.542=0.006
min0.280-0.285=-0.005
max1.377-1.370=0.007
policies=20
mean1784.298-1784.223=0.075
σ0.354-0.352=0.001
min1784.071-1783.991=0.081
max1784.824-1784.746=0.077
mean800.000
σ0.000
min800.000
max800.000
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean2.782-2.784=-0.002
σ0.021-0.012=0.009
min2.757-2.776=-0.019
max2.807-2.802=0.005
policies=200
mean17849.769-17848.848=0.920
σ0.372-0.384=-0.012
min17849.455-17848.579=0.876
max17850.299-17849.418=0.880
mean8000.000
σ0.000
min8000.000
max8000.000
mean2416.000-2470.000=-54.000
σ0.000
min2416.000-2470.000=-54.000
max2416.000-2470.000=-54.000
mean27.920-28.047=-0.127
σ0.067-0.034=0.033
min27.828-28.020=-0.192
max27.988-28.093=-0.105