Compare commits

Home / Compare 018d293c .. 7e98ee6a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.388=0.002
σ0.046-0.043=0.003
min70.358-70.364=-0.007
max70.518-70.509=0.009
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.157-0.155=0.002
σ0.005-0.005=-0.000
min0.150-0.148=0.002
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.002=0.000
min21.142-21.141=0.001
max21.147-21.146=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.064=0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.394=-0.002
σ0.360-0.360=-0.000
min1751.821-1751.827=-0.006
max1752.955-1752.955=-0.000
mean1629.250-1629.750=-0.500
σ588.493-589.619=-1.127
min625.000-626.000=-1.000
max2411.000-2416.000=-5.000
mean2.819-2.809=0.010
σ0.122-0.161=-0.039
min2.532-2.354=0.178
max3.002-3.083=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.239=-0.001
σ0.007-0.006=0.000
min270.227-270.231=-0.004
max270.244-270.246=-0.002
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean0.383-0.382=0.001
σ0.014-0.005=0.009
min0.371-0.378=-0.007
max0.408-0.392=0.017
iters=5
new-facts=1
prior-facts=6402
mean1930.701-1930.697=0.004
σ0.011-0.011=-0.001
min1930.689-1930.683=0.006
max1930.713-1930.711=0.002
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean2.531-2.627=-0.096
σ0.090-0.174=-0.084
min2.457-2.462=-0.005
max2.641-2.854=-0.213
iters=5
new-facts=6402
prior-facts=1
mean4751.365-4751.480=-0.115
σ0.904-0.825=0.079
min4750.901-4751.011=-0.110
max4752.979-4752.951=0.028
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean8.710-7.875=0.835
σ0.342-0.369=-0.027
min8.248-7.571=0.677
max9.066-8.506=0.560
iters=5
new-facts=6402
prior-facts=6402
mean4941.728-4941.869=-0.141
σ0.314-0.015=0.300
min4941.166-4941.849=-0.683
max4941.881-4941.883=-0.002
mean3021.400-2925.600=95.800
σ312.687-411.219=-98.532
min2607.000-2416.000=191.000
max3424.000-3436.000=-12.000
mean8.524-8.541=-0.017
σ0.141-0.110=0.030
min8.383-8.413=-0.030
max8.719-8.672=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.829=-0.070
σ0.110-0.034=0.076
min1.584-1.802=-0.218
max1.860-1.886=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.360=0.000
σ575.915-575.918=-0.002
min178.399-178.399=0.000
max1330.233-1330.236=-0.003
mean84.000
σ8.000
min80.000
max96.000
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean0.566-0.561=0.006
σ0.572-0.561=0.011
min0.278-0.279=-0.001
max1.425-1.403=0.022
policies=20
mean1784.292-1784.300=-0.008
σ0.370-0.357=0.012
min1784.055-1784.072=-0.017
max1784.841-1784.832=0.009
mean800.000
σ0.000
min800.000
max800.000
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean2.786-2.774=0.013
σ0.010-0.020=-0.010
min2.775-2.747=0.027
max2.797-2.793=0.005
policies=200
mean17849.801-17849.630=0.171
σ0.528-0.463=0.065
min17849.440-17849.358=0.082
max17850.573-17850.322=0.251
mean8000.000
σ0.000
min8000.000
max8000.000
mean2411.000-2416.000=-5.000
σ0.000
min2411.000-2416.000=-5.000
max2411.000-2416.000=-5.000
mean28.088-27.960=0.129
σ0.080-0.095=-0.015
min27.985-27.844=0.141
max28.164-28.054=0.109