Compare commits

Home / Compare 6e3b59ce .. d5a8206d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=-0.000
σ0.060-0.057=0.003
min70.334-70.339=-0.005
max70.543-70.533=0.009
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.158-0.160=-0.002
σ0.005-0.004=0.001
min0.150-0.157=-0.006
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.002=0.001
min21.140-21.141=-0.001
max21.146-21.146=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.058-0.063=-0.005
max0.066-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1752.199=-0.001
σ0.362-0.363=-0.002
min1751.628-1751.631=-0.003
max1752.782-1752.783=-0.002
mean1648.050-1652.150=-4.100
σ644.169-641.099=3.070
min661.000-635.000=26.000
max2845.000-2847.000=-2.000
mean2.834-2.850=-0.016
σ0.132-0.095=0.037
min2.552-2.620=-0.068
max3.100-3.011=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.926=0.009
σ0.009-0.007=0.002
min269.925-269.920=0.004
max269.947-269.936=0.011
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean0.372-0.373=-0.001
σ0.007-0.007=0.000
min0.366-0.369=-0.003
max0.383-0.385=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.407-1930.398=0.009
σ0.008-0.012=-0.004
min1930.396-1930.388=0.008
max1930.418-1930.418=0.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean2.662-2.561=0.100
σ0.166-0.126=0.039
min2.448-2.459=-0.010
max2.909-2.716=0.193
iters=5
new-facts=6402
prior-facts=1
mean4750.887-4750.883=0.004
σ0.795-0.851=-0.056
min4750.402-4750.271=0.130
max4752.285-4752.382=-0.097
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean8.759-8.785=-0.026
σ0.725-0.627=0.098
min7.767-7.842=-0.075
max9.461-9.603=-0.142
iters=5
new-facts=6402
prior-facts=6402
mean4941.271-4941.261=0.009
σ0.131-0.131=0.000
min4941.071-4941.073=-0.002
max4941.435-4941.442=-0.006
mean3106.400-3071.000=35.400
σ312.846-236.079=76.767
min2845.000-2847.000=-2.000
max3577.000-3413.000=164.000
mean8.847-8.557=0.290
σ0.439-0.167=0.272
min8.542-8.400=0.142
max9.580-8.815=0.765

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.047=-0.002
σ0.127-0.126=0.001
min0.930-0.934=-0.005
max1.241-1.245=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.912-465.917=-0.005
σ575.755-575.769=-0.013
min178.026-178.022=0.004
max1329.544-1329.569=-0.025
mean81.750
σ7.500
min78.000
max93.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean0.439-0.444=-0.005
σ0.301-0.307=-0.006
min0.287-0.285=0.002
max0.891-0.905=-0.014
policies=20
mean1780.495-1780.477=0.018
σ0.354-0.356=-0.001
min1780.239-1780.224=0.015
max1781.014-1780.997=0.018
mean780.000
σ0.000
min780.000
max780.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean2.855-2.864=-0.008
σ0.005-0.041=-0.035
min2.848-2.841=0.007
max2.860-2.925=-0.065
policies=200
mean17811.382-17811.239=0.143
σ0.461-0.471=-0.011
min17811.065-17810.791=0.274
max17812.066-17811.895=0.171
mean7800.000
σ0.000
min7800.000
max7800.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean28.265-28.351=-0.086
σ0.453-0.447=0.006
min27.767-27.774=-0.007
max28.669-28.736=-0.067