Compare commits

Home / Compare 9e312d60 .. 8c7aa262

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.377=-0.004
σ0.057-0.057=-0.000
min70.336-70.338=-0.003
max70.531-70.535=-0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.158-0.161=-0.003
σ0.005-0.002=0.002
min0.148-0.158=-0.010
max0.163-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.002
σ0.003-0.002=0.001
min21.138-21.141=-0.003
max21.146-21.147=-0.001
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.063-0.066=-0.004
σ0.003-0.003=0.000
min0.057-0.064=-0.007
max0.064-0.072=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.201=0.000
σ0.361-0.361=-0.001
min1751.623-1751.629=-0.006
max1752.771-1752.767=0.004
mean1652.200-1630.150=22.050
σ645.441-598.606=46.835
min644.000-647.000=-3.000
max2848.000-2415.000=433.000
mean2.869-2.787=0.081
σ0.082-0.179=-0.096
min2.712-2.240=0.472
max3.047-3.088=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.937-269.930=0.007
σ0.011-0.009=0.002
min269.923-269.920=0.002
max269.947-269.943=0.005
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean0.385-0.373=0.012
σ0.014-0.007=0.007
min0.371-0.368=0.003
max0.401-0.385=0.016
iters=5
new-facts=1
prior-facts=6402
mean1930.403-1930.397=0.006
σ0.012-0.013=-0.001
min1930.390-1930.378=0.013
max1930.418-1930.408=0.010
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean2.463-2.559=-0.096
σ0.072-0.092=-0.020
min2.387-2.467=-0.080
max2.580-2.677=-0.097
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.755=0.108
σ0.802-0.907=-0.105
min4750.277-4749.798=0.479
max4752.258-4752.256=0.002
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean8.479-8.472=0.007
σ0.394-0.222=0.172
min8.083-8.238=-0.155
max9.120-8.768=0.352
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.262=-0.001
σ0.129-0.215=-0.086
min4941.072-4940.903=0.169
max4941.437-4941.431=0.007
mean3048.000-3008.800=39.200
σ202.932-273.074=-70.141
min2848.000-2617.000=231.000
max3326.000-3343.000=-17.000
mean8.454-8.501=-0.047
σ0.111-0.162=-0.051
min8.340-8.350=-0.010
max8.616-8.753=-0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.716=-0.644
σ0.108-0.158=-0.050
min0.938-1.554=-0.616
max1.241-1.955=-0.714

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.901=0.011
σ575.762-575.755=0.008
min178.022-178.018=0.004
max1329.555-1329.533=0.022
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean0.432-0.556=-0.124
σ0.302-0.552=-0.250
min0.271-0.278=-0.007
max0.885-1.384=-0.499
policies=20
mean1780.479-1780.449=0.030
σ0.346-0.359=-0.013
min1780.234-1780.202=0.032
max1780.987-1780.981=0.006
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean2.840-2.769=0.071
σ0.006-0.028=-0.022
min2.833-2.741=0.092
max2.847-2.805=0.043
policies=200
mean17811.417-17811.286=0.131
σ0.446-0.476=-0.030
min17811.123-17810.965=0.158
max17812.078-17811.995=0.083
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2415.000=433.000
σ0.000
min2848.000-2415.000=433.000
max2848.000-2415.000=433.000
mean28.276-27.915=0.361
σ0.518-0.169=0.350
min27.792-27.764=0.028
max28.797-28.139=0.658