Compare commits

Home / Compare 2cd1139e .. be75fdf5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.000
σ0.050-0.052=-0.002
min70.751-70.753=-0.002
max70.919-70.926=-0.007
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.158-0.157=0.001
σ0.005-0.005=-0.001
min0.150-0.150=0.000
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.003=-0.000
min21.487-21.488=-0.001
max21.498-21.498=-0.001
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.063-0.064=-0.000
σ0.004-0.003=0.001
min0.058-0.060=-0.001
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.882=-0.002
σ0.359-0.360=-0.000
min1751.309-1751.318=-0.009
max1752.464-1752.475=-0.011
mean1671.200-1640.250=30.950
σ638.042-630.515=7.527
min682.000-617.000=65.000
max2698.000-2777.000=-79.000
mean2.820-2.840=-0.020
σ0.109-0.147=-0.039
min2.575-2.450=0.125
max2.977-3.150=-0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.381-269.381=-0.000
σ0.007-0.008=-0.002
min269.372-269.367=0.005
max269.388-269.387=0.001
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean0.379-0.380=-0.002
σ0.007-0.008=-0.001
min0.374-0.375=-0.001
max0.391-0.394=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1929.744-1929.745=-0.001
σ0.016-0.016=-0.001
min1929.720-1929.724=-0.004
max1929.759-1929.765=-0.006
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean3.124-2.951=0.173
σ0.144-0.265=-0.120
min3.003-2.488=0.515
max3.369-3.137=0.231
iters=5
new-facts=6402
prior-facts=1
mean4750.496-4750.374=0.123
σ0.875-0.948=-0.073
min4750.075-4749.619=0.456
max4752.061-4752.028=0.033
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean8.609-8.558=0.051
σ0.225-0.530=-0.305
min8.288-7.817=0.471
max8.924-9.199=-0.276
iters=5
new-facts=6402
prior-facts=6402
mean4940.984-4940.914=0.070
σ0.017-0.156=-0.139
min4940.964-4940.637=0.327
max4941.000-4941.005=-0.004
mean3010.000-3021.600=-11.600
σ341.239-289.072=52.167
min2698.000-2777.000=-79.000
max3512.000-3449.000=63.000
mean8.466-8.475=-0.010
σ0.151-0.105=0.045
min8.319-8.412=-0.093
max8.702-8.662=0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.028=0.065
σ0.235-0.134=0.101
min0.933-0.937=-0.005
max1.461-1.246=0.214

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.699-462.711=-0.012
σ574.935-574.964=-0.030
min175.221-175.228=-0.006
max1325.101-1325.157=-0.056
mean86.250
σ8.500
min82.000
max99.000
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean0.548-0.483=0.065
σ0.530-0.411=0.119
min0.277-0.275=0.002
max1.343-1.099=0.244
policies=20
mean1752.485-1752.520=-0.035
σ0.348-0.360=-0.012
min1752.257-1752.292=-0.035
max1753.003-1753.057=-0.053
mean820.000
σ0.000
min820.000
max820.000
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean2.714-2.744=-0.031
σ0.035-0.012=0.022
min2.666-2.730=-0.064
max2.746-2.758=-0.013
policies=200
mean17532.208-17532.180=0.028
σ0.449-0.561=-0.112
min17531.877-17531.872=0.005
max17532.862-17533.021=-0.159
mean8200.000
σ0.000
min8200.000
max8200.000
mean2698.000-2777.000=-79.000
σ0.000
min2698.000-2777.000=-79.000
max2698.000-2777.000=-79.000
mean27.502-27.574=-0.072
σ0.150-0.121=0.029
min27.373-27.456=-0.083
max27.694-27.687=0.007