Compare commits

Home / Compare 96bbdf62 .. 1b7a8808

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.728=0.001
σ0.048-0.050=-0.002
min70.703-70.699=0.004
max70.864-70.867=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.155-0.157=-0.002
σ0.005-0.004=0.001
min0.148-0.150=-0.002
max0.161-0.165=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.000
σ0.003-0.002=0.001
min21.441-21.441=-0.000
max21.452-21.448=0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.058-0.063=-0.005
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.525=0.001
σ0.358-0.362=-0.004
min1753.954-1753.956=-0.002
max1755.106-1755.115=-0.008
mean1659.450-1658.200=1.250
σ627.792-638.241=-10.449
min626.000-624.000=2.000
max2840.000-2856.000=-16.000
mean2.825-2.774=0.051
σ0.100-0.164=-0.064
min2.452-2.403=0.050
max2.967-2.967=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.612=-0.001
σ0.005-0.004=0.001
min273.605-273.606=-0.001
max273.617-273.616=0.001
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean0.385-0.384=0.001
σ0.007-0.006=0.001
min0.380-0.380=0.000
max0.398-0.394=0.003
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1933.998=0.004
σ0.007-0.009=-0.001
min1933.990-1933.986=0.004
max1934.007-1934.007=-0.000
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean3.098-3.019=0.078
σ0.183-0.175=0.007
min2.927-2.777=0.149
max3.369-3.207=0.162
iters=5
new-facts=6402
prior-facts=1
mean4754.617-4754.728=-0.111
σ0.949-0.850=0.098
min4753.784-4754.288=-0.504
max4756.254-4756.246=0.008
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean8.679-8.583=0.095
σ0.241-0.458=-0.217
min8.345-7.825=0.520
max8.901-8.956=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean4945.226-4945.222=0.004
σ0.023-0.017=0.007
min4945.207-4945.206=0.002
max4945.259-4945.240=0.019
mean3047.600-3068.000=-20.400
σ223.022-186.821=36.201
min2840.000-2856.000=-16.000
max3378.000-3332.000=46.000
mean8.613-8.565=0.048
σ0.192-0.201=-0.009
min8.443-8.366=0.077
max8.905-8.858=0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.060=-0.067
σ0.149-0.139=0.010
min0.920-0.940=-0.020
max1.259-1.283=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.837-472.841=-0.004
σ574.929-574.924=0.005
min185.366-185.373=-0.007
max1335.231-1335.228=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean0.450-0.452=-0.001
σ0.301-0.312=-0.010
min0.297-0.292=0.005
max0.902-0.919=-0.017
policies=20
mean1854.000-1854.013=-0.013
σ0.371-0.382=-0.012
min1853.723-1853.741=-0.018
max1854.540-1854.572=-0.033
mean840.000
σ0.000
min840.000
max840.000
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean2.943-2.945=-0.002
σ0.013-0.017=-0.004
min2.923-2.925=-0.002
max2.952-2.961=-0.009
policies=200
mean18546.761-18546.731=0.030
σ0.471-0.459=0.012
min18546.516-18546.358=0.158
max18547.467-18547.402=0.066
mean8400.000
σ0.000
min8400.000
max8400.000
mean2840.000-2856.000=-16.000
σ0.000
min2840.000-2856.000=-16.000
max2840.000-2856.000=-16.000
mean29.246-29.156=0.090
σ0.456-0.417=0.039
min28.808-28.887=-0.079
max29.767-29.777=-0.011