Compare commits

Home / Compare d269ee9e .. d8bae745

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.564=0.002
σ0.044-0.048=-0.004
min70.542-70.539=0.002
max70.687-70.699=-0.012
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.161-0.160=0.001
σ0.004-0.004=-0.001
min0.154-0.154=-0.000
max0.166-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.287-21.291=-0.004
σ0.003-0.010=-0.008
min21.282-21.283=-0.001
max21.291-21.319=-0.028
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.065=-0.004
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.176-1753.175=0.000
σ0.360-0.362=-0.002
min1752.608-1752.601=0.007
max1753.760-1753.756=0.004
mean1660.950-1644.550=16.400
σ625.614-632.173=-6.559
min669.000-629.000=40.000
max2673.000-2767.000=-94.000
mean2.892-2.850=0.042
σ0.163-0.117=0.046
min2.561-2.476=0.085
max3.135-3.018=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.618-271.615=0.003
σ0.007-0.005=0.002
min271.608-271.609=-0.001
max271.626-271.622=0.005
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean0.384-0.380=0.003
σ0.007-0.001=0.006
min0.379-0.379=-0.000
max0.396-0.381=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.044-1932.043=0.001
σ0.010-0.012=-0.002
min1932.031-1932.028=0.003
max1932.057-1932.062=-0.005
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean3.013-3.084=-0.071
σ0.148-0.166=-0.017
min2.815-2.965=-0.150
max3.204-3.365=-0.162
iters=5
new-facts=6402
prior-facts=1
mean4752.849-4752.851=-0.003
σ0.834-0.799=0.035
min4752.368-4752.418=-0.050
max4754.337-4754.279=0.058
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean7.962-7.970=-0.007
σ0.426-0.335=0.091
min7.723-7.686=0.037
max8.715-8.514=0.201
iters=5
new-facts=6402
prior-facts=6402
mean4943.238-4943.230=0.008
σ0.009-0.012=-0.003
min4943.225-4943.213=0.012
max4943.249-4943.246=0.002
mean3010.800-3019.200=-8.400
σ384.584-296.862=87.722
min2673.000-2767.000=-94.000
max3562.000-3455.000=107.000
mean8.452-8.425=0.028
σ0.114-0.115=-0.001
min8.348-8.349=-0.002
max8.603-8.626=-0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.145-1.016=0.129
σ0.245-0.127=0.117
min0.934-0.926=0.007
max1.520-1.215=0.305

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.295-472.288=0.008
σ575.938-575.920=0.017
min184.323-184.324=-0.001
max1336.202-1336.168=0.034
mean88.250
σ8.500
min84.000
max101.000
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean0.573-0.485=0.088
σ0.569-0.377=0.192
min0.286-0.291=-0.005
max1.426-1.050=0.375
policies=20
mean1843.545-1843.575=-0.029
σ0.373-0.356=0.017
min1843.294-1843.316=-0.022
max1844.096-1844.093=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean2.896-2.959=-0.063
σ0.034-0.118=-0.084
min2.855-2.862=-0.007
max2.929-3.123=-0.193
policies=200
mean18442.099-18442.192=-0.093
σ0.444-0.409=0.036
min18441.822-18441.916=-0.094
max18442.759-18442.800=-0.041
mean8400.000
σ0.000
min8400.000
max8400.000
mean2673.000-2767.000=-94.000
σ0.000
min2673.000-2767.000=-94.000
max2673.000-2767.000=-94.000
mean29.024-29.025=-0.001
σ0.124-0.087=0.038
min28.856-28.895=-0.040
max29.121-29.076=0.045