Compare commits

Home / Compare 99fe9a35 .. 28ab1abf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.969-35.970=-0.001
σ0.105-0.102=0.003
min35.924-35.924=0.000
max36.267-36.259=0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.077=-0.001
σ0.003-0.003=-0.000
min0.074-0.074=-0.001
max0.083-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.207-26.208=-0.001
σ0.004-0.003=0.002
min26.200-26.203=-0.003
max26.215-26.212=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.061=-0.000
σ0.002-0.003=-0.001
min0.056-0.059=-0.003
max0.065-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.760-1757.759=0.002
σ0.369-0.369=0.000
min1757.182-1757.180=0.003
max1758.359-1758.352=0.007
mean1649.900-1630.250=19.650
σ625.263-608.431=16.832
min621.000
max2747.000-2458.000=289.000
mean2.405-2.361=0.044
σ0.178-0.094=0.083
min2.270-2.261=0.009
max2.875-2.626=0.249

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.287-280.289=-0.002
σ0.004-0.006=-0.002
min280.284-280.281=0.003
max280.293-280.297=-0.003
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean0.417-0.412=0.006
σ0.009-0.004=0.004
min0.412-0.409=0.003
max0.432-0.419=0.013
iters=5
new-facts=1
prior-facts=6402
mean2270.286-2270.270=0.016
σ0.026-0.042=-0.016
min2270.255-2270.218=0.037
max2270.311-2270.323=-0.012
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean3.039-3.035=0.004
σ0.181-0.117=0.065
min2.817-2.917=-0.100
max3.229-3.191=0.038
iters=5
new-facts=6402
prior-facts=1
mean5147.471-5147.476=-0.005
σ0.768-1.143=-0.376
min5146.988-5146.384=0.604
max5148.833-5149.422=-0.589
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean8.831-8.782=0.049
σ0.689-0.749=-0.060
min8.226-8.169=0.057
max9.960-10.002=-0.043
iters=5
new-facts=6402
prior-facts=6402
mean5285.577-5285.580=-0.003
σ0.222-0.210=0.013
min5285.212-5285.246=-0.035
max5285.757-5285.763=-0.005
mean3442.200-3457.800=-15.600
σ435.173-506.048=-70.876
min2825.000-2777.000=48.000
max3976.000-3936.000=40.000
mean10.089-10.158=-0.068
σ0.079-0.286=-0.207
min9.978-9.650=0.327
max10.188-10.320=-0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-1.831=-0.850
σ0.055-0.108=-0.053
min0.948-1.645=-0.696
max1.078-1.904=-0.826

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.302-464.285=0.017
σ572.658-572.646=0.012
min177.961-177.960=0.000
max1323.289-1323.254=0.035
mean81.500
σ7.000
min78.000
max92.000
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean0.442-0.546=-0.104
σ0.304-0.540=-0.235
min0.282-0.275=0.007
max0.898-1.355=-0.457
policies=20
mean1779.915-1779.903=0.012
σ0.319-0.385=-0.066
min1779.729-1779.674=0.056
max1780.391-1780.477=-0.085
mean780.000
σ0.000
min780.000
max780.000
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean2.809-2.781=0.028
σ0.096-0.010=0.086
min2.731-2.767=-0.036
max2.949-2.789=0.159
policies=200
mean17805.917-17806.016=-0.099
σ0.585-0.448=0.137
min17805.558-17805.732=-0.174
max17806.790-17806.684=0.105
mean7800.000
σ0.000
min7800.000
max7800.000
mean2747.000-2458.000=289.000
σ0.000
min2747.000-2458.000=289.000
max2747.000-2458.000=289.000
mean28.007-28.020=-0.013
σ0.143-0.062=0.081
min27.835-27.980=-0.145
max28.130-28.112=0.018