Compare commits

Home / Compare 54605003 .. 3bd6d180

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=0.000
σ0.050-0.048=0.002
min33.951-33.955=-0.004
max34.118-34.111=0.007
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.002
min0.081-0.077=0.005
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.003-0.002=0.001
min23.314-23.314=0.000
max23.324-23.321=0.003
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.066-0.065=0.000
σ0.002-0.003=-0.000
min0.063-0.064=-0.000
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.428=0.066
σ0.363-0.364=-0.001
min1756.922-1756.854=0.069
max1758.081-1758.016=0.065
mean1671.750-1648.300=23.450
σ643.795-612.222=31.573
min677.000
max2650.000-2630.000=20.000
mean2.378-2.367=0.011
σ0.116-0.093=0.022
min2.256-2.255=0.001
max2.728-2.595=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.575=0.063
σ0.050-0.043=0.007
min326.549-326.503=0.047
max326.673-326.616=0.057
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean0.428-0.424=0.004
σ0.006-0.007=-0.001
min0.423-0.420=0.003
max0.435-0.436=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.807-1988.727=0.080
σ0.007-0.018=-0.011
min1988.796-1988.707=0.089
max1988.813-1988.749=0.063
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean2.702-2.803=-0.102
σ0.086-0.283=-0.197
min2.598-2.632=-0.034
max2.799-3.305=-0.505
iters=5
new-facts=6402
prior-facts=1
mean4813.427-4813.458=-0.031
σ7.872-7.778=0.093
min4809.065-4809.613=-0.548
max4827.480-4827.367=0.113
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean8.737-8.985=-0.247
σ0.483-0.192=0.291
min8.076-8.674=-0.598
max9.161-9.173=-0.012
iters=5
new-facts=6402
prior-facts=6402
mean5001.207-5001.146=0.061
σ0.046-0.034=0.011
min5001.158-5001.112=0.046
max5001.271-5001.200=0.071
mean3011.200-2989.800=21.400
σ266.130-275.427=-9.297
min2650.000-2630.000=20.000
max3353.000-3317.000=36.000
mean9.500-9.752=-0.252
σ0.623-0.388=0.235
min8.487-9.113=-0.625
max10.165-10.125=0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.118=0.069
σ0.360-0.304=0.056
min0.920-0.913=0.006
max1.789-1.652=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.634-464.571=0.063
σ574.778-574.780=-0.002
min177.238-177.172=0.066
max1326.802-1326.741=0.061
mean88.250
σ8.500
min84.000
max101.000
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean0.552-0.556=-0.005
σ0.558-0.568=-0.010
min0.270-0.270=0.000
max1.389-1.409=-0.020
policies=20
mean1772.685-1772.012=0.673
σ0.357-0.353=0.004
min1772.444-1771.785=0.660
max1773.215-1772.538=0.677
mean840.000
σ0.000
min840.000
max840.000
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean2.729-2.728=0.001
σ0.019-0.018=0.001
min2.707-2.704=0.003
max2.752-2.747=0.006
policies=200
mean17733.908-17727.390=6.519
σ0.565-0.544=0.020
min17733.620-17727.085=6.535
max17734.755-17728.205=6.550
mean8400.000
σ0.000
min8400.000
max8400.000
mean2650.000-2630.000=20.000
σ0.000
min2650.000-2630.000=20.000
max2650.000-2630.000=20.000
mean27.585-27.481=0.104
σ0.081-0.093=-0.012
min27.513-27.390=0.123
max27.658-27.577=0.082