Compare commits

Home / Compare 3416fbf6 .. 10a178c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.274-35.271=0.003
σ0.056-0.053=0.003
min35.245-35.247=-0.001
max35.431-35.421=0.011
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.086-0.081=0.005
σ0.004-0.004=-0.000
min0.083-0.076=0.007
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean23.777-23.777=0.000
σ0.003-0.003=-0.000
min23.773-23.772=0.001
max23.781-23.780=0.001
mean410.700-413.000=-2.300
σ0.483-0.000=0.483
min410.000-413.000=-3.000
max411.000-413.000=-2.000
mean0.066-0.066=0.001
σ0.005-0.004=0.000
min0.061-0.062=-0.001
max0.077-0.075=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.488-1756.487=0.001
σ0.365-0.365=0.001
min1755.911-1755.912=-0.000
max1757.080-1757.074=0.006
mean1641.100-1640.850=0.250
σ635.559-629.554=6.005
min640.000-651.000=-11.000
max2823.000-2835.000=-12.000
mean2.354-2.351=0.003
σ0.081-0.073=0.008
min2.265-2.271=-0.005
max2.576-2.505=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.705=0.007
σ0.045-0.055=-0.010
min324.632-324.606=0.026
max324.740-324.734=0.007
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean0.427-0.425=0.002
σ0.007-0.004=0.003
min0.421-0.422=-0.001
max0.438-0.431=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.276=-0.011
σ0.008-0.005=0.003
min1985.258-1985.270=-0.012
max1985.274-1985.283=-0.009
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean2.726-2.585=0.141
σ0.133-0.051=0.082
min2.595-2.538=0.058
max2.897-2.645=0.252
iters=5
new-facts=6402
prior-facts=1
mean4808.874-4808.877=-0.003
σ7.718-7.707=0.012
min4805.389-4805.374=0.015
max4822.680-4822.663=0.018
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean8.927-8.930=-0.003
σ0.152-0.257=-0.105
min8.745-8.715=0.030
max9.077-9.324=-0.247
iters=5
new-facts=6402
prior-facts=6402
mean4996.401-4996.481=-0.080
σ0.150-0.015=0.135
min4996.134-4996.463=-0.329
max4996.496-4996.504=-0.008
mean3065.200-3048.000=17.200
σ311.867-201.651=110.217
min2823.000-2835.000=-12.000
max3541.000-3343.000=198.000
mean8.558-8.758=-0.200
σ0.138-0.231=-0.093
min8.404-8.504=-0.100
max8.783-9.076=-0.293

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.930-0.981=-0.051
σ0.010-0.065=-0.055
min0.924-0.922=0.002
max0.947-1.055=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.957-462.959=-0.002
σ574.248-574.255=-0.006
min175.827-175.821=0.006
max1324.329-1324.341=-0.012
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean0.432-0.427=0.005
σ0.305-0.293=0.012
min0.277-0.277=-0.000
max0.890-0.867=0.023
policies=20
mean1758.583-1758.573=0.011
σ0.343-0.358=-0.015
min1758.364-1758.331=0.033
max1759.095-1759.104=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean2.778-2.779=-0.001
σ0.019-0.005=0.013
min2.753-2.773=-0.020
max2.794-2.784=0.010
policies=200
mean17592.551-17592.625=-0.074
σ0.427-0.369=0.058
min17592.108-17592.369=-0.261
max17593.134-17593.170=-0.036
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2835.000=-12.000
σ0.000
min2823.000-2835.000=-12.000
max2823.000-2835.000=-12.000
mean27.772-27.718=0.054
σ0.383-0.412=-0.029
min27.438-27.244=0.194
max28.212-28.128=0.084