Compare commits

Home / Compare 610647e3 .. 89b6f8d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.064-73.046=0.018
σ0.051-0.049=0.002
min73.037-73.022=0.015
max73.207-73.184=0.023
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.164-0.161=0.003
σ0.008-0.003=0.005
min0.157-0.158=-0.001
max0.183-0.166=0.017
cache=y
dps=1
iters=10
policies=100
mean23.754-23.740=0.014
σ0.004-0.003=0.001
min23.749-23.734=0.015
max23.763-23.744=0.018
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.066-0.064=0.002
σ0.005-0.003=0.002
min0.062-0.059=0.003
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1758.786=-2.966
σ0.362-0.363=-0.001
min1755.254-1758.217=-2.963
max1756.405-1759.371=-2.966
mean1653.500-1659.800=-6.300
σ639.461-631.172=8.289
min650.000-622.000=28.000
max2853.000-2892.000=-39.000
mean2.866-2.737=0.129
σ0.138-0.212=-0.074
min2.487-2.254=0.233
max3.177-3.087=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.044-324.008=-2.964
σ0.057-0.052=0.005
min320.943-323.915=-2.972
max321.082-324.034=-2.952
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean0.430-0.426=0.004
σ0.010-0.001=0.009
min0.421-0.425=-0.005
max0.444-0.427=0.017
iters=5
new-facts=1
prior-facts=6402
mean1981.610-1984.579=-2.969
σ0.030-0.012=0.018
min1981.558-1984.568=-3.010
max1981.628-1984.594=-2.966
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean2.643-2.608=0.035
σ0.131-0.080=0.051
min2.555-2.539=0.016
max2.867-2.710=0.157
iters=5
new-facts=6402
prior-facts=1
mean4805.243-4808.118=-2.875
σ7.782-7.520=0.262
min4801.672-4804.738=-3.065
max4819.164-4821.570=-2.406
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean8.932-8.761=0.170
σ0.236-0.164=0.072
min8.637-8.612=0.025
max9.212-8.952=0.260
iters=5
new-facts=6402
prior-facts=6402
mean4992.825-4995.805=-2.980
σ0.022-0.016=0.006
min4992.798-4995.788=-2.990
max4992.851-4995.819=-2.969
mean3068.200-3020.800=47.400
σ223.250-203.297=19.953
min2853.000-2892.000=-39.000
max3403.000-3357.000=46.000
mean8.955-8.604=0.351
σ0.227-0.168=0.059
min8.758-8.462=0.297
max9.327-8.881=0.445

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.013=0.046
σ0.228-0.143=0.084
min0.923-0.911=0.012
max1.453-1.247=0.206

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.422-468.349=-5.927
σ574.241-574.230=0.011
min175.293-181.225=-5.933
max1323.784-1329.695=-5.911
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean0.435-0.447=-0.012
σ0.301-0.306=-0.005
min0.282-0.290=-0.008
max0.886-0.906=-0.019
policies=20
mean1753.219-1812.619=-59.399
σ0.365-0.401=-0.036
min1752.968-1812.341=-59.373
max1753.761-1813.210=-59.448
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean2.787-2.887=-0.099
σ0.010-0.017=-0.007
min2.780-2.862=-0.082
max2.801-2.898=-0.097
policies=200
mean17538.671-18132.175=-593.504
σ0.432-0.888=-0.456
min17538.165-18131.008=-592.842
max17539.040-18132.919=-593.879
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2853.000-2892.000=-39.000
σ0.000
min2853.000-2892.000=-39.000
max2853.000-2892.000=-39.000
mean27.867-28.831=-0.964
σ0.269-0.341=-0.072
min27.515-28.487=-0.973
max28.120-29.135=-1.015