Compare commits

Home / Compare 99fec616 .. bee3e126

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.728=0.055
σ0.051-0.053=-0.002
min70.753-70.694=0.059
max70.927-70.876=0.051
mean415.400-416.000=-0.600
σ0.516-0.000=0.516
min415.000-416.000=-1.000
max416.000
mean0.160-0.155=0.004
σ0.006-0.006=-0.000
min0.152-0.146=0.006
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.494-21.445=0.048
σ0.002-0.003=-0.001
min21.490-21.440=0.050
max21.496-21.450=0.046
mean416.000-416.600=-0.600
σ0.000-0.516=-0.516
min416.000
max416.000-417.000=-1.000
mean0.063-0.063=0.001
σ0.003-0.004=-0.001
min0.059-0.059=0.000
max0.068-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1717.366=34.514
σ0.360-169.601=-169.242
min1751.317-996.812=754.505
max1752.470-1755.867=-3.398
mean1637.400-1625.950=11.450
σ629.634-608.872=20.762
min621.000-624.000=-3.000
max2774.000-2462.000=312.000
mean2.822-2.817=0.005
σ0.200-0.324=-0.124
min2.250-1.480=0.770
max3.142-3.071=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.381-274.366=-4.985
σ0.006-0.003=0.003
min269.375-274.363=-4.988
max269.389-274.369=-4.980
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean0.378-0.386=-0.008
σ0.004-0.005=-0.001
min0.374-0.383=-0.009
max0.384-0.394=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1929.752-1934.751=-4.999
σ0.008-0.008=0.000
min1929.746-1934.742=-4.996
max1929.766-1934.759=-4.993
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean3.051-3.055=-0.004
σ0.137-0.057=0.079
min2.857-3.001=-0.144
max3.226-3.135=0.092
iters=5
new-facts=6402
prior-facts=1
mean4750.526-4755.500=-4.974
σ0.837-0.914=-0.077
min4750.025-4754.950=-4.925
max4752.014-4757.128=-5.114
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean8.328-8.675=-0.347
σ0.469-0.506=-0.037
min7.664-7.941=-0.277
max8.962-9.259=-0.297
iters=5
new-facts=6402
prior-facts=6402
mean4940.983-4945.982=-4.999
σ0.020-0.019=0.001
min4940.949-4945.962=-5.013
max4941.000-4946.007=-5.007
mean3035.200-2986.200=49.000
σ259.901-260.942=-1.041
min2774.000-2633.000=141.000
max3400.000-3297.000=103.000
mean8.538-8.544=-0.006
σ0.138-0.132=0.006
min8.384-8.420=-0.037
max8.669-8.744=-0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.990-1.722=-0.732
σ0.136-0.176=-0.040
min0.914-1.440=-0.526
max1.233-1.854=-0.621

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.705-472.835=-10.130
σ574.966-574.928=0.038
min175.221-185.366=-10.145
max1325.155-1335.226=-10.072
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean0.564-0.585=-0.021
σ0.575-0.583=-0.008
min0.274-0.288=-0.014
max1.427-1.460=-0.033
policies=20
mean1752.496-1853.987=-101.491
σ0.374-0.368=0.006
min1752.250-1853.739=-101.490
max1753.053-1854.532=-101.479
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean2.742-2.887=-0.145
σ0.016-0.042=-0.026
min2.726-2.853=-0.127
max2.760-2.949=-0.189
policies=200
mean17532.312-18546.741=-1014.429
σ0.483-0.502=-0.018
min17532.055-18546.435=-1014.380
max17533.036-18547.490=-1014.454
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2774.000-2462.000=312.000
σ0.000
min2774.000-2462.000=312.000
max2774.000-2462.000=312.000
mean27.523-28.866=-1.343
σ0.075-0.078=-0.003
min27.457-28.764=-1.308
max27.629-28.955=-1.325