Compare commits

Home / Compare 4a278297 .. b2e9b84d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.262=0.002
σ0.055-0.054=0.000
min35.232-35.233=-0.001
max35.418-35.415=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.086-0.083=0.003
σ0.004-0.005=-0.000
min0.082-0.076=0.006
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.004-0.003=0.000
min23.762-23.762=-0.000
max23.773-23.774=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.067-0.066=0.001
σ0.004-0.004=0.001
min0.062-0.061=0.001
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.469-1756.485=-0.016
σ0.366-0.366=-0.000
min1755.896-1755.907=-0.012
max1757.061-1757.077=-0.017
mean1653.600-1650.750=2.850
σ643.850-640.169=3.680
min627.000
max2840.000-2832.000=8.000
mean2.339-2.330=0.009
σ0.082-0.074=0.008
min2.228-2.247=-0.019
max2.548-2.515=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.689-324.709=-0.019
σ0.056-0.048=0.008
min324.591-324.623=-0.032
max324.721-324.731=-0.010
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean0.432-0.427=0.005
σ0.010-0.009=0.001
min0.424-0.421=0.002
max0.449-0.442=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.251-1985.260=-0.009
σ0.010-0.014=-0.005
min1985.235-1985.243=-0.008
max1985.259-1985.272=-0.013
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean2.707-2.665=0.042
σ0.219-0.110=0.109
min2.529-2.553=-0.024
max3.002-2.805=0.197
iters=5
new-facts=6402
prior-facts=1
mean4808.738-4808.786=-0.049
σ7.471-7.693=-0.222
min4805.348-4804.791=0.557
max4822.103-4822.535=-0.433
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean8.901-8.654=0.247
σ0.274-0.556=-0.282
min8.582-7.738=0.845
max9.297-9.167=0.130
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.462=-0.003
σ0.021-0.016=0.005
min4996.431-4996.438=-0.008
max4996.476-4996.476=-0.000
mean3054.400-3071.000=-16.600
σ214.836-310.052=-95.216
min2840.000-2832.000=8.000
max3342.000-3545.000=-203.000
mean9.063-8.542=0.521
σ0.453-0.166=0.287
min8.473-8.313=0.160
max9.656-8.716=0.940

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.982-1.053=-0.071
σ0.068-0.146=-0.078
min0.923-0.928=-0.005
max1.059-1.293=-0.234

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.934-462.959=-0.024
σ574.255-574.254=0.001
min175.793-175.819=-0.026
max1324.316-1324.339=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean0.435-0.437=-0.002
σ0.300-0.305=-0.005
min0.282-0.283=-0.000
max0.884-0.895=-0.010
policies=20
mean1758.328-1758.525=-0.197
σ0.346-0.345=0.001
min1758.077-1758.302=-0.225
max1758.839-1759.037=-0.198
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean2.797-2.782=0.015
σ0.010-0.007=0.002
min2.784-2.772=0.013
max2.808-2.789=0.019
policies=200
mean17590.307-17592.478=-2.172
σ0.494-0.554=-0.060
min17589.986-17592.188=-2.203
max17591.043-17593.309=-2.266
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2832.000=8.000
σ0.000
min2840.000-2832.000=8.000
max2840.000-2832.000=8.000
mean27.965-27.846=0.119
σ0.327-0.340=-0.013
min27.602-27.538=0.064
max28.338-28.213=0.125