Compare commits

Home / Compare e2b2cc3b .. a1797acc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.000
σ0.047-0.045=0.001
min70.750-70.746=0.003
max70.911-70.907=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.158-0.159=-0.001
σ0.005-0.004=0.000
min0.151-0.151=-0.001
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.002-0.003=-0.001
min21.490-21.489=0.001
max21.496-21.498=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.065=-0.004
σ0.003-0.002=0.000
min0.059-0.064=-0.006
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.092=0.002
σ0.364-0.360=0.004
min1753.520-1753.535=-0.015
max1754.668-1754.663=0.005
mean1662.500-1649.200=13.300
σ630.252-640.049=-9.797
min667.000-638.000=29.000
max2615.000-2850.000=-235.000
mean2.670-2.801=-0.131
σ0.257-0.241=0.016
min2.066-2.126=-0.059
max3.004-3.142=-0.138

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.959=-0.007
σ0.009-0.005=0.003
min271.940-271.952=-0.013
max271.964-271.966=-0.002
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean0.383-0.384=-0.000
σ0.009-0.006=0.002
min0.377-0.380=-0.004
max0.398-0.395=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.318-1932.318=0.000
σ0.010-0.018=-0.008
min1932.305-1932.289=0.016
max1932.331-1932.339=-0.008
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean3.002-3.011=-0.008
σ0.115-0.203=-0.088
min2.805-2.737=0.068
max3.101-3.275=-0.174
iters=5
new-facts=6402
prior-facts=1
mean4753.097-4753.050=0.046
σ0.858-0.934=-0.076
min4752.671-4752.588=0.083
max4754.630-4754.719=-0.089
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean8.518-8.744=-0.227
σ0.188-0.448=-0.260
min8.266-8.029=0.237
max8.751-9.090=-0.340
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.416=0.143
σ0.019-0.198=-0.179
min4943.534-4943.185=0.349
max4943.577-4943.575=0.002
mean3020.200-3020.800=-0.600
σ290.607-191.419=99.189
min2619.000-2850.000=-231.000
max3349.000-3316.000=33.000
mean8.562-8.499=0.064
σ0.200-0.094=0.107
min8.373-8.395=-0.022
max8.818-8.589=0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.265-1.079=0.186
σ0.389-0.123=0.267
min0.931-0.938=-0.007
max1.873-1.277=0.596

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.663-468.667=-0.004
σ574.934-574.935=-0.000
min181.189-181.188=0.001
max1331.065-1331.069=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean0.578-0.445=0.133
σ0.563-0.303=0.260
min0.292-0.291=0.001
max1.423-0.900=0.524
policies=20
mean1812.163-1812.229=-0.066
σ0.395-0.390=0.005
min1811.910-1811.949=-0.039
max1812.746-1812.799=-0.053
mean840.000
σ0.000
min840.000
max840.000
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean2.849-2.907=-0.058
σ0.012-0.029=-0.018
min2.832-2.864=-0.032
max2.858-2.929=-0.072
policies=200
mean18129.061-18129.083=-0.022
σ0.565-0.578=-0.013
min18128.670-18128.742=-0.072
max18129.875-18129.948=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2615.000-2850.000=-235.000
σ0.000
min2615.000-2850.000=-235.000
max2615.000-2850.000=-235.000
mean28.581-28.942=-0.361
σ0.139-0.567=-0.428
min28.487-28.413=0.074
max28.787-29.449=-0.662