Compare commits

Home / Compare 4d8d23f5 .. 456ecd1e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.002
σ0.045-0.047=-0.002
min70.756-70.752=0.004
max70.907-70.913=-0.006
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.162-0.157=0.004
σ0.003-0.006=-0.003
min0.159-0.149=0.010
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.003-0.002=0.000
min21.487-21.490=-0.003
max21.494-21.498=-0.003
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.065-0.067=-0.002
σ0.003-0.004=-0.001
min0.064-0.064=0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.095=-0.001
σ0.361-0.359=0.002
min1753.529-1753.527=0.002
max1754.680-1754.679=0.000
mean1631.800-1663.700=-31.900
σ596.050-631.632=-35.581
min640.000-627.000=13.000
max2430.000-2761.000=-331.000
mean2.787-2.837=-0.050
σ0.204-0.113=0.091
min2.303-2.492=-0.189
max3.158-2.995=0.163

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.953=0.002
σ0.008-0.006=0.002
min271.943-271.944=-0.001
max271.962-271.959=0.002
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean0.383-0.381=0.002
σ0.006-0.006=0.000
min0.380-0.377=0.003
max0.394-0.392=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.323-1932.317=0.006
σ0.014-0.006=0.007
min1932.311-1932.307=0.003
max1932.344-1932.324=0.020
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean2.919-3.039=-0.121
σ0.268-0.120=0.148
min2.474-2.938=-0.464
max3.199-3.247=-0.048
iters=5
new-facts=6402
prior-facts=1
mean4753.078-4753.058=0.019
σ0.883-0.931=-0.049
min4752.552-4752.596=-0.044
max4754.651-4754.722=-0.071
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean8.620-8.701=-0.082
σ0.508-0.483=0.025
min7.883-7.934=-0.051
max9.309-9.083=0.226
iters=5
new-facts=6402
prior-facts=6402
mean4943.421-4943.419=0.002
σ0.205-0.196=0.009
min4943.181-4943.193=-0.011
max4943.590-4943.574=0.017
mean2953.000-2995.000=-42.000
σ268.022-224.071=43.951
min2588.000-2761.000=-173.000
max3298.000-3319.000=-21.000
mean8.491-8.549=-0.058
σ0.041-0.056=-0.015
min8.457-8.455=0.002
max8.562-8.599=-0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-1.046=0.751
σ0.082-0.188=-0.105
min1.665-0.931=0.734
max1.882-1.366=0.516

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.630-468.642=-0.012
σ574.876-574.898=-0.021
min181.186-181.191=-0.005
max1330.945-1330.989=-0.044
mean88.250
σ8.500
min84.000
max101.000
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean0.556-0.580=-0.024
σ0.533-0.586=-0.053
min0.288-0.284=0.004
max1.356-1.459=-0.103
policies=20
mean1812.158-1812.208=-0.050
σ0.385-0.384=0.001
min1811.912-1811.949=-0.037
max1812.728-1812.777=-0.048
mean840.000
σ0.000
min840.000
max840.000
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean2.839-2.831=0.008
σ0.012-0.008=0.004
min2.826-2.820=0.006
max2.854-2.837=0.017
policies=200
mean18129.112-18129.104=0.009
σ0.601-0.398=0.203
min18128.704-18128.829=-0.125
max18129.977-18129.694=0.282
mean8400.000
σ0.000
min8400.000
max8400.000
mean2430.000-2761.000=-331.000
σ0.000
min2430.000-2761.000=-331.000
max2430.000-2761.000=-331.000
mean28.647-28.448=0.199
σ0.259-0.051=0.208
min28.504-28.373=0.131
max29.035-28.488=0.547