Compare commits

Home / Compare 7b02b8f6 .. 6c8e7f61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.793=0.001
σ0.107-0.110=-0.003
min35.739-35.740=-0.001
max36.097-36.102=-0.006
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.075-0.076=-0.002
σ0.004-0.003=0.000
min0.069-0.073=-0.004
max0.083-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.004=-0.000
min26.059-26.060=-0.001
max26.070-26.072=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.060-0.059=0.001
σ0.003-0.003=0.000
min0.057-0.056=0.001
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.975-1718.987=37.988
σ0.365-170.012=-169.647
min1756.392-996.686=759.705
max1757.566-1757.587=-0.021
mean1624.050-1628.200=-4.150
σ599.903-593.763=6.140
min630.000-683.000=-53.000
max2420.000-2789.000=-369.000
mean2.852-2.762=0.090
σ0.141-0.356=-0.215
min2.433-1.448=0.985
max3.088-3.100=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.258-278.285=-0.027
σ0.006-0.006=-0.000
min278.250-278.276=-0.027
max278.266-278.294=-0.028
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean0.399-0.408=-0.009
σ0.011-0.008=0.003
min0.391-0.402=-0.011
max0.414-0.423=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2175.509-2175.503=0.005
σ0.026-0.017=0.009
min2175.483-2175.490=-0.007
max2175.546-2175.531=0.015
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean2.969-2.952=0.017
σ0.168-0.158=0.009
min2.818-2.788=0.030
max3.218-3.207=0.011
iters=5
new-facts=6402
prior-facts=1
mean5053.551-5134.479=-80.928
σ1.012-1.106=-0.095
min5052.535-5133.457=-80.922
max5055.225-5136.374=-81.148
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean8.837-8.971=-0.134
σ0.456-0.484=-0.028
min8.248-8.338=-0.090
max9.498-9.506=-0.008
iters=5
new-facts=6402
prior-facts=6402
mean5189.413-5238.168=-48.754
σ0.210-0.294=-0.084
min5189.056-5237.766=-48.710
max5189.585-5238.474=-48.889
mean3263.400-3350.800=-87.400
σ535.638-440.999=94.639
min2578.000-2789.000=-211.000
max3962.000-3777.000=185.000
mean8.803-9.012=-0.209
σ0.192-0.108=0.084
min8.601-8.849=-0.248
max9.006-9.128=-0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.732-1.008=0.724
σ0.105-0.144=-0.039
min1.630-0.943=0.688
max1.880-1.266=0.614

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.964-467.468=-0.504
σ572.648-572.648=-0.000
min180.634-181.138=-0.503
max1325.935-1326.439=-0.504
mean85.500
σ7.000
min82.000
max96.000
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean0.536-0.450=0.086
σ0.507-0.306=0.201
min0.281-0.293=-0.012
max1.295-0.909=0.387
policies=20
mean1806.678-1811.704=-5.025
σ0.375-0.377=-0.001
min1806.438-1811.441=-5.003
max1807.237-1812.253=-5.016
mean820.000
σ0.000
min820.000
max820.000
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean2.833-2.950=-0.117
σ0.011-0.015=-0.004
min2.818-2.929=-0.111
max2.842-2.963=-0.122
policies=200
mean18073.553-18123.546=-49.993
σ0.517-0.504=0.013
min18073.221-18123.230=-50.009
max18074.316-18124.287=-49.971
mean8200.000
σ0.000
min8200.000
max8200.000
mean2420.000-2789.000=-369.000
σ0.000
min2420.000-2789.000=-369.000
max2420.000-2789.000=-369.000
mean28.450-29.119=-0.669
σ0.169-0.604=-0.435
min28.292-28.645=-0.352
max28.688-30.003=-1.315