Compare commits

Home / Compare 34b285f7 .. 280c24c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.768=0.189
σ0.051-0.048=0.003
min30.915-30.732=0.183
max31.098-30.901=0.197
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.075-0.076=-0.002
σ0.005-0.004=0.001
min0.070-0.072=-0.001
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.003-0.003=0.000
min21.053-21.053=-0.000
max21.063-21.064=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.061-0.064=-0.003
σ0.003-0.001=0.003
min0.057-0.063=-0.005
max0.067-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.420=-0.009
σ0.362-0.362=0.000
min1750.844-1750.848=-0.003
max1751.982-1752.000=-0.018
mean1658.050-1664.300=-6.250
σ622.914-640.220=-17.306
min635.000-678.000=-43.000
max2506.000-2695.000=-189.000
mean2.773-2.880=-0.108
σ0.216-0.121=0.095
min2.172-2.594=-0.421
max3.174-3.024=0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.071-282.191=-3.120
σ0.011-0.008=0.003
min279.060-282.183=-3.123
max279.084-282.200=-3.115
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean0.388-0.399=-0.012
σ0.002-0.003=-0.001
min0.386-0.397=-0.011
max0.390-0.405=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1939.513-2174.719=-235.206
σ0.008-0.011=-0.003
min1939.501-2174.706=-235.206
max1939.520-2174.736=-235.217
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean3.086-3.053=0.034
σ0.104-0.217=-0.113
min3.008-2.763=0.245
max3.228-3.241=-0.013
iters=5
new-facts=6402
prior-facts=1
mean4760.063-5054.545=-294.482
σ0.849-0.942=-0.093
min4759.590-5054.070=-294.480
max4761.571-5056.228=-294.657
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean8.643-8.819=-0.176
σ0.759-0.589=0.170
min7.676-8.046=-0.370
max9.513-9.475=0.039
iters=5
new-facts=6402
prior-facts=6402
mean4950.469-5185.608=-235.139
σ0.086-0.208=-0.122
min4950.404-5185.266=-234.862
max4950.563-5185.783=-235.220
mean3037.800-3219.200=-181.400
σ300.734-374.444=-73.709
min2616.000-2695.000=-79.000
max3418.000-3687.000=-269.000
mean8.611-9.985=-1.374
σ0.192-0.335=-0.143
min8.316-9.592=-1.276
max8.789-10.423=-1.633

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.665-1.112=0.553
σ0.183-0.180=0.003
min1.401-0.943=0.458
max1.918-1.341=0.576

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.577=-0.244
σ572.198-572.661=-0.463
min177.232-177.239=-0.007
max1321.630-1322.568=-0.938
mean79.750
σ7.500
min76.000
max91.000
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean0.566-0.557=0.010
σ0.569-0.558=0.011
min0.274-0.276=-0.002
max1.419-1.393=0.026
policies=20
mean1772.555-1772.632=-0.077
σ0.327-0.334=-0.007
min1772.356-1772.413=-0.057
max1773.042-1773.128=-0.086
mean760.000
σ0.000
min760.000
max760.000
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean2.738-2.746=-0.009
σ0.009-0.009=-0.000
min2.730-2.736=-0.006
max2.750-2.754=-0.004
policies=200
mean17732.405-17732.848=-0.443
σ0.572-0.389=0.183
min17732.019-17732.559=-0.540
max17733.237-17733.419=-0.182
mean7600.000
σ0.000
min7600.000
max7600.000
mean2506.000-2695.000=-189.000
σ0.000
min2506.000-2695.000=-189.000
max2506.000-2695.000=-189.000
mean27.604-27.765=-0.161
σ0.077-0.216=-0.139
min27.498-27.607=-0.110
max27.679-28.071=-0.393