Compare commits

Home / Compare 4b7ccd4b .. 64585dba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.769=-0.001
σ0.048-0.048=0.000
min30.727-30.733=-0.006
max30.902-30.902=-0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.075-0.074=0.001
σ0.005-0.004=0.000
min0.071-0.070=0.001
max0.083-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.001
σ0.003-0.003=0.000
min21.056-21.057=-0.001
max21.064-21.066=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.057-0.062=-0.005
max0.070-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.421=-0.002
σ0.363-0.363=-0.000
min1750.852-1750.844=0.008
max1752.005-1752.007=-0.003
mean1660.650-1657.300=3.350
σ634.389-634.448=-0.058
min680.000-689.000=-9.000
max2698.000-2771.000=-73.000
mean2.836-2.853=-0.017
σ0.144-0.125=0.019
min2.363-2.631=-0.268
max3.019-3.190=-0.171

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.755=-0.000
σ0.010-0.010=0.000
min275.743-275.744=-0.001
max275.769-275.766=0.003
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean0.395-0.392=0.003
σ0.011-0.007=0.005
min0.386-0.388=-0.002
max0.409-0.404=0.005
iters=5
new-facts=1
prior-facts=6402
mean2168.282-2168.280=0.002
σ0.011-0.019=-0.007
min2168.264-2168.250=0.015
max2168.291-2168.299=-0.008
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean2.929-2.916=0.013
σ0.187-0.186=0.001
min2.635-2.764=-0.129
max3.097-3.120=-0.023
iters=5
new-facts=6402
prior-facts=1
mean5048.101-5048.155=-0.054
σ0.923-0.862=0.062
min5047.616-5047.696=-0.079
max5049.746-5049.692=0.054
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean8.943-8.374=0.569
σ0.514-0.325=0.189
min8.104-8.033=0.071
max9.400-8.904=0.496
iters=5
new-facts=6402
prior-facts=6402
mean5179.239-5179.230=0.008
σ0.080-0.086=-0.006
min5179.160-5179.152=0.008
max5179.335-5179.340=-0.005
mean3267.000-3234.600=32.400
σ375.876-433.756=-57.880
min2735.000-2771.000=-36.000
max3720.000-3833.000=-113.000
mean9.864-9.986=-0.122
σ0.336-0.473=-0.137
min9.387-9.247=0.141
max10.174-10.516=-0.342

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.168=-0.050
σ0.191-0.259=-0.068
min0.931-0.955=-0.024
max1.375-1.567=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.580=-0.004
σ572.676-572.662=0.014
min177.233-177.243=-0.010
max1322.589-1322.573=0.016
mean79.750
σ7.500
min76.000
max91.000
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean0.568-0.441=0.127
σ0.577-0.304=0.273
min0.277-0.283=-0.006
max1.433-0.896=0.536
policies=20
mean1772.602-1772.657=-0.055
σ0.329-0.302=0.028
min1772.380-1772.421=-0.041
max1773.091-1773.099=-0.008
mean760.000
σ0.000
min760.000
max760.000
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean2.742-2.793=-0.051
σ0.019-0.081=-0.062
min2.715-2.734=-0.020
max2.758-2.913=-0.155
policies=200
mean17732.894-17733.012=-0.118
σ0.505-0.493=0.012
min17732.583-17732.705=-0.122
max17733.649-17733.746=-0.097
mean7600.000
σ0.000
min7600.000
max7600.000
mean2698.000-2771.000=-73.000
σ0.000
min2698.000-2771.000=-73.000
max2698.000-2771.000=-73.000
mean27.738-27.739=-0.001
σ0.110-0.161=-0.051
min27.595-27.552=0.042
max27.833-27.908=-0.075