Compare commits

Home / Compare ffedd6aa .. 0704f563

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.040=-0.001
σ0.052-0.048=0.004
min31.002-30.998=0.003
max31.184-31.173=0.011
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.077-0.079=-0.002
σ0.004-0.002=0.002
min0.071-0.077=-0.006
max0.085-0.086=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.003=-0.001
min21.141-21.139=0.002
max21.146-21.147=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.361-0.359=0.001
min1750.849-1750.842=0.007
max1751.981-1751.975=0.006
mean1637.800-1637.900=-0.100
σ615.732-614.663=1.069
min633.000-628.000=5.000
max2474.000-2469.000=5.000
mean2.779-2.829=-0.050
σ0.194-0.098=0.096
min2.137-2.669=-0.532
max3.043-3.015=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-266.781=-0.000
σ0.007-0.005=0.003
min266.772-266.775=-0.003
max266.789-266.787=0.001
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean0.368-0.368=0.000
σ0.009-0.004=0.004
min0.364-0.363=0.000
max0.383-0.374=0.010
iters=5
new-facts=1
prior-facts=6402
mean1927.210-1927.203=0.007
σ0.010-0.011=-0.000
min1927.202-1927.186=0.016
max1927.225-1927.215=0.010
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean3.047-3.041=0.007
σ0.231-0.093=0.138
min2.751-2.915=-0.164
max3.386-3.165=0.221
iters=5
new-facts=6402
prior-facts=1
mean4747.697-4747.625=0.072
σ0.845-0.506=0.339
min4747.189-4747.295=-0.106
max4749.199-4748.519=0.680
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean8.543-8.304=0.239
σ0.495-0.587=-0.092
min7.932-7.749=0.182
max9.157-9.203=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean4938.173-4938.158=0.014
σ0.091-0.080=0.010
min4938.099-4938.085=0.014
max4938.276-4938.247=0.029
mean3003.000-2939.600=63.400
σ272.715-400.013=-127.298
min2612.000-2494.000=118.000
max3337.000-3465.000=-128.000
mean8.667-8.402=0.265
σ0.267-0.094=0.173
min8.427-8.324=0.104
max9.001-8.560=0.441

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.776-1.844=-0.068
σ0.111-0.156=-0.045
min1.618-1.718=-0.099
max1.925-2.114=-0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.114-465.112=0.002
σ575.753-575.753=0.000
min177.235-177.230=0.004
max1328.743-1328.741=0.002
mean79.750
σ7.500
min76.000
max91.000
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean0.561-0.553=0.008
σ0.559-0.547=0.012
min0.275-0.274=0.000
max1.400-1.374=0.026
policies=20
mean1772.576-1772.578=-0.003
σ0.326-0.319=0.007
min1772.364-1772.367=-0.003
max1773.060-1773.050=0.010
mean760.000
σ0.000
min760.000
max760.000
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean2.733-2.740=-0.007
σ0.015-0.023=-0.007
min2.711-2.706=0.004
max2.745-2.754=-0.009
policies=200
mean17732.518-17732.328=0.190
σ0.483-0.621=-0.138
min17732.231-17731.790=0.441
max17733.240-17733.211=0.030
mean7600.000
σ0.000
min7600.000
max7600.000
mean2474.000-2469.000=5.000
σ0.000
min2474.000-2469.000=5.000
max2474.000-2469.000=5.000
mean27.690-27.702=-0.012
σ0.103-0.140=-0.036
min27.553-27.569=-0.015
max27.780-27.870=-0.091