Compare commits

Home / Compare 1c1ee504 .. 824601bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.001
σ0.049-0.051=-0.002
min31.000-30.999=0.001
max31.175-31.181=-0.006
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.079-0.079=-0.000
σ0.002-0.003=-0.001
min0.077-0.077=-0.001
max0.084-0.087=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=0.001
σ0.003-0.003=-0.000
min21.139-21.136=0.002
max21.146-21.145=0.001
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.065-0.064=0.001
σ0.004-0.004=-0.000
min0.059-0.059=-0.000
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=-0.000
σ0.362-0.364=-0.002
min1750.852-1750.843=0.008
max1751.993-1751.996=-0.002
mean1653.600-1654.650=-1.050
σ646.421-648.622=-2.201
min649.000-651.000=-2.000
max2848.000-2858.000=-10.000
mean2.856-2.811=0.045
σ0.136-0.194=-0.058
min2.480-2.318=0.162
max3.188-3.213=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.072-279.070=0.001
σ0.005-0.004=0.001
min279.064-279.064=-0.000
max279.077-279.075=0.002
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean0.391-0.392=-0.001
σ0.005-0.006=-0.001
min0.387-0.385=0.001
max0.398-0.399=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1939.518-1939.520=-0.001
σ0.012-0.009=0.003
min1939.500-1939.508=-0.008
max1939.530-1939.529=0.001
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean2.824-3.071=-0.247
σ0.206-0.089=0.116
min2.500-2.983=-0.482
max3.011-3.186=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4760.056-4759.833=0.223
σ0.791-0.972=-0.182
min4759.561-4759.085=0.476
max4761.458-4761.470=-0.012
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean8.165-8.139=0.026
σ0.379-0.334=0.045
min7.733-7.682=0.051
max8.634-8.585=0.048
iters=5
new-facts=6402
prior-facts=6402
mean4950.467-4950.399=0.068
σ0.078-0.209=-0.131
min4950.401-4950.050=0.351
max4950.555-4950.567=-0.012
mean3077.200-3044.200=33.000
σ302.031-266.387=35.644
min2848.000-2858.000=-10.000
max3541.000-3462.000=79.000
mean8.491-8.377=0.113
σ0.122-0.050=0.071
min8.378-8.318=0.060
max8.639-8.441=0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.054=0.023
σ0.108-0.124=-0.016
min0.935-0.941=-0.006
max1.238-1.245=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.339-463.340=-0.000
σ572.202-572.196=0.006
min177.229-177.240=-0.011
max1321.642-1321.634=0.008
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean0.439-0.443=-0.003
σ0.308-0.306=0.002
min0.281-0.284=-0.002
max0.901-0.901=0.000
policies=20
mean1772.598-1772.618=-0.020
σ0.338-0.333=0.005
min1772.348-1772.381=-0.033
max1773.093-1773.106=-0.013
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean2.840-2.844=-0.003
σ0.021-0.008=0.014
min2.816-2.834=-0.017
max2.863-2.852=0.011
policies=200
mean17732.480-17732.452=0.028
σ0.483-0.439=0.044
min17732.189-17731.976=0.214
max17733.203-17733.037=0.166
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean28.171-28.211=-0.041
σ0.455-0.481=-0.027
min27.763-27.701=0.062
max28.586-28.726=-0.140