Compare commits

Home / Compare 566f2f6c .. 14963768

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.727=0.001
σ0.685-0.616=0.068
min35.931-35.924=0.006
max37.525-37.218=0.307
mean3975.000-4126.000=-151.000
σ0.000
min3975.000-4126.000=-151.000
max3975.000-4126.000=-151.000
mean0.075-0.074=0.001
σ0.001-0.001=0.000
min0.074-0.073=0.001
max0.076-0.076=0.001
cache=y
dps=1
iters=10
policies=100
mean26.586-26.711=-0.125
σ0.604-0.645=-0.041
min26.207-26.210=-0.003
max27.463-27.465=-0.002
mean3975.000-4126.000=-151.000
σ0.000
min3975.000-4126.000=-151.000
max3975.000-4126.000=-151.000
mean0.060-0.060=0.001
σ0.000-0.001=-0.000
min0.060-0.059=0.001
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.359=0.006
σ0.374-0.374=0.000
min1755.794-1755.788=0.007
max1756.963-1756.955=0.009
mean1648.700-1651.600=-2.900
σ617.436-626.452=-9.016
min615.000-678.000=-63.000
max2643.000-2598.000=45.000
mean2.259-2.265=-0.006
σ0.184-0.136=0.048
min2.081-2.113=-0.032
max2.770-2.649=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.693-278.675=0.018
σ0.014-0.015=-0.001
min278.679-278.659=0.020
max278.717-278.696=0.020
mean2643.000-2598.000=45.000
σ0.000
min2643.000-2598.000=45.000
max2643.000-2598.000=45.000
mean0.418-0.417=0.001
σ0.002-0.001=0.001
min0.417-0.416=0.000
max0.420-0.418=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.866-2268.852=0.014
σ0.010-0.004=0.007
min2268.852-2268.849=0.002
max2268.880-2268.858=0.022
mean2643.000-2598.000=45.000
σ0.000
min2643.000-2598.000=45.000
max2643.000-2598.000=45.000
mean2.931-3.188=-0.258
σ0.039-0.297=-0.258
min2.905-2.882=0.023
max2.997-3.582=-0.585
iters=5
new-facts=6402
prior-facts=1
mean4952.360-4952.188=0.173
σ0.779-0.945=-0.166
min4951.979-4951.346=0.633
max4953.752-4953.815=-0.064
mean2643.000-2598.000=45.000
σ0.000
min2643.000-2598.000=45.000
max2643.000-2598.000=45.000
mean7.882-8.064=-0.183
σ0.154-0.280=-0.125
min7.750-7.694=0.055
max8.131-8.470=-0.338
iters=5
new-facts=6402
prior-facts=6402
mean5167.074-5166.984=0.090
σ0.008-0.158=-0.150
min5167.064-5166.701=0.363
max5167.087-5167.074=0.013
mean3419.000-3368.800=50.200
σ447.247-526.740=-79.493
min2811.000-2899.000=-88.000
max3975.000-4126.000=-151.000
mean9.371-9.353=0.018
σ0.122-0.095=0.027
min9.251-9.188=0.063
max9.576-9.429=0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.052=0.031
σ0.112-0.127=-0.016
min0.945-0.932=0.013
max1.258-1.246=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.253=0.005
σ572.608-572.607=0.001
min173.949-173.947=0.002
max1319.169-1319.163=0.006
mean79.500
σ7.000
min76.000
max90.000
mean436.000
σ0.000
min436.000
max436.000
mean0.499-0.553=-0.054
σ0.449-0.555=-0.106
min0.268-0.272=-0.004
max1.174-1.386=-0.212
policies=20
mean1740.024-1739.988=0.036
σ0.335-0.334=0.002
min1739.788-1739.745=0.043
max1740.518-1740.478=0.040
mean760.000
σ0.000
min760.000
max760.000
mean446.500-444.750=1.750
σ9.950-8.461=1.489
min436.000
max455.000-452.000=3.000
mean2.667-2.664=0.002
σ0.016-0.006=0.009
min2.644-2.659=-0.015
max2.677-2.672=0.005
policies=200
mean17409.682-17409.332=0.350
σ0.156-0.071=0.085
min17409.540-17409.247=0.294
max17409.864-17409.418=0.445
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.750-488.000=3.750
σ2.363-2.000=0.363
min490.000-485.000=5.000
max495.000-489.000=6.000
mean26.899-26.822=0.077
σ0.112-0.090=0.021
min26.774-26.733=0.041
max27.041-26.947=0.094