Compare commits

Home / Compare be26ebf1 .. d908bbe6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.712-70.712=0.000
σ0.046-0.048=-0.002
min70.674-70.674=0.000
max70.836-70.844=-0.007
mean411.600-416.000=-4.400
σ0.516-0.000=0.516
min411.000-416.000=-5.000
max412.000-416.000=-4.000
mean0.158-0.157=0.000
σ0.006-0.004=0.001
min0.151-0.151=0.000
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.414-21.414=-0.000
σ0.003-0.003=-0.000
min21.411-21.409=0.002
max21.420-21.418=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.933-1754.931=0.002
σ0.361-0.361=-0.000
min1754.366-1754.366=0.000
max1755.523-1755.521=0.002
mean1657.950-1672.750=-14.800
σ646.011-643.041=2.969
min621.000-671.000=-50.000
max2774.000-2712.000=62.000
mean2.790-2.794=-0.004
σ0.226-0.174=0.053
min2.276-2.414=-0.138
max3.031-3.035=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.794=0.001
σ0.007-0.005=0.002
min272.783-272.789=-0.006
max272.800-272.802=-0.002
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean0.381-0.379=0.002
σ0.001-0.002=-0.000
min0.379-0.376=0.003
max0.381-0.380=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.221-1933.218=0.003
σ0.020-0.021=-0.000
min1933.195-1933.193=0.001
max1933.250-1933.240=0.010
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean3.046-3.055=-0.009
σ0.043-0.062=-0.019
min3.011-3.018=-0.008
max3.121-3.165=-0.044
iters=5
new-facts=6402
prior-facts=1
mean4756.808-4756.949=-0.141
σ7.674-7.589=0.085
min4752.926-4753.436=-0.510
max4770.527-4770.524=0.003
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean8.817-8.645=0.172
σ0.298-0.366=-0.068
min8.432-8.276=0.156
max9.085-9.133=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean4944.389-4944.389=-0.001
σ0.156-0.157=-0.002
min4944.111-4944.109=0.001
max4944.472-4944.475=-0.003
mean2987.800-2976.000=11.800
σ265.349-310.228=-44.879
min2774.000-2712.000=62.000
max3395.000-3435.000=-40.000
mean8.460-8.448=0.012
σ0.104-0.060=0.043
min8.373-8.382=-0.009
max8.624-8.518=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.032=0.013
σ0.126-0.188=-0.061
min0.929-0.902=0.026
max1.237-1.345=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.329-468.313=0.016
σ574.228-574.240=-0.011
min181.207-181.189=0.018
max1329.672-1329.672=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean0.445-0.568=-0.123
σ0.304-0.563=-0.259
min0.290-0.285=0.005
max0.901-1.412=-0.511
policies=20
mean1812.398-1812.192=0.206
σ0.395-0.388=0.007
min1812.127-1811.934=0.194
max1812.980-1812.767=0.213
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean2.890-2.822=0.068
σ0.016-0.006=0.010
min2.878-2.815=0.063
max2.912-2.829=0.083
policies=200
mean18129.231-18129.305=-0.075
σ0.588-0.475=0.112
min18128.724-18129.006=-0.282
max18130.062-18130.014=0.048
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2712.000=62.000
σ0.000
min2774.000-2712.000=62.000
max2774.000-2712.000=62.000
mean28.523-28.445=0.078
σ0.250-0.040=0.210
min28.331-28.390=-0.060
max28.882-28.479=0.404