Compare commits

Home / Compare e99049f9 .. 6ecf0890

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-30.769=0.272
σ0.047-0.046=0.002
min31.007-30.731=0.275
max31.174-30.894=0.280
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.079-0.078=0.001
σ0.003-0.002=0.001
min0.076-0.076=0.000
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.060=0.083
σ0.002-0.002=0.000
min21.141-21.057=0.084
max21.148-21.063=0.084
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.001
min0.062-0.058=0.005
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.420=-0.010
σ0.361-0.363=-0.002
min1750.845-1750.854=-0.008
max1751.976-1752.006=-0.030
mean1640.650-1645.750=-5.100
σ604.276-621.071=-16.796
min630.000-678.000=-48.000
max2435.000-2642.000=-207.000
mean2.763-2.842=-0.079
σ0.193-0.138=0.055
min2.412-2.443=-0.031
max3.045-3.012=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.649-275.759=-4.110
σ0.010-0.009=0.001
min271.640-275.751=-4.111
max271.661-275.768=-4.107
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean0.382-0.406=-0.024
σ0.004-0.012=-0.008
min0.378-0.395=-0.016
max0.388-0.420=-0.033
iters=5
new-facts=1
prior-facts=6402
mean1932.104-2168.288=-236.184
σ0.018-0.007=0.011
min1932.075-2168.277=-236.203
max1932.119-2168.296=-236.177
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean2.528-2.954=-0.426
σ0.163-0.155=0.008
min2.321-2.750=-0.429
max2.764-3.107=-0.343
iters=5
new-facts=6402
prior-facts=1
mean4752.505-5047.874=-295.370
σ0.572-1.168=-0.596
min4752.151-5046.579=-294.428
max4753.521-5049.781=-296.260
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean8.268-8.697=-0.429
σ0.657-0.459=0.198
min7.710-8.068=-0.358
max9.181-9.184=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean4942.906-5179.237=-236.331
σ0.200-0.069=0.131
min4942.634-5179.170=-236.536
max4943.146-5179.314=-236.168
mean2904.600-3228.400=-323.800
σ401.305-389.712=11.593
min2435.000-2686.000=-251.000
max3444.000-3719.000=-275.000
mean8.396-9.696=-1.300
σ0.062-0.553=-0.491
min8.321-8.915=-0.594
max8.470-10.249=-1.779

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.786-1.304=0.482
σ0.048-0.464=-0.416
min1.719-0.931=0.788
max1.823-1.987=-0.165

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.113-463.573=1.541
σ575.753-572.663=3.090
min177.234-177.236=-0.002
max1328.742-1322.567=6.175
mean79.750
σ7.500
min76.000
max91.000
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean0.558-0.555=0.002
σ0.547-0.542=0.005
min0.279-0.276=0.003
max1.378-1.368=0.010
policies=20
mean1772.588-1772.647=-0.059
σ0.329-0.335=-0.006
min1772.370-1772.417=-0.047
max1773.077-1773.144=-0.067
mean760.000
σ0.000
min760.000
max760.000
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean2.739-2.779=-0.040
σ0.019-0.024=-0.004
min2.721-2.759=-0.037
max2.766-2.812=-0.045
policies=200
mean17732.476-17732.908=-0.433
σ0.389-0.585=-0.196
min17732.187-17732.587=-0.400
max17733.049-17733.785=-0.736
mean7600.000
σ0.000
min7600.000
max7600.000
mean2435.000-2642.000=-207.000
σ0.000
min2435.000-2642.000=-207.000
max2435.000-2642.000=-207.000
mean27.709-27.931=-0.223
σ0.086-0.122=-0.035
min27.613-27.811=-0.198
max27.808-28.088=-0.281