Compare commits

Home / Compare 0dc38c10 .. 64935c63

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.729=-0.023
σ0.046-0.045=0.001
min70.673-70.705=-0.031
max70.835-70.857=-0.022
mean415.000-411.400=3.600
σ0.000-0.516=-0.516
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.159-0.159=0.000
σ0.004-0.003=0.001
min0.152-0.156=-0.004
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.411-21.446=-0.035
σ0.002-0.003=-0.001
min21.408-21.440=-0.032
max21.415-21.449=-0.034
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.072-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.161-1754.759=0.401
σ0.360-0.361=-0.002
min1754.598-1754.185=0.413
max1755.740-1755.333=0.407
mean1632.600-1670.300=-37.700
σ597.117-650.862=-53.744
min634.000-619.000=15.000
max2434.000-2866.000=-432.000
mean2.770-2.831=-0.060
σ0.217-0.144=0.073
min2.180-2.294=-0.114
max3.224-2.981=0.243

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.797-273.589=-0.792
σ0.004-0.008=-0.004
min272.792-273.580=-0.788
max272.801-273.598=-0.797
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean0.383-0.392=-0.009
σ0.009-0.012=-0.003
min0.378-0.383=-0.004
max0.400-0.412=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.452-1934.228=-0.776
σ0.013-0.006=0.007
min1933.433-1934.221=-0.788
max1933.469-1934.238=-0.769
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean3.097-2.976=0.122
σ0.097-0.159=-0.062
min3.010-2.711=0.299
max3.256-3.099=0.157
iters=5
new-facts=6402
prior-facts=1
mean4757.180-4755.052=2.127
σ7.573-0.823=6.750
min4753.696-4754.592=-0.897
max4770.727-4756.520=14.207
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean8.525-8.151=0.374
σ0.382-0.382=-0.000
min7.939-7.769=0.170
max8.991-8.698=0.293
iters=5
new-facts=6402
prior-facts=6402
mean4944.615-4945.443=-0.828
σ0.162-0.018=0.144
min4944.326-4945.414=-1.088
max4944.708-4945.459=-0.751
mean2948.600-3085.600=-137.000
σ400.414-297.861=102.553
min2450.000-2866.000=-416.000
max3493.000-3547.000=-54.000
mean8.544-8.433=0.110
σ0.232-0.117=0.115
min8.302-8.327=-0.025
max8.861-8.618=0.244

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.637-1.059=0.578
σ0.127-0.277=-0.150
min1.462-0.933=0.529
max1.778-1.554=0.224

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.306-472.845=-4.539
σ574.228-574.928=-0.700
min181.186-185.377=-4.191
max1329.648-1335.237=-5.588
mean88.250
σ8.500
min84.000
max101.000
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean0.558-0.488=0.071
σ0.546-0.375=0.171
min0.283-0.300=-0.017
max1.378-1.051=0.327
policies=20
mean1812.180-1854.035=-41.856
σ0.387-0.382=0.005
min1811.924-1853.739=-41.814
max1812.752-1854.587=-41.835
mean840.000
σ0.000
min840.000
max840.000
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean2.822-2.957=-0.135
σ0.020-0.005=0.014
min2.799-2.953=-0.154
max2.840-2.965=-0.124
policies=200
mean18129.263-18546.824=-417.562
σ0.512-0.496=0.016
min18128.822-18546.402=-417.580
max18129.995-18547.487=-417.492
mean8400.000
σ0.000
min8400.000
max8400.000
mean2434.000-2866.000=-432.000
σ0.000
min2434.000-2866.000=-432.000
max2434.000-2866.000=-432.000
mean28.397-29.114=-0.717
σ0.075-0.599=-0.524
min28.327-28.764=-0.437
max28.491-30.009=-1.518