Compare commits

Home / Compare ef8bbfd7 .. a363f47c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=-0.001
σ0.049-0.051=-0.001
min30.995-30.999=-0.004
max31.176-31.181=-0.005
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.079-0.079=0.000
σ0.003-0.003=0.000
min0.076-0.077=-0.001
max0.087-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.003=-0.000
min21.138-21.139=-0.001
max21.148-21.150=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.062-0.063=-0.001
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.001
σ0.362-0.361=0.001
min1750.838-1750.841=-0.004
max1751.989-1751.976=0.013
mean1658.400-1659.450=-1.050
σ644.778-629.708=15.070
min628.000-673.000=-45.000
max2774.000-2660.000=114.000
mean2.813-2.827=-0.014
σ0.215-0.205=0.010
min2.299-2.213=0.086
max3.158-3.066=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.786-266.776=0.010
σ0.010-0.006=0.004
min266.777-266.767=0.011
max266.797-266.783=0.014
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean0.368-0.364=0.003
σ0.008-0.002=0.007
min0.363-0.361=0.002
max0.382-0.366=0.017
iters=5
new-facts=1
prior-facts=6402
mean1927.222-1927.210=0.012
σ0.020-0.010=0.010
min1927.198-1927.197=0.001
max1927.246-1927.223=0.023
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean2.813-2.850=-0.037
σ0.268-0.112=0.156
min2.451-2.703=-0.252
max3.045-3.002=0.043
iters=5
new-facts=6402
prior-facts=1
mean4747.463-4747.655=-0.193
σ1.114-0.849=0.264
min4746.110-4746.898=-0.789
max4749.215-4749.112=0.102
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean8.696-8.079=0.617
σ0.286-0.304=-0.018
min8.458-7.734=0.724
max9.170-8.503=0.666
iters=5
new-facts=6402
prior-facts=6402
mean4938.168-4938.159=0.008
σ0.088-0.084=0.004
min4938.095-4938.081=0.014
max4938.264-4938.254=0.010
mean3041.200-3003.800=37.400
σ210.209-383.304=-173.095
min2774.000-2660.000=114.000
max3323.000-3554.000=-231.000
mean8.549-8.466=0.084
σ0.226-0.144=0.082
min8.313-8.339=-0.026
max8.869-8.642=0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.125-1.200=-0.075
σ0.128-0.190=-0.062
min1.060-1.057=0.003
max1.353-1.468=-0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.124-465.125=-0.000
σ575.764-575.778=-0.014
min177.236-177.233=0.003
max1328.771-1328.792=-0.021
mean79.750
σ7.500
min76.000
max91.000
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean0.446-0.562=-0.115
σ0.304-0.563=-0.259
min0.293-0.278=0.014
max0.903-1.406=-0.503
policies=20
mean1772.606-1772.589=0.017
σ0.320-0.328=-0.008
min1772.372-1772.375=-0.003
max1773.074-1773.077=-0.003
mean760.000
σ0.000
min760.000
max760.000
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean2.849-2.749=0.100
σ0.127-0.018=0.108
min2.750-2.726=0.024
max3.018-2.769=0.249
policies=200
mean17732.356-17732.531=-0.175
σ0.504-0.470=0.033
min17732.029-17732.209=-0.180
max17733.107-17733.228=-0.122
mean7600.000
σ0.000
min7600.000
max7600.000
mean2774.000-2660.000=114.000
σ0.000
min2774.000-2660.000=114.000
max2774.000-2660.000=114.000
mean27.806-27.768=0.038
σ0.106-0.224=-0.118
min27.699-27.602=0.097
max27.928-28.093=-0.165