Compare commits

Home / Compare e6a0f0cf .. 7041dab2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.000
σ0.046-0.049=-0.002
min33.950-33.950=-0.000
max34.108-34.115=-0.007
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.084-0.085=-0.001
σ0.003-0.003=-0.001
min0.080-0.083=-0.002
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.000
min23.313-23.312=0.001
max23.322-23.321=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.063-0.063=-0.000
σ0.002-0.003=-0.001
min0.061-0.060=0.001
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.492=0.002
σ0.364-0.365=-0.001
min1756.920-1756.920=-0.000
max1758.083-1758.082=0.001
mean1652.250-1646.100=6.150
σ638.842-624.806=14.036
min634.000
max2824.000-2832.000=-8.000
mean2.409-2.388=0.022
σ0.106-0.092=0.015
min2.280-2.234=0.046
max2.712-2.686=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.642-326.640=0.002
σ0.061-0.052=0.009
min326.534-326.551=-0.017
max326.683-326.682=0.001
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean0.427-0.433=-0.006
σ0.023-0.011=0.012
min0.389-0.423=-0.034
max0.448-0.448=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.809-1988.796=0.012
σ0.005-0.015=-0.010
min1988.800-1988.780=0.021
max1988.815-1988.811=0.004
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean2.687-2.703=-0.016
σ0.076-0.140=-0.065
min2.628-2.574=0.055
max2.818-2.939=-0.121
iters=5
new-facts=6402
prior-facts=1
mean4813.696-4813.650=0.046
σ7.729-7.742=-0.013
min4810.099-4810.174=-0.075
max4827.520-4827.499=0.021
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean8.539-8.936=-0.397
σ0.602-0.248=0.353
min7.720-8.547=-0.827
max9.240-9.156=0.084
iters=5
new-facts=6402
prior-facts=6402
mean5001.136-5001.211=-0.075
σ0.170-0.028=0.142
min5000.836-5001.189=-0.354
max5001.248-5001.259=-0.011
mean3037.200-3011.400=25.800
σ208.617-192.110=16.507
min2824.000-2832.000=-8.000
max3302.000-3295.000=7.000
mean9.909-9.921=-0.012
σ0.119-0.102=0.018
min9.779-9.803=-0.023
max10.098-10.062=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.054=-0.049
σ0.187-0.103=0.084
min0.917-0.922=-0.004
max1.340-1.210=0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.625-464.631=-0.006
σ574.770-574.772=-0.001
min177.238-177.240=-0.002
max1326.781-1326.789=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean0.438-0.416=0.022
σ0.312-0.269=0.043
min0.280-0.280=0.000
max0.907-0.820=0.087
policies=20
mean1772.706-1772.699=0.006
σ0.355-0.377=-0.022
min1772.443-1772.433=0.010
max1773.227-1773.256=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean2.813-2.824=-0.011
σ0.011-0.033=-0.023
min2.804-2.781=0.023
max2.828-2.851=-0.023
policies=200
mean17734.043-17734.133=-0.089
σ0.503-0.483=0.019
min17733.643-17733.730=-0.086
max17734.777-17734.826=-0.049
mean8400.000
σ0.000
min8400.000
max8400.000
mean2824.000-2832.000=-8.000
σ0.000
min2824.000-2832.000=-8.000
max2824.000-2832.000=-8.000
mean28.025-27.958=0.066
σ0.422-0.396=0.026
min27.556-27.597=-0.041
max28.514-28.379=0.136