Compare commits

Home / Compare 35249801 .. ce2a20a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.262=0.356
σ0.055-0.053=0.001
min35.586-35.230=0.356
max35.772-35.412=0.360
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.087-0.082=0.005
σ0.004-0.005=-0.001
min0.083-0.077=0.006
max0.096-0.091=0.005
cache=y
dps=1
iters=10
policies=100
mean24.047-23.769=0.278
σ0.003-0.004=-0.001
min24.044-23.764=0.280
max24.053-23.776=0.277
mean413.000-414.700=-1.700
σ0.000-0.483=-0.483
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.067-0.066=0.001
σ0.004-0.005=-0.001
min0.062-0.060=0.002
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.472=0.019
σ0.364-0.365=-0.001
min1755.918-1755.896=0.022
max1757.076-1757.057=0.019
mean1660.450-1626.600=33.850
σ647.568-591.585=55.983
min622.000-652.000=-30.000
max2812.000-2422.000=390.000
mean2.374-2.345=0.029
σ0.137-0.107=0.030
min2.182-2.215=-0.032
max2.805-2.670=0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.778-324.682=0.096
σ0.008-0.048=-0.040
min324.763-324.596=0.168
max324.783-324.707=0.076
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean0.421-0.431=-0.009
σ0.009-0.011=-0.003
min0.414-0.423=-0.009
max0.432-0.449=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.321-1985.253=0.068
σ0.019-0.012=0.007
min1985.289-1985.233=0.056
max1985.340-1985.265=0.075
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean2.624-2.674=-0.050
σ0.064-0.194=-0.130
min2.569-2.475=0.094
max2.711-2.979=-0.268
iters=5
new-facts=6402
prior-facts=1
mean4808.879-4808.858=0.022
σ7.451-7.690=-0.239
min4805.032-4805.410=-0.378
max4822.196-4822.615=-0.419
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean8.561-8.975=-0.414
σ0.532-0.109=0.422
min7.692-8.884=-1.191
max9.051-9.160=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean4996.565-4996.375=0.190
σ0.162-0.145=0.017
min4996.279-4996.117=0.162
max4996.671-4996.466=0.205
mean3052.400-2937.600=114.800
σ216.832-449.491=-232.659
min2812.000-2422.000=390.000
max3365.000-3538.000=-173.000
mean8.967-8.524=0.443
σ0.474-0.123=0.351
min8.464-8.440=0.024
max9.641-8.740=0.901

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.672=-0.688
σ0.139-0.182=-0.043
min0.916-1.348=-0.432
max1.233-1.772=-0.540

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.216-462.924=0.291
σ574.772-574.245=0.527
min175.818-175.798=0.020
max1325.373-1324.291=1.082
mean86.250
σ8.500
min82.000
max99.000
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean0.430-0.551=-0.120
σ0.303-0.552=-0.249
min0.277-0.272=0.005
max0.885-1.379=-0.494
policies=20
mean1758.550-1758.299=0.251
σ0.346-0.350=-0.005
min1758.295-1758.062=0.233
max1759.058-1758.819=0.240
mean820.000
σ0.000
min820.000
max820.000
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean2.817-2.735=0.082
σ0.060-0.022=0.038
min2.775-2.712=0.063
max2.906-2.763=0.143
policies=200
mean17592.117-17590.124=1.993
σ0.416-0.535=-0.119
min17591.881-17589.757=2.123
max17592.739-17590.912=1.827
mean8200.000
σ0.000
min8200.000
max8200.000
mean2812.000-2422.000=390.000
σ0.000
min2812.000-2422.000=390.000
max2812.000-2422.000=390.000
mean27.509-27.560=-0.051
σ0.120-0.226=-0.106
min27.374-27.388=-0.014
max27.633-27.886=-0.254