Compare commits

Home / Compare bd3cacb8 .. cd9341d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.703=-0.002
σ0.045-0.049=-0.004
min70.673-70.667=0.007
max70.826-70.838=-0.012
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.161=0.000
σ0.003-0.003=0.000
min0.158-0.159=-0.001
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.001
σ0.002-0.003=-0.001
min21.406-21.401=0.005
max21.412-21.411=0.001
mean414.000-414.500=-0.500
σ0.000-0.527=-0.527
min414.000
max414.000-415.000=-1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.929=0.002
σ0.361-0.362=-0.000
min1754.367-1754.357=0.010
max1755.516-1755.512=0.004
mean1628.250-1660.650=-32.400
σ619.757-646.005=-26.249
min623.000
max2757.000-2779.000=-22.000
mean2.814-2.782=0.031
σ0.252-0.179=0.073
min2.286-2.248=0.038
max3.114-2.978=0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.788-272.757=0.032
σ0.006-0.006=0.000
min272.781-272.750=0.031
max272.794-272.764=0.031
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean0.382-0.383=-0.001
σ0.008-0.008=0.000
min0.377-0.378=-0.002
max0.395-0.397=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.230-1933.168=0.062
σ0.004-0.015=-0.011
min1933.227-1933.145=0.082
max1933.238-1933.181=0.057
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean3.044-3.057=-0.014
σ0.348-0.054=0.295
min2.735-3.019=-0.283
max3.593-3.152=0.441
iters=5
new-facts=6402
prior-facts=1
mean4756.641-4756.923=-0.281
σ7.438-7.561=-0.123
min4752.497-4753.485=-0.987
max4769.918-4770.449=-0.530
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean8.405-8.436=-0.031
σ0.362-0.400=-0.038
min7.982-7.837=0.145
max8.919-8.909=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4944.461-4944.325=0.136
σ0.020-0.146=-0.126
min4944.433-4944.065=0.369
max4944.477-4944.406=0.071
mean3041.800-3038.200=3.600
σ272.668-315.303=-42.635
min2757.000-2779.000=-22.000
max3422.000-3512.000=-90.000
mean8.483-8.496=-0.012
σ0.112-0.114=-0.002
min8.366-8.414=-0.047
max8.624-8.690=-0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.003=0.009
σ0.136-0.134=0.002
min0.918-0.914=0.003
max1.232-1.220=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.337-468.339=-0.002
σ574.292-574.257=0.035
min181.186-181.203=-0.017
max1329.775-1329.724=0.051
mean88.250
σ8.500
min84.000
max101.000
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean0.486-0.446=0.040
σ0.405-0.301=0.105
min0.282-0.291=-0.010
max1.094-0.896=0.197
policies=20
mean1812.183-1812.370=-0.186
σ0.380-0.395=-0.015
min1811.932-1812.090=-0.158
max1812.748-1812.948=-0.200
mean840.000
σ0.000
min840.000
max840.000
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean2.806-2.886=-0.080
σ0.009-0.006=0.003
min2.795-2.877=-0.081
max2.816-2.890=-0.074
policies=200
mean18129.029-18129.090=-0.061
σ0.398-0.526=-0.129
min18128.761-18128.626=0.135
max18129.619-18129.577=0.042
mean8400.000
σ0.000
min8400.000
max8400.000
mean2757.000-2779.000=-22.000
σ0.000
min2757.000-2779.000=-22.000
max2757.000-2779.000=-22.000
mean28.428-28.545=-0.117
σ0.119-0.238=-0.119
min28.322-28.328=-0.006
max28.586-28.884=-0.298