Compare commits

Home / Compare 27e88eeb .. 4b1499da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.002
σ0.047-0.052=-0.004
min70.751-70.755=-0.004
max70.914-70.926=-0.012
mean413.100-414.000=-0.900
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.162-0.159=0.002
σ0.004-0.003=0.000
min0.158-0.155=0.003
max0.168-0.166=0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.003-0.003=-0.000
min21.488-21.489=-0.001
max21.496-21.497=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.002
σ0.003-0.004=-0.001
min0.061-0.063=-0.002
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1713.950=40.143
σ0.362-169.563=-169.201
min1753.528-993.558=759.969
max1754.679-1752.451=2.228
mean1652.900-1640.650=12.250
σ626.912-604.305=22.607
min680.000-613.000=67.000
max2694.000-2701.000=-7.000
mean2.775-2.787=-0.012
σ0.181-0.346=-0.165
min2.378-1.460=0.918
max3.009-3.156=-0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.589-269.377=2.212
σ0.013-0.001=0.012
min271.569-269.377=2.193
max271.601-269.379=2.222
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean0.385-0.374=0.010
σ0.006-0.001=0.005
min0.381-0.373=0.009
max0.395-0.375=0.020
iters=5
new-facts=1
prior-facts=6402
mean1931.984-1929.746=2.238
σ0.018-0.016=0.001
min1931.961-1929.726=2.235
max1932.007-1929.768=2.239
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean2.563-2.928=-0.365
σ0.159-0.141=0.018
min2.473-2.729=-0.256
max2.845-3.098=-0.253
iters=5
new-facts=6402
prior-facts=1
mean4752.726-4750.482=2.243
σ0.912-0.885=0.027
min4752.233-4750.050=2.184
max4754.352-4752.064=2.287
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean8.538-8.757=-0.218
σ0.498-0.152=0.346
min7.747-8.541=-0.794
max8.990-8.907=0.083
iters=5
new-facts=6402
prior-facts=6402
mean4943.202-4940.981=2.221
σ0.018-0.018=0.000
min4943.179-4940.953=2.226
max4943.222-4940.999=2.223
mean2977.800-2978.800=-1.000
σ241.165-320.082=-78.917
min2694.000-2701.000=-7.000
max3315.000-3434.000=-119.000
mean8.431-8.368=0.064
σ0.056-0.027=0.029
min8.361-8.323=0.038
max8.494-8.398=0.096

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.155-1.018=0.137
σ0.272-0.135=0.138
min0.930-0.925=0.005
max1.571-1.237=0.334

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-462.738=5.928
σ574.951-574.950=0.001
min181.186-175.247=5.938
max1331.091-1325.162=5.929
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean0.571-0.481=0.089
σ0.565-0.413=0.152
min0.285-0.271=0.014
max1.418-1.101=0.317
policies=20
mean1812.200-1752.742=59.459
σ0.383-0.333=0.050
min1811.951-1752.527=59.423
max1812.767-1753.238=59.528
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean2.838-2.718=0.119
σ0.009-0.008=0.001
min2.828-2.707=0.121
max2.848-2.726=0.123
policies=200
mean18129.120-17534.656=594.464
σ0.494-0.556=-0.063
min18128.860-17534.302=594.558
max18129.861-17535.486=594.375
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2694.000-2701.000=-7.000
σ0.000
min2694.000-2701.000=-7.000
max2694.000-2701.000=-7.000
mean28.592-27.534=1.058
σ0.083-0.140=-0.057
min28.495-27.379=1.116
max28.693-27.659=1.034