Compare commits

Home / Compare 671bffcc .. 3bbb78c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.001
σ0.044-0.052=-0.008
min70.750-70.753=-0.003
max70.905-70.928=-0.023
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.161-0.160=0.001
σ0.003-0.003=0.000
min0.157-0.156=0.000
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.002-0.002=0.000
min21.488-21.491=-0.003
max21.497-21.498=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.002
min0.064-0.060=0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.091-1751.882=2.209
σ0.360-0.361=-0.000
min1753.530-1751.319=2.212
max1754.679-1752.466=2.213
mean1661.750-1640.200=21.550
σ635.073-630.194=4.879
min628.000-624.000=4.000
max2778.000-2781.000=-3.000
mean2.802-2.873=-0.071
σ0.228-0.172=0.056
min2.222-2.297=-0.075
max3.381-3.140=0.241

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.951-269.384=2.568
σ0.006-0.007=-0.001
min271.945-269.377=2.568
max271.959-269.390=2.568
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean0.380-0.377=0.003
σ0.001-0.005=-0.004
min0.379-0.373=0.006
max0.381-0.385=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1929.754=2.566
σ0.010-0.004=0.006
min1932.307-1929.747=2.559
max1932.334-1929.758=2.577
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean2.957-3.081=-0.124
σ0.121-0.103=0.018
min2.744-2.987=-0.243
max3.038-3.226=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4753.087-4750.370=2.717
σ0.857-0.964=-0.107
min4752.620-4749.544=3.076
max4754.612-4752.040=2.572
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean8.484-8.604=-0.119
σ0.392-0.403=-0.011
min7.919-7.990=-0.070
max8.878-9.031=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean4943.487-4940.991=2.495
σ0.152-0.013=0.139
min4943.216-4940.975=2.242
max4943.572-4941.003=2.569
mean2988.000-3026.200=-38.200
σ272.853-231.420=41.433
min2778.000-2781.000=-3.000
max3420.000-3337.000=83.000
mean8.355-8.600=-0.245
σ0.049-0.226=-0.177
min8.303-8.402=-0.099
max8.427-8.880=-0.453

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.992=0.041
σ0.134-0.137=-0.003
min0.943-0.926=0.017
max1.247-1.236=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.662-462.713=5.950
σ574.924-574.964=-0.041
min181.190-175.226=5.964
max1331.048-1325.159=5.889
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean0.447-0.573=-0.126
σ0.310-0.589=-0.279
min0.291-0.276=0.015
max0.912-1.457=-0.545
policies=20
mean1812.226-1752.509=59.717
σ0.384-0.375=0.009
min1811.949-1752.263=59.686
max1812.785-1753.068=59.718
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean2.944-2.755=0.189
σ0.050-0.015=0.035
min2.915-2.740=0.175
max3.019-2.776=0.243
policies=200
mean18129.048-17532.178=596.869
σ0.487-0.374=0.113
min18128.760-17531.933=596.826
max18129.776-17532.734=597.042
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2778.000-2781.000=-3.000
σ0.000
min2778.000-2781.000=-3.000
max2778.000-2781.000=-3.000
mean28.534-27.651=0.883
σ0.062-0.100=-0.038
min28.465-27.535=0.930
max28.605-27.780=0.825