Compare commits

Home / Compare dced144e .. 61468e03

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.783=-0.001
σ0.045-0.046=-0.000
min70.750-70.747=0.003
max70.907-70.909=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.162=-0.002
σ0.003-0.003=-0.000
min0.154-0.158=-0.003
max0.165-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.002-0.002=0.000
min21.488-21.488=0.000
max21.496-21.495=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.092=-0.000
σ0.361-0.362=-0.001
min1753.530-1753.531=-0.002
max1754.679-1754.683=-0.004
mean1645.000-1665.000=-20.000
σ628.711-630.727=-2.016
min626.000-666.000=-40.000
max2771.000-2620.000=151.000
mean2.777-2.794=-0.017
σ0.196-0.140=0.056
min2.172-2.368=-0.196
max3.016-2.971=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.957-271.955=0.002
σ0.004-0.004=-0.001
min271.953-271.950=0.002
max271.963-271.960=0.003
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean0.382-0.385=-0.002
σ0.001-0.006=-0.005
min0.381-0.380=0.001
max0.385-0.395=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.323-1932.324=-0.001
σ0.007-0.025=-0.019
min1932.317-1932.298=0.019
max1932.334-1932.358=-0.023
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean3.057-2.899=0.158
σ0.064-0.278=-0.214
min2.989-2.433=0.556
max3.139-3.178=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4753.125-4753.059=0.067
σ0.894-0.924=-0.030
min4752.545-4752.595=-0.050
max4754.696-4754.710=-0.014
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean8.483-8.667=-0.184
σ0.681-0.474=0.207
min7.661-7.867=-0.205
max9.178-8.995=0.182
iters=5
new-facts=6402
prior-facts=6402
mean4943.419-4943.562=-0.143
σ0.190-0.013=0.177
min4943.199-4943.546=-0.347
max4943.569-4943.576=-0.007
mean3041.400-2966.400=75.000
σ235.586-262.096=-26.510
min2771.000-2620.000=151.000
max3331.000-3316.000=15.000
mean8.592-8.610=-0.018
σ0.127-0.188=-0.061
min8.409-8.430=-0.021
max8.752-8.927=-0.174

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.261=-0.256
σ0.150-0.364=-0.213
min0.933-0.937=-0.004
max1.274-1.819=-0.545

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.665-468.660=0.005
σ574.934-574.933=0.001
min181.188-181.188=0.000
max1331.066-1331.060=0.007
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean0.447-0.586=-0.139
σ0.300-0.594=-0.293
min0.295-0.281=0.013
max0.898-1.476=-0.579
policies=20
mean1812.200-1812.176=0.024
σ0.378-0.391=-0.013
min1811.918-1811.918=0.001
max1812.738-1812.753=-0.015
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean2.913-2.839=0.074
σ0.124-0.019=0.105
min2.828-2.817=0.011
max3.097-2.859=0.238
policies=200
mean18128.957-18129.191=-0.234
σ0.527-0.527=0.000
min18128.623-18128.801=-0.178
max18129.740-18129.968=-0.228
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2620.000=151.000
σ0.000
min2771.000-2620.000=151.000
max2771.000-2620.000=151.000
mean28.604-28.668=-0.064
σ0.031-0.136=-0.106
min28.559-28.537=0.023
max28.627-28.857=-0.230