Compare commits

Home / Compare 1aba765a .. 4827f46e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.392=0.001
σ0.046-0.047=-0.001
min70.372-70.369=0.004
max70.522-70.525=-0.003
mean415.900-414.000=1.900
σ0.316-0.000=0.316
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.159-0.154=0.005
σ0.005-0.005=-0.001
min0.153-0.148=0.005
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.147=-0.003
σ0.003-0.011=-0.008
min21.140-21.140=0.000
max21.151-21.178=-0.027
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.002
min0.063-0.057=0.006
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.394=0.303
σ0.359-0.360=-0.001
min1752.128-1751.827=0.301
max1753.279-1752.996=0.283
mean1659.750-1659.850=-0.100
σ632.223-629.874=2.349
min620.000-619.000=1.000
max2770.000-2779.000=-9.000
mean2.763-2.792=-0.029
σ0.211-0.146=0.065
min2.126-2.510=-0.384
max3.063-3.090=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.241=0.368
σ0.005-0.007=-0.003
min270.602-270.232=0.370
max270.615-270.249=0.366
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean0.378-0.381=-0.003
σ0.001-0.008=-0.007
min0.376-0.376=0.000
max0.380-0.395=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1931.046-1930.692=0.354
σ0.012-0.015=-0.003
min1931.036-1930.667=0.369
max1931.067-1930.704=0.363
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean2.922-2.545=0.378
σ0.183-0.119=0.065
min2.607-2.442=0.165
max3.081-2.706=0.375
iters=5
new-facts=6402
prior-facts=1
mean4751.776-4751.320=0.456
σ0.918-0.994=-0.075
min4751.221-4750.514=0.707
max4753.406-4753.046=0.360
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean8.566-8.327=0.238
σ0.466-0.562=-0.097
min7.961-7.688=0.274
max9.137-9.100=0.037
iters=5
new-facts=6402
prior-facts=6402
mean4942.231-4941.792=0.439
σ0.017-0.177=-0.160
min4942.213-4941.478=0.735
max4942.255-4941.890=0.365
mean3050.400-3055.000=-4.600
σ242.162-336.904=-94.742
min2770.000-2779.000=-9.000
max3397.000-3563.000=-166.000
mean8.640-8.482=0.158
σ0.213-0.174=0.038
min8.387-8.335=0.052
max8.933-8.766=0.167

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.144=-0.124
σ0.142-0.252=-0.109
min0.923-0.931=-0.008
max1.253-1.529=-0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.206-466.756=0.451
σ575.929-575.942=-0.014
min179.236-178.781=0.455
max1331.099-1330.670=0.430
mean86.250
σ8.500
min82.000
max99.000
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean0.440-0.441=-0.001
σ0.299-0.304=-0.005
min0.287-0.287=-0.000
max0.888-0.897=-0.009
policies=20
mean1792.605-1788.126=4.479
σ0.335-0.386=-0.052
min1792.361-1787.870=4.491
max1793.099-1788.699=4.401
mean820.000
σ0.000
min820.000
max820.000
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean2.821-2.859=-0.039
σ0.092-0.082=0.010
min2.765-2.778=-0.012
max2.958-2.967=-0.010
policies=200
mean17933.025-17888.114=44.911
σ0.522-0.568=-0.046
min17932.615-17887.676=44.939
max17933.790-17888.949=44.842
mean8200.000
σ0.000
min8200.000
max8200.000
mean2770.000-2779.000=-9.000
σ0.000
min2770.000-2779.000=-9.000
max2770.000-2779.000=-9.000
mean27.988-27.976=0.013
σ0.115-0.114=0.001
min27.859-27.881=-0.022
max28.126-28.127=-0.001