Compare commits

Home / Compare 8087f249 .. 5a19cad2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.380=-0.001
σ0.044-0.046=-0.002
min70.354-70.347=0.007
max70.502-70.509=-0.006
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.161-0.158=0.003
σ0.003-0.003=0.000
min0.156-0.153=0.003
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.145=-0.001
σ0.003-0.003=0.000
min21.139-21.140=-0.001
max21.147-21.150=-0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.063-0.063=0.000
σ0.004-0.003=0.001
min0.059-0.058=0.001
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.387=-0.000
σ0.362-0.363=-0.001
min1751.818-1751.821=-0.003
max1752.957-1752.973=-0.016
mean1651.500-1647.350=4.150
σ612.897-619.891=-6.994
min677.000-682.000=-5.000
max2586.000-2640.000=-54.000
mean2.736-2.843=-0.107
σ0.204-0.151=0.054
min2.201-2.301=-0.100
max3.042-3.041=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.217-270.219=-0.002
σ0.006-0.007=-0.001
min270.207-270.209=-0.001
max270.223-270.228=-0.005
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean0.372-0.374=-0.002
σ0.001-0.005=-0.004
min0.371-0.371=0.001
max0.373-0.383=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.688-1930.684=0.004
σ0.009-0.017=-0.007
min1930.680-1930.658=0.022
max1930.702-1930.696=0.006
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean2.532-2.569=-0.037
σ0.129-0.120=0.008
min2.441-2.409=0.032
max2.754-2.675=0.078
iters=5
new-facts=6402
prior-facts=1
mean4751.152-4751.217=-0.065
σ0.866-0.810=0.056
min4750.600-4750.761=-0.161
max4752.689-4752.656=0.033
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean8.714-8.142=0.572
σ0.679-0.395=0.284
min7.703-7.671=0.031
max9.394-8.678=0.715
iters=5
new-facts=6402
prior-facts=6402
mean4941.621-4941.623=-0.002
σ0.086-0.084=0.002
min4941.549-4941.553=-0.004
max4941.716-4941.721=-0.004
mean3024.800-2969.200=55.600
σ311.880-340.307=-28.427
min2605.000-2640.000=-35.000
max3419.000-3451.000=-32.000
mean8.672-8.478=0.194
σ0.174-0.199=-0.024
min8.499-8.310=0.190
max8.890-8.768=0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.435-1.118=0.318
σ0.332-0.255=0.078
min1.079-0.935=0.144
max1.843-1.505=0.338

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.362=-0.003
σ575.929-575.934=-0.005
min178.393-178.391=0.002
max1330.253-1330.263=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean0.558-0.563=-0.006
σ0.555-0.561=-0.006
min0.278-0.282=-0.004
max1.390-1.404=-0.015
policies=20
mean1784.194-1784.228=-0.034
σ0.346-0.358=-0.011
min1783.993-1784.001=-0.008
max1784.710-1784.760=-0.050
mean800.000
σ0.000
min800.000
max800.000
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean2.781-2.774=0.007
σ0.020-0.015=0.005
min2.767-2.758=0.009
max2.810-2.795=0.015
policies=200
mean17848.824-17848.903=-0.079
σ0.561-0.516=0.045
min17848.470-17848.639=-0.169
max17849.650-17849.676=-0.026
mean8000.000
σ0.000
min8000.000
max8000.000
mean2586.000-2640.000=-54.000
σ0.000
min2586.000-2640.000=-54.000
max2586.000-2640.000=-54.000
mean28.025-28.006=0.019
σ0.147-0.186=-0.039
min27.907-27.861=0.046
max28.220-28.268=-0.048