Compare commits

Home / Compare dfa12265 .. 59579e3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.975-53.971=0.004
σ0.365-0.364=0.001
min53.847-53.839=0.008
max55.013-55.006=0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.144-0.138=0.006
σ0.010-0.004=0.006
min0.136-0.134=0.001
max0.165-0.146=0.019
cache=y
dps=1
iters=10
policies=100
mean43.182-43.176=0.006
σ0.005-0.005=0.000
min43.171-43.166=0.006
max43.188-43.184=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.119=0.021
σ0.007-0.004=0.002
min0.125-0.113=0.012
max0.146-0.127=0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.846-994.839=0.008
σ1.251-1.250=0.002
min994.265-994.262=0.003
max1000.113-1000.100=0.012
mean1054.250-1066.350=-12.100
σ315.195-320.093=-4.899
min568.000-574.000=-6.000
max1622.000-1628.000=-6.000
mean1.471-1.467=0.003
σ0.085-0.072=0.013
min1.328-1.402=-0.074
max1.674-1.698=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.263-297.289=-0.025
σ0.010-0.014=-0.003
min297.251-297.267=-0.015
max297.279-297.303=-0.025
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean0.382-0.390=-0.008
σ0.003-0.006=-0.003
min0.380-0.383=-0.004
max0.387-0.399=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1298.545-1298.540=0.006
σ0.136-0.125=0.011
min1298.479-1298.478=0.001
max1298.789-1298.764=0.025
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean1.930-2.000=-0.070
σ0.141-0.094=0.046
min1.761-1.889=-0.127
max2.148-2.150=-0.002
iters=5
new-facts=6402
prior-facts=1
mean1820.729-1820.781=-0.052
σ7.077-6.988=0.089
min1817.338-1817.413=-0.075
max1833.374-1833.266=0.109
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean4.102-4.193=-0.091
σ0.407-0.179=0.228
min3.820-4.010=-0.190
max4.803-4.457=0.346
iters=5
new-facts=6402
prior-facts=6402
mean2083.373-2083.376=-0.003
σ0.003-0.009=-0.006
min2083.369-2083.368=0.001
max2083.377-2083.391=-0.014
mean1831.200-1857.000=-25.800
σ174.203-200.950=-26.747
min1622.000-1628.000=-6.000
max2071.000-2086.000=-15.000
mean4.486-4.503=-0.017
σ0.022-0.097=-0.075
min4.461-4.413=0.048
max4.520-4.648=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.134=0.064
σ0.370-0.246=0.125
min0.914-0.926=-0.012
max1.802-1.514=0.288

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.382-440.376=0.006
σ572.880-572.870=0.010
min153.937-153.935=0.002
max1299.701-1299.681=0.020
mean94.250
σ8.500
min90.000
max107.000
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean0.546-0.548=-0.002
σ0.558-0.562=-0.004
min0.260-0.266=-0.006
max1.382-1.390=-0.008
policies=20
mean1539.601-1539.607=-0.006
σ0.302-0.295=0.008
min1539.408-1539.428=-0.020
max1540.051-1540.046=0.005
mean900.000
σ0.000
min900.000
max900.000
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean2.562-2.569=-0.007
σ0.010-0.022=-0.012
min2.556-2.548=0.008
max2.577-2.596=-0.019
policies=200
mean15404.000-15403.990=0.010
σ0.058-0.124=-0.066
min15403.919-15403.835=0.084
max15404.042-15404.126=-0.084
mean9000.000
σ0.000
min9000.000
max9000.000
mean1622.000-1628.000=-6.000
σ0.000
min1622.000-1628.000=-6.000
max1622.000-1628.000=-6.000
mean25.902-26.041=-0.139
σ0.236-0.273=-0.037
min25.600-25.804=-0.204
max26.126-26.421=-0.295