Compare commits

Home / Compare 3f3070c6 .. df64d8df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.772=0.001
σ0.046-0.045=0.001
min30.752-30.750=0.003
max30.904-30.900=0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.078-0.076=0.003
σ0.004-0.006=-0.003
min0.075-0.069=0.006
max0.086-0.088=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-21.058=0.001
σ0.002-0.002=0.000
min21.055-21.054=0.001
max21.064-21.061=0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.063-0.062=0.001
σ0.002-0.004=-0.002
min0.062-0.056=0.006
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.235=0.002
σ0.365-0.362=0.003
min1750.670-1750.670=-0.000
max1751.818-1751.821=-0.003
mean1677.100-1671.400=5.700
σ644.811-630.965=13.846
min683.000
max2718.000-2651.000=67.000
mean2.861-2.816=0.045
σ0.107-0.104=0.004
min2.512-2.608=-0.096
max3.011-3.056=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.570-275.566=0.003
σ0.006-0.007=-0.001
min275.565-275.561=0.004
max275.580-275.578=0.002
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean0.400-0.391=0.009
σ0.007-0.009=-0.001
min0.394-0.386=0.009
max0.409-0.406=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2168.099=-0.009
σ0.018-0.007=0.010
min2168.074-2168.091=-0.017
max2168.117-2168.109=0.008
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean2.964-2.968=-0.004
σ0.123-0.164=-0.041
min2.774-2.747=0.027
max3.074-3.153=-0.080
iters=5
new-facts=6402
prior-facts=1
mean5047.777-5047.550=0.227
σ1.038-1.248=-0.210
min5046.750-5046.167=0.583
max5049.517-5049.530=-0.013
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean8.857-8.762=0.095
σ0.459-0.485=-0.026
min8.104-8.135=-0.031
max9.281-9.272=0.009
iters=5
new-facts=6402
prior-facts=6402
mean5179.045-5178.989=0.056
σ0.090-0.207=-0.117
min5178.963-5178.648=0.315
max5179.164-5179.172=-0.008
mean3233.200-3212.000=21.200
σ361.481-386.003=-24.522
min2718.000-2680.000=38.000
max3687.000-3694.000=-7.000
mean9.840-10.215=-0.376
σ0.499-0.278=0.221
min9.347-9.961=-0.613
max10.555-10.604=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.131-1.163=-0.032
σ0.085-0.343=-0.259
min1.063-0.942=0.121
max1.255-1.727=-0.471

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.207=-0.001
σ572.658-572.671=-0.013
min176.863-176.869=-0.006
max1322.193-1322.214=-0.021
mean77.500
σ7.000
min74.000
max88.000
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean0.557-0.547=0.010
σ0.539-0.531=0.008
min0.285-0.281=0.004
max1.366-1.344=0.022
policies=20
mean1768.933-1768.964=-0.031
σ0.331-0.331=-0.000
min1768.737-1768.754=-0.017
max1769.428-1769.459=-0.030
mean740.000
σ0.000
min740.000
max740.000
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean2.743-2.735=0.008
σ0.025-0.012=0.013
min2.715-2.720=-0.005
max2.767-2.749=0.019
policies=200
mean17696.143-17696.132=0.011
σ0.586-0.501=0.085
min17695.746-17695.772=-0.025
max17697.009-17696.861=0.148
mean7400.000
σ0.000
min7400.000
max7400.000
mean2718.000-2651.000=67.000
σ0.000
min2718.000-2651.000=67.000
max2718.000-2651.000=67.000
mean27.596-27.722=-0.127
σ0.090-0.131=-0.042
min27.495-27.584=-0.088
max27.707-27.896=-0.189