Compare commits

Home / Compare 672b08bf .. 8748259c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.794=-5.021
σ0.045-0.108=-0.063
min30.751-35.750=-4.998
max30.901-36.100=-5.199
mean413.000
σ0.000
min413.000
max413.000
mean0.079-0.073=0.006
σ0.004-0.004=-0.000
min0.076-0.069=0.007
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-26.065=-5.006
σ0.002-0.003=-0.001
min21.056-26.061=-5.005
max21.064-26.072=-5.008
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.060=0.003
σ0.003-0.003=-0.000
min0.059-0.056=0.003
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.235=0.000
σ0.362-0.363=-0.001
min1750.676-1750.670=0.006
max1751.825-1751.809=0.016
mean1667.100-1624.650=42.450
σ630.176-591.533=38.643
min679.000-631.000=48.000
max2640.000-2412.000=228.000
mean2.837-2.834=0.003
σ0.106-0.219=-0.113
min2.621-2.205=0.416
max2.970-3.113=-0.143

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.567-275.568=-0.001
σ0.007-0.006=0.000
min275.562-275.561=0.001
max275.578-275.576=0.002
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean0.391-0.397=-0.006
σ0.008-0.011=-0.003
min0.383-0.388=-0.004
max0.400-0.411=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2168.099-2168.087=0.013
σ0.009-0.021=-0.012
min2168.089-2168.056=0.033
max2168.110-2168.107=0.003
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean2.997-2.884=0.113
σ0.161-0.124=0.037
min2.836-2.753=0.083
max3.223-3.023=0.200
iters=5
new-facts=6402
prior-facts=1
mean5047.922-5047.903=0.019
σ0.896-0.897=-0.000
min5047.391-5047.344=0.046
max5049.516-5049.496=0.020
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean9.018-8.804=0.214
σ0.328-0.460=-0.132
min8.597-8.094=0.504
max9.493-9.274=0.219
iters=5
new-facts=6402
prior-facts=6402
mean5179.041-5179.045=-0.003
σ0.082-0.086=-0.004
min5178.961-5178.968=-0.007
max5179.131-5179.139=-0.009
mean3218.800-3252.200=-33.400
σ388.112-518.143=-130.031
min2684.000-2625.000=59.000
max3704.000-3878.000=-174.000
mean9.864-9.893=-0.029
σ0.271-0.196=0.075
min9.489-9.657=-0.167
max10.214-10.083=0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.295-1.843=-0.548
σ0.381-0.061=0.320
min0.950-1.782=-0.832
max1.871-1.933=-0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.195=0.008
σ572.661-572.654=0.007
min176.872-176.865=0.007
max1322.194-1322.175=0.019
mean77.500
σ7.000
min74.000
max88.000
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean0.550-0.551=-0.001
σ0.541-0.547=-0.005
min0.275-0.275=0.000
max1.362-1.371=-0.009
policies=20
mean1768.970-1768.968=0.002
σ0.334-0.340=-0.006
min1768.757-1768.738=0.018
max1769.469-1769.473=-0.004
mean740.000
σ0.000
min740.000
max740.000
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean2.744-2.760=-0.016
σ0.019-0.017=0.003
min2.718-2.736=-0.019
max2.764-2.774=-0.010
policies=200
mean17696.103-17696.102=0.001
σ0.589-0.463=0.125
min17695.750-17695.784=-0.034
max17696.981-17696.782=0.199
mean7400.000
σ0.000
min7400.000
max7400.000
mean2640.000-2412.000=228.000
σ0.000
min2640.000-2412.000=228.000
max2640.000-2412.000=228.000
mean27.657-27.700=-0.042
σ0.132-0.131=0.001
min27.467-27.529=-0.061
max27.772-27.821=-0.049