Compare commits

Home / Compare ae1367f6 .. d6062dc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.795=0.003
σ0.106-0.108=-0.002
min35.754-35.752=0.002
max36.099-36.102=-0.004
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.073-0.077=-0.004
σ0.003-0.004=-0.001
min0.069-0.073=-0.005
max0.077-0.084=-0.007
cache=y
dps=1
iters=10
policies=100
mean26.066-26.064=0.001
σ0.003-0.003=-0.000
min26.062-26.060=0.002
max26.071-26.069=0.002
mean410.600-413.000=-2.400
σ0.516-0.000=0.516
min410.000-413.000=-3.000
max411.000-413.000=-2.000
mean0.061-0.058=0.002
σ0.003-0.003=-0.000
min0.059-0.056=0.003
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.236=-0.001
σ0.361-0.362=-0.001
min1750.670-1750.670=-0.000
max1751.803-1751.822=-0.019
mean1651.550-1661.300=-9.750
σ643.493-635.382=8.111
min624.000-620.000=4.000
max2844.000-2779.000=65.000
mean2.810-2.887=-0.077
σ0.147-0.106=0.041
min2.462-2.655=-0.193
max3.012-3.112=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-275.569=-0.001
σ0.007-0.006=0.001
min275.557-275.561=-0.004
max275.575-275.575=-0.000
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean0.404-0.405=-0.001
σ0.007-0.012=-0.006
min0.397-0.395=0.001
max0.411-0.422=-0.012
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2168.088=0.013
σ0.010-0.014=-0.004
min2168.089-2168.068=0.021
max2168.113-2168.104=0.008
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean3.050-3.026=0.024
σ0.172-0.136=0.036
min2.811-2.818=-0.008
max3.223-3.187=0.036
iters=5
new-facts=6402
prior-facts=1
mean5047.888-5047.934=-0.046
σ0.878-0.897=-0.019
min5047.414-5047.346=0.067
max5049.450-5049.501=-0.051
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean8.830-9.191=-0.362
σ0.374-0.589=-0.215
min8.214-8.485=-0.271
max9.122-10.020=-0.898
iters=5
new-facts=6402
prior-facts=6402
mean5178.908-5179.055=-0.146
σ0.263-0.084=0.180
min5178.625-5178.969=-0.345
max5179.149-5179.149=-0.000
mean3250.600-3258.000=-7.400
σ328.141-354.970=-26.828
min2844.000-2779.000=65.000
max3695.000-3703.000=-8.000
mean9.855-10.000=-0.145
σ0.323-0.259=0.065
min9.463-9.577=-0.114
max10.222-10.226=-0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.063=0.013
σ0.109-0.127=-0.018
min0.944-0.945=-0.000
max1.249-1.258=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.202=0.003
σ572.653-572.665=-0.012
min176.873-176.863=0.010
max1322.184-1322.199=-0.015
mean77.500
σ7.000
min74.000
max88.000
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean0.435-0.439=-0.003
σ0.304-0.300=0.004
min0.282-0.288=-0.006
max0.891-0.889=0.002
policies=20
mean1769.005-1768.976=0.028
σ0.331-0.315=0.016
min1768.773-1768.766=0.007
max1769.494-1769.437=0.057
mean740.000
σ0.000
min740.000
max740.000
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean2.824-2.794=0.029
σ0.009-0.126=-0.118
min2.811-2.727=0.085
max2.831-2.984=-0.153
policies=200
mean17696.164-17695.966=0.198
σ0.533-0.500=0.033
min17695.728-17695.664=0.064
max17696.910-17696.714=0.195
mean7400.000
σ0.000
min7400.000
max7400.000
mean2844.000-2779.000=65.000
σ0.000
min2844.000-2779.000=65.000
max2844.000-2779.000=65.000
mean28.069-27.715=0.353
σ0.545-0.081=0.464
min27.509-27.637=-0.128
max28.609-27.820=0.789