Compare commits

Home / Compare d3673e39 .. 774eec52

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.793=-5.020
σ0.046-0.106=-0.060
min30.750-35.747=-4.997
max30.903-36.093=-5.190
mean411.900-412.900=-1.000
σ0.316
min411.000-412.000=-1.000
max412.000-413.000=-1.000
mean0.076-0.076=-0.001
σ0.005-0.003=0.002
min0.069-0.074=-0.004
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean21.059-26.065=-5.007
σ0.003-0.003=-0.000
min21.054-26.061=-5.007
max21.064-26.073=-5.008
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.063-0.061=0.002
σ0.002-0.003=-0.000
min0.062-0.059=0.003
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.238=-0.003
σ0.362-0.362=0.001
min1750.668-1750.677=-0.009
max1751.822-1751.825=-0.004
mean1659.300-1634.350=24.950
σ638.400-616.533=21.867
min689.000-628.000=61.000
max2775.000-2471.000=304.000
mean2.790-2.853=-0.063
σ0.162-0.118=0.044
min2.365-2.541=-0.176
max2.994-3.083=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.570-275.566=0.004
σ0.004-0.007=-0.003
min275.566-275.559=0.008
max275.575-275.575=-0.000
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean0.392-0.395=-0.004
σ0.008-0.009=-0.001
min0.382-0.388=-0.007
max0.399-0.406=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2168.104=-0.015
σ0.020-0.003=0.017
min2168.070-2168.099=-0.028
max2168.114-2168.107=0.007
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean2.980-2.959=0.021
σ0.139-0.151=-0.012
min2.752-2.769=-0.018
max3.093-3.153=-0.060
iters=5
new-facts=6402
prior-facts=1
mean5047.892-5047.926=-0.033
σ0.882-0.884=-0.002
min5047.340-5047.390=-0.050
max5049.449-5049.500=-0.051
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean8.843-8.781=0.062
σ0.479-0.573=-0.094
min8.083-8.069=0.014
max9.295-9.389=-0.094
iters=5
new-facts=6402
prior-facts=6402
mean5179.055-5179.037=0.018
σ0.089-0.079=0.010
min5178.968-5178.968=0.000
max5179.150-5179.124=0.026
mean3326.400-3219.400=107.000
σ393.420-389.498=3.922
min2775.000-2684.000=91.000
max3684.000-3707.000=-23.000
mean10.120-9.788=0.332
σ0.331-0.198=0.133
min9.665-9.584=0.081
max10.566-10.061=0.505

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.802=-0.772
σ0.157-0.123=0.034
min0.932-1.652=-0.720
max1.295-1.989=-0.694

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.197=0.006
σ572.651-572.647=0.004
min176.876-176.871=0.005
max1322.179-1322.168=0.011
mean77.500
σ7.000
min74.000
max88.000
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean0.440-0.561=-0.121
σ0.301-0.559=-0.258
min0.287-0.276=0.011
max0.892-1.400=-0.508
policies=20
mean1768.983-1768.972=0.011
σ0.348-0.344=0.004
min1768.767-1768.761=0.006
max1769.501-1769.485=0.017
mean740.000
σ0.000
min740.000
max740.000
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean2.790-2.752=0.037
σ0.079-0.031=0.049
min2.727-2.723=0.004
max2.901-2.796=0.106
policies=200
mean17696.243-17696.159=0.084
σ0.498-0.404=0.095
min17695.970-17695.863=0.107
max17696.990-17696.753=0.236
mean7400.000
σ0.000
min7400.000
max7400.000
mean2775.000-2471.000=304.000
σ0.000
min2775.000-2471.000=304.000
max2775.000-2471.000=304.000
mean27.590-27.668=-0.078
σ0.188-0.186=0.003
min27.402-27.461=-0.058
max27.827-27.862=-0.036