Compare commits

Home / Compare dbca404e .. 40c03a35

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.837=-0.001
σ0.368-0.367=0.001
min53.695-53.688=0.007
max54.883-54.881=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.140=-0.000
σ0.004-0.008=-0.004
min0.137-0.130=0.007
max0.147-0.159=-0.012
cache=y
dps=1
iters=10
policies=100
mean43.212-43.211=0.001
σ0.007-0.008=-0.001
min43.203-43.200=0.004
max43.229-43.229=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.137-0.129=0.007
σ0.005-0.008=-0.003
min0.130-0.118=0.012
max0.145-0.138=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.206-1016.205=0.001
σ1.168-1.186=-0.018
min1015.635-1015.630=0.005
max1021.086-1021.173=-0.087
mean1058.450-1046.250=12.200
σ316.270-311.460=4.809
min550.000-554.000=-4.000
max1542.000-1511.000=31.000
mean1.510-1.525=-0.015
σ0.098-0.060=0.038
min1.413-1.445=-0.031
max1.829-1.652=0.177

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.273-301.363=-0.091
σ0.217-0.218=-0.001
min301.119-301.231=-0.112
max301.869-301.958=-0.089
mean1975.000-2013.000=-38.000
σ0.000
min1975.000-2013.000=-38.000
max1975.000-2013.000=-38.000
mean0.541-0.537=0.004
σ0.029-0.031=-0.002
min0.500-0.506=-0.006
max0.576-0.581=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.477-301.475=0.003
σ0.053-0.063=-0.010
min301.391-301.374=0.017
max301.528-301.534=-0.005
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean0.396-0.395=0.001
σ0.005-0.006=-0.001
min0.392-0.391=0.000
max0.403-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1324.050-1324.060=-0.010
σ0.103-0.110=-0.007
min1323.930-1323.924=0.007
max1324.193-1324.198=-0.005
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean1.873-1.881=-0.009
σ0.121-0.058=0.063
min1.748-1.820=-0.072
max2.057-1.965=0.092
iters=5
new-facts=6402
prior-facts=1
mean1562.082-1562.077=0.005
σ6.939-6.911=0.028
min1558.759-1558.798=-0.040
max1574.488-1574.436=0.053
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean2.321-2.300=0.021
σ0.307-0.290=0.017
min2.090-2.027=0.062
max2.842-2.639=0.203
iters=5
new-facts=6402
prior-facts=6402
mean1891.951-1891.978=-0.027
σ0.084-0.067=0.017
min1891.825-1891.859=-0.034
max1892.013-1892.016=-0.003
mean1711.800-1731.200=-19.400
σ180.457-209.771=-29.314
min1542.000-1511.000=31.000
max1975.000-2013.000=-38.000
mean2.854-2.903=-0.049
σ0.086-0.033=0.053
min2.711-2.876=-0.165
max2.944-2.957=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.335-1.561=-0.226
σ0.203-0.254=-0.051
min1.112-1.234=-0.122
max1.636-1.748=-0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.492-443.480=0.012
σ574.243-574.238=0.005
min156.361-156.360=0.001
max1304.857-1304.837=0.020
mean96.250
σ8.500
min92.000
max109.000
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean0.526-0.545=-0.020
σ0.538-0.569=-0.030
min0.256-0.252=0.004
max1.334-1.398=-0.065
policies=20
mean1563.907-1563.887=0.020
σ0.318-0.344=-0.026
min1563.721-1563.664=0.057
max1564.384-1564.400=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean2.601-2.620=-0.019
σ0.029-0.009=0.019
min2.568-2.608=-0.039
max2.630-2.629=0.002
policies=200
mean15647.009-15647.016=-0.007
σ0.099-0.097=0.002
min15646.919-15646.889=0.030
max15647.149-15647.125=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1542.000-1511.000=31.000
σ0.000
min1542.000-1511.000=31.000
max1542.000-1511.000=31.000
mean26.337-26.562=-0.224
σ0.113-0.122=-0.009
min26.189-26.423=-0.233
max26.453-26.692=-0.239