Compare commits

Home / Compare 6498da5b .. b7bf7eb3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=0.000
σ0.365-0.367=-0.002
min53.686-53.678=0.008
max54.861-54.866=-0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.138-0.140=-0.002
σ0.003-0.005=-0.002
min0.135-0.136=-0.001
max0.143-0.152=-0.008
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.002
σ0.006-0.006=-0.000
min43.200-43.202=-0.001
max43.217-43.221=-0.004
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.120-0.121=-0.001
σ0.004-0.004=0.000
min0.114-0.117=-0.003
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.173=0.000
σ1.177-1.189=-0.013
min1015.623-1015.602=0.021
max1021.098-1021.160=-0.062
mean1050.500-1046.350=4.150
σ311.932-312.219=-0.286
min559.000-554.000=5.000
max1517.000-1513.000=4.000
mean1.555-1.537=0.018
σ0.058-0.071=-0.013
min1.483-1.371=0.112
max1.677-1.684=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.262-301.406=-0.144
σ0.176-0.260=-0.084
min301.125-301.211=-0.086
max301.736-302.107=-0.371
mean2030.000-2033.000=-3.000
σ0.000
min2030.000-2033.000=-3.000
max2030.000-2033.000=-3.000
mean0.548-0.575=-0.026
σ0.036-0.040=-0.005
min0.504-0.493=0.010
max0.587-0.607=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.699-300.697=0.002
σ0.019-0.030=-0.011
min300.671-300.653=0.017
max300.720-300.731=-0.011
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean0.396-0.401=-0.005
σ0.006-0.009=-0.003
min0.389-0.390=-0.002
max0.403-0.416=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1322.867-1322.863=0.003
σ0.091-0.099=-0.008
min1322.816-1322.798=0.018
max1323.028-1323.036=-0.009
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean1.949-1.932=0.018
σ0.106-0.140=-0.035
min1.819-1.801=0.018
max2.059-2.161=-0.102
iters=5
new-facts=6402
prior-facts=1
mean1561.337-1561.309=0.028
σ6.845-6.858=-0.013
min1558.064-1558.031=0.032
max1573.577-1573.573=0.004
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean2.339-2.293=0.047
σ0.221-0.299=-0.079
min2.052-2.055=-0.004
max2.547-2.718=-0.171
iters=5
new-facts=6402
prior-facts=6402
mean1890.783-1890.789=-0.007
σ0.012-0.020=-0.008
min1890.764-1890.764=0.000
max1890.793-1890.815=-0.022
mean1731.600-1731.400=0.200
σ215.177-213.642=1.536
min1517.000-1513.000=4.000
max2030.000-2033.000=-3.000
mean2.923-2.939=-0.016
σ0.147-0.116=0.030
min2.781-2.870=-0.090
max3.167-3.144=0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.467-1.514=-0.047
σ0.243-0.399=-0.156
min1.186-0.930=0.257
max1.678-1.801=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.037-443.032=0.005
σ573.408-573.407=0.001
min156.330-156.326=0.004
max1303.149-1303.142=0.006
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean0.535-0.532=0.002
σ0.551-0.550=0.001
min0.257-0.253=0.003
max1.361-1.357=0.004
policies=20
mean1563.573-1563.582=-0.010
σ0.319-0.341=-0.022
min1563.376-1563.362=0.014
max1564.049-1564.091=-0.042
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean2.600-2.613=-0.012
σ0.023-0.012=0.011
min2.569-2.603=-0.034
max2.623-2.629=-0.006
policies=200
mean15643.791-15643.906=-0.115
σ0.082-0.125=-0.043
min15643.741-15643.765=-0.025
max15643.913-15644.028=-0.115
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1513.000=4.000
σ0.000
min1517.000-1513.000=4.000
max1517.000-1513.000=4.000
mean26.413-26.479=-0.066
σ0.156-0.181=-0.025
min26.262-26.292=-0.030
max26.558-26.648=-0.090