Compare commits

Home / Compare 98beed5a .. 0a1223ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.822=-0.001
σ0.368-0.369=-0.001
min53.684-53.678=0.006
max54.868-54.870=-0.002
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.136-0.136=0.000
σ0.005-0.005=0.000
min0.130-0.130=-0.001
max0.144-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.207-43.209=-0.002
σ0.006-0.006=0.000
min43.198-43.201=-0.003
max43.220-43.221=-0.002
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.117-0.121=-0.004
σ0.003-0.004=-0.001
min0.114-0.114=0.001
max0.122-0.128=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.179=-0.003
σ1.145-1.168=-0.023
min1015.604-1015.612=-0.008
max1020.963-1021.067=-0.104
mean1049.650-1045.650=4.000
σ296.715-294.591=2.124
min591.000-575.000=16.000
max1467.000-1441.000=26.000
mean1.560-1.581=-0.021
σ0.065-0.065=-0.000
min1.415-1.495=-0.079
max1.653-1.758=-0.106

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.279-301.501=-0.222
σ0.277-0.210=0.067
min301.046-301.347=-0.301
max302.031-302.086=-0.055
mean1957.000-2039.000=-82.000
σ0.000
min1957.000-2039.000=-82.000
max1957.000-2039.000=-82.000
mean0.547-0.533=0.014
σ0.032-0.035=-0.003
min0.500-0.496=0.004
max0.575-0.579=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.686-300.698=-0.012
σ0.042-0.023=0.019
min300.615-300.670=-0.055
max300.723-300.732=-0.009
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean0.405-0.396=0.009
σ0.012-0.007=0.004
min0.389-0.388=0.002
max0.421-0.403=0.018
iters=5
new-facts=1
prior-facts=6402
mean1322.878-1322.868=0.010
σ0.102-0.099=0.003
min1322.818-1322.798=0.020
max1323.058-1323.039=0.019
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean1.926-1.901=0.025
σ0.066-0.105=-0.039
min1.837-1.817=0.020
max2.013-2.085=-0.071
iters=5
new-facts=6402
prior-facts=1
mean1561.313-1561.304=0.009
σ6.898-6.881=0.017
min1557.967-1558.018=-0.051
max1573.646-1573.609=0.037
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean2.331-2.325=0.007
σ0.278-0.319=-0.041
min2.070-2.043=0.027
max2.661-2.719=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean1890.808-1890.796=0.011
σ0.030-0.023=0.007
min1890.785-1890.777=0.007
max1890.857-1890.832=0.025
mean1767.400-1725.400=42.000
σ154.780-238.902=-84.122
min1533.000-1441.000=92.000
max1957.000-2039.000=-82.000
mean2.995-2.867=0.128
σ0.157-0.031=0.126
min2.870-2.823=0.047
max3.251-2.898=0.353

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.706-1.749=-0.043
σ0.074-0.065=0.008
min1.583-1.654=-0.071
max1.779-1.831=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.031-443.031=-0.000
σ573.395-573.392=0.003
min156.327-156.329=-0.002
max1303.123-1303.119=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean0.560-0.544=0.016
σ0.589-0.563=0.025
min0.265-0.257=0.007
max1.443-1.389=0.054
policies=20
mean1563.604-1563.619=-0.015
σ0.343-0.344=-0.000
min1563.385-1563.395=-0.010
max1564.116-1564.131=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean2.627-2.628=-0.001
σ0.009-0.015=-0.007
min2.616-2.614=0.002
max2.637-2.642=-0.006
policies=200
mean15644.080-15644.160=-0.080
σ0.115-0.034=0.081
min15643.922-15644.128=-0.206
max15644.199-15644.205=-0.006
mean9200.000
σ0.000
min9200.000
max9200.000
mean1467.000-1441.000=26.000
σ0.000
min1467.000-1441.000=26.000
max1467.000-1441.000=26.000
mean26.456-26.551=-0.095
σ0.150-0.170=-0.020
min26.342-26.370=-0.029
max26.674-26.759=-0.085