Compare commits

Home / Compare 2205d61e .. 11a71fea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-53.970=0.080
σ0.370-0.368=0.003
min53.910-53.825=0.085
max55.103-55.016=0.087
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.140-0.135=0.005
σ0.004-0.005=-0.001
min0.136-0.129=0.007
max0.147-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=0.000
σ0.006-0.006=0.000
min43.333-43.328=0.005
max43.356-43.351=0.005
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.119-0.119=-0.000
σ0.004-0.003=0.000
min0.114-0.114=0.000
max0.128-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.203-1016.895=0.308
σ1.155-1.169=-0.014
min1016.626-1016.321=0.304
max1022.030-1021.788=0.242
mean1055.800-1064.300=-8.500
σ310.265-318.422=-8.157
min565.000-604.000=-39.000
max1517.000-1636.000=-119.000
mean1.524-1.544=-0.020
σ0.054-0.059=-0.006
min1.458-1.460=-0.002
max1.629-1.666=-0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.972-301.861=0.112
σ0.225-0.267=-0.042
min301.804-301.671=0.133
max302.574-302.607=-0.033
mean2061.000-2038.000=23.000
σ0.000
min2061.000-2038.000=23.000
max2061.000-2038.000=23.000
mean0.600-0.596=0.004
σ0.007-0.020=-0.012
min0.582-0.547=0.036
max0.609-0.609=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.780-303.521=0.259
σ0.068-0.043=0.025
min303.671-303.460=0.211
max303.840-303.571=0.269
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.391-0.390=0.001
σ0.001-0.001=0.000
min0.390-0.389=0.001
max0.392-0.391=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.332-1326.053=0.279
σ0.110-0.102=0.008
min1326.194-1325.922=0.272
max1326.470-1326.179=0.290
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean1.948-1.881=0.067
σ0.094-0.062=0.032
min1.844-1.815=0.029
max2.055-1.957=0.098
iters=5
new-facts=6402
prior-facts=1
mean1564.421-1564.128=0.293
σ6.852-6.911=-0.059
min1561.165-1560.840=0.324
max1576.674-1576.486=0.187
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.352-2.359=-0.007
σ0.204-0.329=-0.125
min2.058-2.050=0.008
max2.526-2.745=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean1894.282-1894.002=0.280
σ0.067-0.064=0.003
min1894.163-1893.893=0.271
max1894.322-1894.050=0.272
mean1774.200
σ221.959-170.245=51.714
min1517.000-1636.000=-119.000
max2061.000-2038.000=23.000
mean2.990-2.924=0.066
σ0.130-0.115=0.015
min2.825-2.857=-0.031
max3.143-3.128=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.641-1.183=0.457
σ0.271-0.313=-0.042
min1.260-0.911=0.349
max1.876-1.545=0.332

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.165-444.705=3.459
σ581.462-575.150=6.312
min157.428-157.125=0.303
max1320.358-1307.430=12.927
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.547-0.524=0.023
σ0.568-0.533=0.035
min0.258-0.245=0.013
max1.400-1.324=0.075
policies=20
mean1574.602-1571.544=3.059
σ0.349-0.317=0.031
min1574.381-1571.363=3.018
max1575.123-1572.019=3.104
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.618-2.612=0.006
σ0.008-0.009=-0.002
min2.610-2.600=0.010
max2.626-2.623=0.004
policies=200
mean15754.279-15723.357=30.922
σ0.061-0.070=-0.009
min15754.219-15723.278=30.942
max15754.364-15723.446=30.918
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean26.608-26.581=0.027
σ0.235-0.218=0.017
min26.306-26.304=0.002
max26.851-26.817=0.034