Compare commits

Home / Compare 79f0ccf9 .. cf5deb6c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.825-53.822=0.002
σ0.369-0.369=0.000
min53.681-53.679=0.002
max54.874-54.872=0.002
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.140-0.138=0.002
σ0.004-0.004=0.000
min0.136-0.131=0.005
max0.148-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.006-0.008=-0.002
min43.202-43.193=0.009
max43.223-43.221=0.003
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.119-0.120=-0.000
σ0.004-0.003=0.002
min0.114-0.115=-0.001
max0.128-0.124=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.179-1016.173=0.005
σ1.150-1.220=-0.069
min1015.621-1015.635=-0.014
max1020.987-1021.290=-0.303
mean1045.750-1054.550=-8.800
σ311.342-313.144=-1.802
min591.000-590.000=1.000
max1638.000-1670.000=-32.000
mean1.541-1.573=-0.032
σ0.106-0.141=-0.035
min1.391-1.477=-0.086
max1.822-2.065=-0.243

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.314-301.288=0.026
σ0.244-0.216=0.028
min301.158-301.088=0.071
max301.992-301.845=0.147
mean2021.000-1940.000=81.000
σ0.000
min2021.000-1940.000=81.000
max2021.000-1940.000=81.000
mean0.548-0.562=-0.014
σ0.034-0.027=0.007
min0.504-0.508=-0.004
max0.589-0.581=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.686-300.702=-0.016
σ0.038-0.028=0.011
min300.621-300.671=-0.050
max300.719-300.739=-0.020
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean0.401-0.396=0.005
σ0.007-0.005=0.002
min0.392-0.390=0.002
max0.408-0.401=0.006
iters=5
new-facts=1
prior-facts=6402
mean1322.870-1322.857=0.013
σ0.098-0.099=-0.001
min1322.816-1322.806=0.010
max1323.044-1323.034=0.010
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean1.929-1.938=-0.008
σ0.107-0.087=0.020
min1.824-1.834=-0.010
max2.076-2.065=0.012
iters=5
new-facts=6402
prior-facts=1
mean1561.329-1561.304=0.025
σ6.854-6.884=-0.030
min1558.033-1557.951=0.082
max1573.584-1573.612=-0.027
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean2.334-2.344=-0.010
σ0.163-0.275=-0.112
min2.095-2.125=-0.030
max2.516-2.684=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean1890.786-1890.797=-0.011
σ0.014-0.019=-0.005
min1890.777-1890.786=-0.009
max1890.810-1890.831=-0.021
mean1776.400-1782.400=-6.000
σ165.425-101.874=63.551
min1638.000-1670.000=-32.000
max2021.000-1940.000=81.000
mean3.010-3.028=-0.018
σ0.191-0.092=0.099
min2.850-2.916=-0.066
max3.284-3.108=0.176

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.058=0.129
σ0.293-0.230=0.063
min0.928-0.893=0.034
max1.674-1.415=0.258

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.322-443.326=-0.004
σ573.970-573.960=0.010
min156.336-156.338=-0.002
max1304.277-1304.266=0.011
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean0.545-0.536=0.009
σ0.565-0.548=0.017
min0.260-0.260=0.000
max1.392-1.357=0.035
policies=20
mean1563.624-1563.635=-0.010
σ0.329-0.323=0.005
min1563.449-1563.457=-0.007
max1564.117-1564.119=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean2.620-2.616=0.004
σ0.010-0.015=-0.005
min2.614-2.598=0.016
max2.635-2.633=0.002
policies=200
mean15644.103-15644.111=-0.009
σ0.156-0.041=0.115
min15643.934-15644.051=-0.117
max15644.270-15644.139=0.132
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1670.000=-32.000
σ0.000
min1638.000-1670.000=-32.000
max1638.000-1670.000=-32.000
mean26.574-26.455=0.119
σ0.164-0.085=0.079
min26.434-26.360=0.074
max26.769-26.528=0.241