Compare commits

Home / Compare f22c9658 .. 56764c5c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.654=0.001
σ0.369-0.368=0.001
min53.515-53.516=-0.001
max54.705-54.701=0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.137=0.003
σ0.003-0.005=-0.001
min0.136-0.130=0.006
max0.145-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.006-0.006=0.000
min42.973-42.972=0.000
max42.992-42.991=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.119-0.121=-0.002
σ0.004-0.004=0.000
min0.115-0.115=-0.000
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.966-1013.970=-0.004
σ1.189-1.184=0.004
min1013.427-1013.424=0.003
max1018.946-1018.906=0.040
mean1049.400-1050.950=-1.550
σ313.144-315.395=-2.251
min600.000-602.000=-2.000
max1649.000-1654.000=-5.000
mean1.621-1.647=-0.026
σ0.077-0.128=-0.051
min1.503-1.469=0.034
max1.814-1.950=-0.135

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.211-299.247=-0.036
σ0.213-0.207=0.006
min299.022-299.033=-0.011
max299.769-299.722=0.047
mean2046.000-2061.000=-15.000
σ0.000
min2046.000-2061.000=-15.000
max2046.000-2061.000=-15.000
mean0.601-0.574=0.027
σ0.025-0.019=0.006
min0.558-0.546=0.012
max0.625-0.595=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.679-294.679=-0.000
σ0.014-0.013=0.001
min294.659-294.665=-0.005
max294.698-294.698=-0.000
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean0.378-0.387=-0.010
σ0.001-0.006=-0.006
min0.377-0.380=-0.003
max0.378-0.394=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1316.935-1316.941=-0.007
σ0.098-0.102=-0.004
min1316.876-1316.888=-0.012
max1317.109-1317.123=-0.014
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean1.960-1.906=0.054
σ0.116-0.113=0.003
min1.853-1.735=0.118
max2.098-2.023=0.076
iters=5
new-facts=6402
prior-facts=1
mean1555.290-1555.272=0.018
σ6.881-6.863=0.018
min1551.963-1551.973=-0.010
max1567.593-1567.542=0.050
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean2.343-2.277=0.066
σ0.321-0.307=0.014
min2.028-2.036=-0.008
max2.833-2.746=0.087
iters=5
new-facts=6402
prior-facts=6402
mean1884.775-1884.770=0.005
σ0.030-0.025=0.005
min1884.751-1884.742=0.009
max1884.827-1884.809=0.018
mean1781.200-1810.000=-28.800
σ166.842-176.945=-10.103
min1649.000-1654.000=-5.000
max2046.000-2061.000=-15.000
mean3.020-3.075=-0.056
σ0.178-0.126=0.051
min2.896-2.917=-0.021
max3.323-3.244=0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.131-1.193=-0.063
σ0.325-0.367=-0.042
min0.918-0.919=-0.001
max1.704-1.815=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.566-440.571=-0.005
σ573.040-573.035=0.006
min154.044-154.043=0.000
max1300.127-1300.123=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean0.551-0.566=-0.015
σ0.554-0.594=-0.040
min0.271-0.268=0.003
max1.382-1.457=-0.075
policies=20
mean1540.699-1540.687=0.012
σ0.311-0.314=-0.003
min1540.533-1540.498=0.034
max1541.165-1541.157=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean2.598-2.593=0.005
σ0.026-0.031=-0.005
min2.578-2.549=0.029
max2.634-2.624=0.009
policies=200
mean15414.699-15414.848=-0.149
σ0.135-0.073=0.062
min15414.575-15414.755=-0.180
max15414.849-15414.927=-0.078
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1654.000=-5.000
σ0.000
min1649.000-1654.000=-5.000
max1649.000-1654.000=-5.000
mean26.371-26.277=0.094
σ0.178-0.141=0.037
min26.209-26.130=0.079
max26.544-26.418=0.126