Compare commits

Home / Compare 5d29ce0f .. 4f9c5be5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.974=-0.000
σ0.108-0.107=0.001
min35.929-35.927=0.002
max36.281-36.278=0.003
mean415.600-414.000=1.600
σ0.516-0.000=0.516
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.075-0.077=-0.003
σ0.003-0.006=-0.002
min0.071-0.072=-0.000
max0.081-0.086=-0.006
cache=y
dps=1
iters=10
policies=100
mean26.209-26.210=-0.001
σ0.003-0.004=-0.001
min26.205-26.205=0.000
max26.214-26.217=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.062=-0.000
σ0.004-0.003=0.001
min0.057-0.058=-0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.366-1758.364=0.002
σ0.370-0.373=-0.003
min1757.789-1757.787=0.002
max1758.961-1758.965=-0.004
mean1657.050-1658.200=-1.150
σ620.311-623.947=-3.636
min688.000-687.000=1.000
max2746.000-2767.000=-21.000
mean2.370-2.373=-0.003
σ0.073-0.102=-0.029
min2.288-2.251=0.037
max2.547-2.576=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.513-279.509=0.003
σ0.007-0.006=0.001
min279.504-279.501=0.003
max279.519-279.514=0.004
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean0.408-0.404=0.004
σ0.006-0.004=0.002
min0.404-0.401=0.003
max0.418-0.410=0.008
iters=5
new-facts=1
prior-facts=6402
mean2178.395-2178.429=-0.035
σ0.079-0.015=0.064
min2178.254-2178.410=-0.155
max2178.447-2178.447=0.000
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean3.476-3.366=0.110
σ0.322-0.115=0.207
min3.253-3.231=0.022
max4.040-3.523=0.517
iters=5
new-facts=6402
prior-facts=1
mean5056.371-5056.236=0.135
σ0.982-1.079=-0.097
min5055.840-5055.247=0.592
max5058.119-5058.080=0.039
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean9.020-9.006=0.013
σ0.556-0.468=0.088
min8.230-8.286=-0.056
max9.586-9.516=0.071
iters=5
new-facts=6402
prior-facts=6402
mean5193.534-5193.745=-0.211
σ0.133-0.094=0.039
min5193.346-5193.666=-0.320
max5193.694-5193.860=-0.166
mean3273.800-3272.000=1.800
σ383.682-474.864=-91.182
min2746.000-2767.000=-21.000
max3630.000-3951.000=-321.000
mean8.960-8.854=0.106
σ0.218-0.057=0.161
min8.736-8.780=-0.043
max9.314-8.930=0.383

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-0.973=0.021
σ0.066-0.054=0.012
min0.936-0.941=-0.006
max1.070-1.066=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.480-465.486=-0.006
σ572.663-572.662=0.001
min179.140-179.143=-0.003
max1324.475-1324.479=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean0.491-0.477=0.015
σ0.421-0.292=0.129
min0.278-0.279=-0.001
max1.122-0.898=0.224
policies=20
mean1791.701-1791.690=0.011
σ0.334-0.316=0.018
min1791.509-1791.473=0.035
max1792.200-1792.157=0.043
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean2.796-2.777=0.020
σ0.011-0.009=0.002
min2.784-2.766=0.018
max2.811-2.788=0.023
policies=200
mean17923.363-17923.411=-0.048
σ0.522-0.417=0.105
min17922.994-17923.126=-0.132
max17924.125-17924.030=0.095
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2767.000=-21.000
σ0.000
min2746.000-2767.000=-21.000
max2746.000-2767.000=-21.000
mean28.129-28.170=-0.041
σ0.092-0.151=-0.060
min28.033-28.024=0.009
max28.232-28.371=-0.138