Compare commits

Home / Compare fec93ee5 .. 71f7f5cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.999-53.998=0.001
σ0.369-0.370=-0.001
min53.861-53.854=0.007
max55.048-55.051=-0.004
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.139-0.139=0.000
σ0.003-0.004=-0.001
min0.136-0.133=0.003
max0.145-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.344=-0.002
σ0.007-0.007=0.000
min43.327-43.331=-0.005
max43.352-43.352=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.120-0.128=-0.008
σ0.003-0.009=-0.006
min0.118-0.119=-0.001
max0.128-0.140=-0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.407-1017.410=-0.003
σ1.169-1.152=0.017
min1016.832-1016.833=-0.001
max1022.306-1022.227=0.079
mean1058.250-1053.400=4.850
σ311.380-320.453=-9.072
min599.000-578.000=21.000
max1626.000-1628.000=-2.000
mean1.521-1.543=-0.022
σ0.072-0.074=-0.002
min1.450-1.471=-0.021
max1.716-1.738=-0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.966-302.257=-0.291
σ0.272-0.215=0.057
min301.761-302.133=-0.372
max302.695-302.853=-0.158
mean1950.000-2020.000=-70.000
σ0.000
min1950.000-2020.000=-70.000
max1950.000-2020.000=-70.000
mean0.594-0.583=0.010
σ0.021-0.026=-0.005
min0.540-0.540=0.001
max0.608-0.610=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean304.099-304.115=-0.016
σ0.089-0.072=0.017
min303.951-303.997=-0.046
max304.180-304.176=0.004
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean0.396-0.401=-0.005
σ0.008-0.009=-0.001
min0.390-0.391=-0.001
max0.410-0.408=0.002
iters=5
new-facts=1
prior-facts=6402
mean1326.690-1326.662=0.028
σ0.118-0.105=0.013
min1326.563-1326.528=0.036
max1326.814-1326.785=0.029
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean1.911-1.887=0.024
σ0.064-0.065=-0.002
min1.823-1.815=0.008
max2.000-1.958=0.042
iters=5
new-facts=6402
prior-facts=1
mean1564.724-1564.722=0.002
σ6.923-6.925=-0.003
min1561.370-1561.437=-0.067
max1577.101-1577.106=-0.005
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean2.320-2.321=-0.001
σ0.265-0.341=-0.076
min2.094-1.998=0.096
max2.653-2.710=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean1894.618-1894.608=0.011
σ0.075-0.066=0.009
min1894.486-1894.491=-0.006
max1894.669-1894.649=0.019
mean1758.000-1772.400=-14.400
σ136.294-169.200=-32.907
min1626.000-1628.000=-2.000
max1950.000-2020.000=-70.000
mean2.946-2.899=0.047
σ0.080-0.037=0.043
min2.847-2.868=-0.021
max3.037-2.957=0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.283=-0.071
σ0.304-0.360=-0.056
min0.932-0.944=-0.012
max1.647-1.879=-0.232

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.750-448.753=-0.003
σ581.920-581.926=-0.005
min157.781-157.783=-0.003
max1321.631-1321.642=-0.011
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean0.541-0.550=-0.009
σ0.551-0.574=-0.023
min0.263-0.261=0.003
max1.368-1.411=-0.044
policies=20
mean1578.105-1578.091=0.014
σ0.336-0.335=0.001
min1577.913-1577.882=0.031
max1578.608-1578.592=0.016
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean2.633-2.625=0.008
σ0.018-0.020=-0.002
min2.614-2.599=0.016
max2.657-2.641=0.016
policies=200
mean15788.738-15788.716=0.022
σ0.052-0.052=0.000
min15788.677-15788.646=0.031
max15788.795-15788.761=0.034
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1628.000=-2.000
σ0.000
min1626.000-1628.000=-2.000
max1626.000-1628.000=-2.000
mean26.731-26.540=0.191
σ0.083-0.160=-0.077
min26.639-26.352=0.287
max26.808-26.684=0.124