Compare commits

Home / Compare 2f5d750f .. ef1613c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.039-54.039=0.000
σ0.369-0.369=-0.000
min53.895-53.900=-0.005
max55.089-55.090=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.138-0.139=-0.001
σ0.004-0.005=-0.001
min0.131-0.131=-0.000
max0.144-0.149=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.343-43.341=0.002
σ0.006-0.007=-0.000
min43.332-43.333=-0.001
max43.355-43.353=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.122-0.122=-0.001
σ0.004-0.003=0.001
min0.119-0.120=-0.001
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.198-1017.203=-0.004
σ1.234-1.164=0.070
min1016.659-1016.631=0.028
max1022.377-1022.079=0.297
mean1049.750-1058.900=-9.150
σ308.810-312.839=-4.029
min566.000-578.000=-12.000
max1512.000-1629.000=-117.000
mean1.562-1.531=0.032
σ0.139-0.048=0.091
min1.466-1.481=-0.015
max2.081-1.633=0.447

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.918-302.094=-0.177
σ0.310-0.235=0.075
min301.641-301.890=-0.249
max302.731-302.694=0.037
mean2026.000-2049.000=-23.000
σ0.000
min2026.000-2049.000=-23.000
max2026.000-2049.000=-23.000
mean0.602-0.602=-0.001
σ0.010-0.005=0.005
min0.590-0.594=-0.004
max0.625-0.609=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.789-303.790=-0.001
σ0.049-0.050=-0.001
min303.719-303.721=-0.001
max303.840-303.845=-0.005
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean0.391-0.392=-0.001
σ0.001-0.002=-0.001
min0.391-0.390=0.001
max0.392-0.395=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1326.340-1326.330=0.010
σ0.111-0.102=0.009
min1326.200-1326.197=0.003
max1326.461-1326.450=0.011
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean1.958-1.954=0.004
σ0.102-0.119=-0.016
min1.847-1.831=0.016
max2.052-2.087=-0.035
iters=5
new-facts=6402
prior-facts=1
mean1564.414-1564.392=0.022
σ6.878-6.909=-0.031
min1561.164-1561.110=0.054
max1576.714-1576.748=-0.033
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean2.346-2.327=0.019
σ0.275-0.306=-0.031
min2.035-2.048=-0.013
max2.687-2.664=0.023
iters=5
new-facts=6402
prior-facts=6402
mean1894.290-1894.273=0.017
σ0.078-0.065=0.013
min1894.152-1894.160=-0.007
max1894.341-1894.321=0.021
mean1754.200-1773.400=-19.200
σ210.687-175.768=34.920
min1512.000-1629.000=-117.000
max2026.000-2049.000=-23.000
mean3.005-2.995=0.010
σ0.134-0.188=-0.054
min2.873-2.847=0.026
max3.192-3.302=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.547-1.267=0.279
σ0.296-0.327=-0.031
min1.219-0.954=0.266
max1.845-1.809=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.049-448.061=-0.013
σ581.229-581.236=-0.007
min157.430-157.436=-0.006
max1319.893-1319.916=-0.023
mean96.250
σ8.500
min92.000
max109.000
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean0.535-0.549=-0.013
σ0.533-0.562=-0.029
min0.266-0.265=0.001
max1.335-1.391=-0.056
policies=20
mean1574.588-1574.624=-0.036
σ0.348-0.345=0.003
min1574.352-1574.410=-0.058
max1575.105-1575.139=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean2.625-2.632=-0.007
σ0.019-0.008=0.011
min2.608-2.625=-0.017
max2.653-2.640=0.013
policies=200
mean15754.221-15754.210=0.011
σ0.168-0.132=0.036
min15754.074-15754.108=-0.034
max15754.391-15754.404=-0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000-1629.000=-117.000
σ0.000
min1512.000-1629.000=-117.000
max1512.000-1629.000=-117.000
mean26.772-26.739=0.032
σ0.293-0.109=0.183
min26.478-26.627=-0.149
max27.167-26.840=0.327