Compare commits

Home / Compare ed2db5ba .. e880b81c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-54.050=-0.001
σ0.369-0.370=-0.001
min53.899-53.906=-0.008
max55.098-55.103=-0.006
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.139=-0.001
σ0.004-0.004=-0.000
min0.131-0.135=-0.004
max0.144-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.343-43.342=0.000
σ0.006-0.005=0.001
min43.334-43.334=-0.001
max43.353-43.353=-0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.121=0.002
σ0.004-0.003=0.000
min0.119-0.118=0.001
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.196-1017.198=-0.002
σ1.182-1.168=0.014
min1016.626-1016.637=-0.011
max1022.154-1022.093=0.061
mean1055.200-1058.500=-3.300
σ303.517-313.982=-10.464
min596.000-589.000=7.000
max1643.000-1576.000=67.000
mean1.556-1.556=-0.000
σ0.088-0.088=-0.000
min1.462-1.485=-0.023
max1.795-1.823=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.984-302.303=-0.319
σ0.200-0.271=-0.072
min301.842-302.082=-0.240
max302.509-303.026=-0.516
mean2022.000-2052.000=-30.000
σ0.000
min2022.000-2052.000=-30.000
max2022.000-2052.000=-30.000
mean0.542-0.603=-0.061
σ0.039-0.007=0.031
min0.496-0.589=-0.092
max0.603-0.613=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.791-303.791=-0.001
σ0.051-0.049=0.003
min303.715-303.720=-0.005
max303.845-303.842=0.003
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean0.393-0.395=-0.002
σ0.007-0.007=0.000
min0.390-0.390=-0.000
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.336-1326.340=-0.004
σ0.112-0.116=-0.004
min1326.196-1326.196=-0.000
max1326.471-1326.479=-0.008
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean1.947-1.886=0.061
σ0.108-0.049=0.059
min1.825-1.823=0.002
max2.040-1.948=0.092
iters=5
new-facts=6402
prior-facts=1
mean1564.423-1564.361=0.062
σ6.887-6.898=-0.011
min1561.165-1561.074=0.091
max1576.739-1576.696=0.043
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean2.380-2.256=0.124
σ0.259-0.241=0.018
min2.076-2.006=0.070
max2.681-2.593=0.088
iters=5
new-facts=6402
prior-facts=6402
mean1894.283-1894.278=0.006
σ0.071-0.068=0.003
min1894.158-1894.160=-0.001
max1894.329-1894.325=0.004
mean1790.000-1753.600=36.400
σ166.220-199.732=-33.512
min1643.000-1576.000=67.000
max2022.000-2052.000=-30.000
mean3.057-2.930=0.127
σ0.137-0.159=-0.021
min2.847-2.697=0.150
max3.204-3.116=0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.296-1.344=-0.048
σ0.300-0.385=-0.085
min1.069-0.944=0.125
max1.685-1.808=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.340-448.338=0.002
σ581.801-581.803=-0.002
min157.436-157.433=0.003
max1321.041-1321.043=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean0.565-0.538=0.027
σ0.600-0.550=0.050
min0.261-0.255=0.006
max1.465-1.362=0.102
policies=20
mean1574.600-1574.606=-0.006
σ0.337-0.350=-0.013
min1574.385-1574.400=-0.014
max1575.103-1575.130=-0.027
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean2.626-2.650=-0.024
σ0.010-0.057=-0.047
min2.611-2.614=-0.003
max2.632-2.735=-0.102
policies=200
mean15754.223-15754.218=0.005
σ0.133-0.093=0.041
min15754.072-15754.121=-0.049
max15754.361-15754.304=0.057
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1576.000=67.000
σ0.000
min1643.000-1576.000=67.000
max1643.000-1576.000=67.000
mean26.562-26.661=-0.099
σ0.149-0.205=-0.056
min26.419-26.461=-0.042
max26.723-26.915=-0.192