Compare commits

Home / Compare 3ca6e876 .. 90332a6e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.654=0.001
σ0.368-0.367=0.001
min53.512-53.512=0.001
max54.702-54.699=0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.138-0.138=-0.001
σ0.005-0.005=0.000
min0.130-0.132=-0.001
max0.146-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.000
σ0.005-0.006=-0.001
min42.973-42.973=-0.001
max42.989-42.991=-0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.121-0.121=-0.000
σ0.004-0.003=0.000
min0.118-0.118=-0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.969-1013.968=0.001
σ1.191-1.201=-0.010
min1013.435-1013.429=0.005
max1018.953-1019.002=-0.049
mean1048.600-1052.450=-3.850
σ315.133-315.504=-0.371
min598.000-604.000=-6.000
max1649.000-1656.000=-7.000
mean1.655-1.641=0.014
σ0.106-0.081=0.025
min1.494-1.564=-0.070
max1.914-1.872=0.042

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.132-298.981=0.151
σ0.173-0.211=-0.039
min299.014-298.827=0.187
max299.603-299.549=0.054
mean2037.000-2043.000=-6.000
σ0.000
min2037.000-2043.000=-6.000
max2037.000-2043.000=-6.000
mean0.579-0.575=0.004
σ0.027-0.017=0.010
min0.521-0.553=-0.032
max0.611-0.596=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.686-294.675=0.010
σ0.018-0.027=-0.009
min294.667-294.648=0.019
max294.708-294.713=-0.005
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean0.392-0.387=0.005
σ0.014-0.008=0.007
min0.381-0.382=-0.001
max0.411-0.401=0.010
iters=5
new-facts=1
prior-facts=6402
mean1316.927-1316.933=-0.006
σ0.092-0.089=0.002
min1316.869-1316.884=-0.015
max1317.089-1317.091=-0.002
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean1.967-1.971=-0.004
σ0.099-0.070=0.029
min1.858-1.895=-0.037
max2.082-2.059=0.023
iters=5
new-facts=6402
prior-facts=1
mean1555.355-1555.349=0.006
σ6.823-6.817=0.006
min1552.123-1552.122=0.001
max1567.556-1567.540=0.017
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean2.442-2.404=0.038
σ0.150-0.191=-0.041
min2.262-2.216=0.046
max2.608-2.658=-0.050
iters=5
new-facts=6402
prior-facts=6402
mean1884.778-1884.783=-0.005
σ0.035-0.038=-0.003
min1884.753-1884.753=-0.001
max1884.839-1884.850=-0.011
mean1778.400-1783.800=-5.400
σ162.855-162.717=0.139
min1649.000-1656.000=-7.000
max2037.000-2043.000=-6.000
mean2.926-3.000=-0.074
σ0.064-0.148=-0.084
min2.877-2.875=0.003
max3.037-3.230=-0.192

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.153-1.075=0.077
σ0.322-0.180=0.142
min0.920-0.924=-0.005
max1.682-1.303=0.379

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.679-440.676=0.003
σ573.410-573.398=0.012
min153.969-153.964=0.005
max1300.794-1300.774=0.021
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean0.543-0.547=-0.003
σ0.559-0.569=-0.010
min0.256-0.260=-0.004
max1.382-1.400=-0.018
policies=20
mean1539.893-1539.903=-0.010
σ0.308-0.313=-0.005
min1539.713-1539.723=-0.010
max1540.354-1540.371=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean2.592-2.603=-0.012
σ0.015-0.020=-0.005
min2.582-2.575=0.007
max2.613-2.619=-0.005
policies=200
mean15406.992-15406.977=0.015
σ0.067-0.036=0.031
min15406.895-15406.953=-0.058
max15407.044-15407.030=0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1656.000=-7.000
σ0.000
min1649.000-1656.000=-7.000
max1649.000-1656.000=-7.000
mean26.194-26.349=-0.155
σ0.134-0.180=-0.046
min26.038-26.142=-0.103
max26.334-26.502=-0.168