Compare commits

Home / Compare 96d0b5b5 .. 37f26b55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.646=0.002
σ0.367-0.367=-0.000
min53.522-53.506=0.016
max54.693-54.691=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.138-0.137=0.000
σ0.004-0.007=-0.003
min0.133-0.129=0.005
max0.144-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean42.942-42.944=-0.002
σ0.006-0.005=0.001
min42.933-42.939=-0.006
max42.951-42.952=-0.001
mean414.700-414.000=0.700
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.122-0.125=-0.003
σ0.003-0.008=-0.005
min0.120-0.118=0.002
max0.129-0.139=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.863-991.864=-0.000
σ1.211-1.224=-0.013
min991.269-991.267=0.002
max996.916-996.980=-0.064
mean1065.100-1043.600=21.500
σ324.062-302.275=21.787
min578.000-579.000=-1.000
max1644.000-1448.000=196.000
mean1.543-1.553=-0.010
σ0.155-0.112=0.044
min1.451-1.413=0.038
max2.153-1.784=0.369

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.441-285.440=0.001
σ0.012-0.011=0.001
min285.421-285.422=-0.001
max285.454-285.451=0.003
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean0.380-0.389=-0.008
σ0.005-0.013=-0.008
min0.377-0.375=0.003
max0.389-0.407=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1285.519-1285.520=-0.001
σ0.082-0.059=0.023
min1285.381-1285.416=-0.035
max1285.591-1285.560=0.031
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean2.003-1.944=0.058
σ0.263-0.167=0.097
min1.866-1.801=0.065
max2.473-2.155=0.318
iters=5
new-facts=6402
prior-facts=1
mean1705.825-1705.834=-0.010
σ6.856-6.871=-0.015
min1702.637-1702.652=-0.015
max1718.086-1718.123=-0.037
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean2.938-2.908=0.030
σ0.198-0.229=-0.030
min2.722-2.727=-0.004
max3.263-3.276=-0.013
iters=5
new-facts=6402
prior-facts=6402
mean1968.431-1968.431=0.000
σ0.003-0.038=-0.035
min1968.427-1968.376=0.051
max1968.435-1968.477=-0.042
mean1764.400-1780.200=-15.800
σ131.268-196.122=-64.854
min1644.000-1537.000=107.000
max1946.000-2037.000=-91.000
mean3.100-3.320=-0.220
σ0.139-0.340=-0.201
min2.966-3.093=-0.127
max3.329-3.920=-0.591

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-1.614=-0.335
σ0.386-0.144=0.242
min0.910-1.435=-0.525
max1.869-1.815=0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.697-436.686=0.011
σ572.360-572.352=0.008
min150.509-150.504=0.005
max1295.236-1295.214=0.023
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean0.524-0.520=0.004
σ0.537-0.534=0.003
min0.251-0.248=0.003
max1.330-1.322=0.008
policies=20
mean1505.360-1505.362=-0.003
σ0.243-0.256=-0.013
min1505.199-1505.189=0.010
max1505.722-1505.743=-0.021
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean2.524-2.548=-0.024
σ0.016-0.055=-0.039
min2.507-2.508=-0.001
max2.538-2.629=-0.091
policies=200
mean15061.159-15061.261=-0.103
σ0.109-0.046=0.063
min15061.043-15061.203=-0.160
max15061.293-15061.309=-0.016
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1448.000=196.000
σ0.000
min1644.000-1448.000=196.000
max1644.000-1448.000=196.000
mean25.506-25.477=0.029
σ0.215-0.149=0.066
min25.298-25.345=-0.046
max25.784-25.636=0.148