Compare commits

Home / Compare a5966b24 .. 75421ebc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.958=-0.001
σ0.049-0.049=0.000
min30.919-30.913=0.006
max31.093-31.092=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.076-0.079=-0.003
σ0.004-0.003=0.001
min0.071-0.076=-0.005
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=0.000
min21.055-21.058=-0.003
max21.064-21.064=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.062-0.063=-0.002
σ0.004-0.002=0.002
min0.056-0.062=-0.006
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.363-0.362=0.001
min1750.844-1750.841=0.003
max1751.997-1751.983=0.014
mean1657.500-1657.750=-0.250
σ648.027-646.836=1.192
min652.000-653.000=-1.000
max2861.000-2853.000=8.000
mean2.808-2.852=-0.044
σ0.174-0.141=0.033
min2.260-2.541=-0.281
max3.060-3.148=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.371-273.403=-0.032
σ0.007-0.005=0.002
min273.362-273.395=-0.033
max273.382-273.408=-0.026
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean0.382-0.393=-0.011
σ0.005-0.011=-0.006
min0.376-0.379=-0.003
max0.389-0.407=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1933.838-1933.840=-0.002
σ0.008-0.017=-0.008
min1933.831-1933.825=0.006
max1933.851-1933.865=-0.014
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean3.066-2.935=0.131
σ0.129-0.196=-0.067
min2.930-2.636=0.294
max3.228-3.172=0.056
iters=5
new-facts=6402
prior-facts=1
mean4754.336-4754.340=-0.004
σ0.819-0.888=-0.069
min4753.885-4753.837=0.049
max4755.785-4755.923=-0.138
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean8.312-8.599=-0.288
σ0.498-0.427=0.071
min7.684-8.129=-0.445
max8.929-9.160=-0.231
iters=5
new-facts=6402
prior-facts=6402
mean4944.718-4944.729=-0.012
σ0.124-0.208=-0.084
min4944.541-4944.378=0.163
max4944.886-4944.894=-0.008
mean3085.400-3074.000=11.400
σ302.216-210.680=91.536
min2861.000-2853.000=8.000
max3556.000-3384.000=172.000
mean8.454-8.709=-0.255
σ0.100-0.403=-0.303
min8.357-8.419=-0.062
max8.579-9.380=-0.800

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.102=-0.050
σ0.125-0.072=0.053
min0.938-1.066=-0.128
max1.242-1.230=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.342-463.346=-0.004
σ572.192-572.206=-0.014
min177.241-177.236=0.004
max1321.630-1321.655=-0.025
mean79.750
σ7.500
min76.000
max91.000
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean0.436-0.441=-0.005
σ0.303-0.306=-0.003
min0.279-0.288=-0.008
max0.891-0.901=-0.010
policies=20
mean1772.589-1772.625=-0.036
σ0.321-0.346=-0.025
min1772.380-1772.367=0.012
max1773.064-1773.128=-0.065
mean760.000
σ0.000
min760.000
max760.000
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean2.823-2.847=-0.025
σ0.018-0.030=-0.012
min2.809-2.831=-0.022
max2.848-2.892=-0.045
policies=200
mean17732.465-17732.548=-0.083
σ0.504-0.372=0.132
min17732.137-17732.300=-0.163
max17733.215-17733.100=0.115
mean7600.000
σ0.000
min7600.000
max7600.000
mean2861.000-2853.000=8.000
σ0.000
min2861.000-2853.000=8.000
max2861.000-2853.000=8.000
mean28.193-28.206=-0.012
σ0.432-0.523=-0.092
min27.816-27.714=0.102
max28.698-28.802=-0.104