Compare commits

Home / Compare bd27c652 .. 667988f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.965=0.009
σ0.106-0.104=0.002
min35.930-35.920=0.009
max36.275-36.260=0.015
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.077-0.074=0.003
σ0.004-0.004=-0.000
min0.074-0.070=0.004
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.004=-0.000
min26.202-26.204=-0.002
max26.214-26.216=-0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.061=-0.000
σ0.003-0.002=0.000
min0.059-0.059=-0.000
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1756.314=2.063
σ0.371-0.369=0.002
min1757.799-1755.739=2.060
max1758.973-1756.908=2.065
mean1658.600-1647.700=10.900
σ620.160-625.175=-5.015
min688.000-609.000=79.000
max2741.000-2634.000=107.000
mean2.392-2.394=-0.003
σ0.143-0.118=0.025
min2.262-2.232=0.029
max2.864-2.751=0.114

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-278.836=0.706
σ0.010-0.017=-0.007
min279.529-278.808=0.721
max279.555-278.848=0.707
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean0.412-0.410=0.002
σ0.006-0.006=0.001
min0.405-0.406=-0.001
max0.420-0.420=0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.452-2268.895=-90.443
σ0.035-0.008=0.027
min2178.404-2268.884=-90.480
max2178.492-2268.903=-90.411
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean3.311-3.122=0.190
σ0.174-0.216=-0.042
min3.091-2.914=0.177
max3.561-3.433=0.128
iters=5
new-facts=6402
prior-facts=1
mean5056.368-4954.128=102.240
σ0.916-0.941=-0.025
min5055.834-4953.329=102.505
max5057.994-4955.760=102.234
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean8.701-8.138=0.563
σ0.407-0.276=0.132
min8.071-7.856=0.215
max9.138-8.438=0.699
iters=5
new-facts=6402
prior-facts=6402
mean5193.710-5168.750=24.960
σ0.210-0.215=-0.005
min5193.366-5168.392=24.974
max5193.884-5168.934=24.950
mean3226.000-3420.000=-194.000
σ353.971-500.785=-146.814
min2841.000-2835.000=6.000
max3760.000-4166.000=-406.000
mean8.723-9.349=-0.627
σ0.069-0.527=-0.458
min8.630-8.760=-0.130
max8.814-10.118=-1.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.084=-0.085
σ0.137-0.227=-0.090
min0.934-0.945=-0.010
max1.244-1.480=-0.236

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.533-460.361=5.172
σ572.656-572.656=-0.000
min179.199-174.023=5.177
max1324.516-1319.344=5.172
mean79.500
σ7.000
min76.000
max90.000
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean0.470-0.562=-0.093
σ0.378-0.572=-0.194
min0.279-0.266=0.013
max1.037-1.420=-0.383
policies=20
mean1792.304-1740.497=51.807
σ0.326-0.317=0.010
min1792.112-1740.290=51.823
max1792.791-1740.969=51.823
mean760.000
σ0.000
min760.000
max760.000
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean2.796-2.682=0.114
σ0.016-0.007=0.008
min2.779-2.672=0.107
max2.815-2.688=0.126
policies=200
mean17929.430-17411.839=517.591
σ0.583-0.598=-0.015
min17929.114-17411.502=517.611
max17930.304-17412.735=517.569
mean7600.000
σ0.000
min7600.000
max7600.000
mean2741.000-2634.000=107.000
σ0.000
min2741.000-2634.000=107.000
max2741.000-2634.000=107.000
mean28.139-27.095=1.044
σ0.124-0.050=0.074
min28.005-27.029=0.976
max28.247-27.152=1.095