Compare commits

Home / Compare 5fd9e993 .. 9f09feb3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.979
σ0.106
min35.932
max36.280
mean411.000
σ0.000
min411.000
max411.000
mean0.077
σ0.004
min0.074
max0.084
cache=y
dps=1
iters=10
policies=100
mean26.209
σ0.003
min26.205
max26.214
mean411.000
σ0.000
min411.000
max411.000
mean0.061
σ0.003
min0.059
max0.070

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1755.328=3.049
σ0.370-0.367=0.003
min1757.799-1754.753=3.046
max1758.975-1755.929=3.046
mean1653.550-1656.400=-2.850
σ625.319-628.542=-3.223
min667.000-619.000=48.000
max2596.000-2743.000=-147.000
mean2.352-2.272=0.079
σ0.078-0.170=-0.092
min2.278-2.092=0.186
max2.605-2.802=-0.197

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.543-277.711=1.832
σ0.007-0.010=-0.003
min279.534-277.699=1.835
max279.553-277.721=1.832
mean2596.000-2743.000=-147.000
σ0.000
min2596.000-2743.000=-147.000
max2596.000-2743.000=-147.000
mean0.418-0.410=0.008
σ0.014-0.001=0.013
min0.405-0.409=-0.004
max0.438-0.411=0.027
iters=5
new-facts=1
prior-facts=6402
mean2178.470-2267.879=-89.409
σ0.013-0.022=-0.009
min2178.452-2267.850=-89.397
max2178.488-2267.901=-89.413
mean2596.000-2743.000=-147.000
σ0.000
min2596.000-2743.000=-147.000
max2596.000-2743.000=-147.000
mean3.325-3.103=0.222
σ0.150-0.122=0.028
min3.205-2.935=0.270
max3.584-3.277=0.307
iters=5
new-facts=6402
prior-facts=1
mean5056.337-4955.071=101.266
σ1.016-0.801=0.215
min5055.364-4954.579=100.785
max5058.063-4956.496=101.567
mean2596.000-2743.000=-147.000
σ0.000
min2596.000-2743.000=-147.000
max2596.000-2743.000=-147.000
mean8.998-7.881=1.117
σ0.706-0.258=0.448
min8.105-7.574=0.531
max9.990-8.147=1.843
iters=5
new-facts=6402
prior-facts=6402
mean5193.765-5169.787=23.977
σ0.072-0.087=-0.015
min5193.720-5169.679=24.041
max5193.893-5169.854=24.039
mean3221.800-3290.200=-68.400
σ487.184-368.503=118.681
min2601.000-2921.000=-320.000
max3830.000-3658.000=172.000
mean8.763-9.274=-0.510
σ0.168-0.256=-0.088
min8.636-8.959=-0.324
max8.957-9.565=-0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.261-1.687=-0.425
σ0.356-0.277=0.080
min0.973-1.318=-0.345
max1.854-1.915=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.950-456.737=9.213
σ573.491-573.432=0.059
min179.200-170.020=9.180
max1326.186-1316.885=9.301
mean79.500
σ7.000
min76.000
max90.000
mean2596.000-430.000=2166.000
σ0.000
min2596.000-430.000=2166.000
max2596.000-430.000=2166.000
mean0.555-0.532=0.023
σ0.547-0.537=0.010
min0.279-0.261=0.017
max1.376-1.337=0.039
policies=20
mean1792.266-1700.732=91.534
σ0.348-0.301=0.047
min1792.024-1700.506=91.518
max1792.777-1701.171=91.606
mean760.000
σ0.000
min760.000
max760.000
mean2596.000-443.000=2153.000
σ0.000-10.066=-10.066
min2596.000-433.000=2163.000
max2596.000-457.000=2139.000
mean2.821-2.613=0.208
σ0.053-0.015=0.038
min2.776-2.598=0.179
max2.886-2.632=0.254
policies=200
mean17929.377-17016.620=912.757
σ0.563-0.080=0.482
min17929.087-17016.570=912.517
max17930.220-17016.738=913.483
mean7600.000
σ0.000
min7600.000
max7600.000
mean2596.000-490.000=2106.000
σ0.000-3.266=-3.266
min2596.000-486.000=2110.000
max2596.000-494.000=2102.000
mean28.280-26.309=1.971
σ0.182-0.074=0.108
min28.127-26.265=1.862
max28.500-26.419=2.081