Compare commits

Home / Compare 9b86c749 .. a525ebb8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798
σ0.106
min35.752
max36.100
mean411.900
σ0.316
min411.000
max412.000
mean0.075
σ0.003
min0.073
max0.081
cache=y
dps=1
iters=10
policies=100
mean26.065
σ0.003
min26.060
max26.069
mean412.000
σ0.000
min412.000
max412.000
mean0.061
σ0.003
min0.059
max0.069

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1740.577=15.345
σ0.368-0.370=-0.002
min1755.347-1739.986=15.361
max1756.518-1741.182=15.336
mean1667.600-1682.000=-14.400
σ639.052-630.730=8.323
min669.000-680.000=-11.000
max2697.000-2548.000=149.000
mean2.845-2.683=0.162
σ0.164-0.125=0.039
min2.361-2.405=-0.044
max3.123-2.851=0.272

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194
σ0.007
min277.185
max277.204
mean2697.000
σ0.000
min2697.000
max2697.000
mean0.400
σ0.010
min0.393
max0.412
iters=5
new-facts=1
prior-facts=6402
mean2174.445
σ0.017
min2174.430
max2174.463
mean2697.000
σ0.000
min2697.000
max2697.000
mean3.008
σ0.170
min2.816
max3.283
iters=5
new-facts=6402
prior-facts=1
mean5052.422
σ1.137
min5051.633
max5054.434
mean2697.000
σ0.000
min2697.000
max2697.000
mean9.288
σ0.896
min8.339
max10.435
iters=5
new-facts=6402
prior-facts=6402
mean5188.411
σ0.096
min5188.303
max5188.514
mean3226.400
σ374.537
min2697.000
max3690.000
mean9.013
σ0.425
min8.772
max9.768

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.087
σ0.138
min0.949
max1.265

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.861-499.160=-34.299
σ572.656-663.562=-90.906
min178.523-167.376=11.147
max1323.844-1494.502=-170.658
mean79.500-77.250=2.250
σ7.000-6.500=0.500
min76.000-74.000=2.000
max90.000-87.000=3.000
mean2697.000-434.000=2263.000
σ0.000
min2697.000-434.000=2263.000
max2697.000-434.000=2263.000
mean0.557-0.561=-0.004
σ0.545-0.582=-0.037
min0.277-0.263=0.015
max1.374-1.433=-0.059
policies=20
mean1785.484-1675.128=110.356
σ0.335-0.836=-0.500
min1785.250-1674.269=110.981
max1785.979-1676.220=109.760
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2697.000-444.000=2253.000
σ0.000-9.274=-9.274
min2697.000-435.000=2262.000
max2697.000-457.000=2240.000
mean2.808-2.632=0.177
σ0.016-0.017=-0.001
min2.793-2.614=0.179
max2.829-2.651=0.178
policies=200
mean17861.405-16771.921=1089.484
σ0.618-0.100=0.518
min17861.006-16771.782=1089.224
max17862.324-16772.015=1090.309
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2697.000-497.000=2200.000
σ0.000-5.164=-5.164
min2697.000-491.000=2206.000
max2697.000-503.000=2194.000
mean28.267-26.653=1.614
σ0.174-0.075=0.098
min28.107-26.549=1.558
max28.418-26.729=1.689