Compare commits

Home / Compare 3f59b0e9 .. 1f90280b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.263=0.354
σ0.055-0.054=0.001
min35.591-35.234=0.357
max35.773-35.417=0.357
mean416.000-417.400=-1.400
σ0.000-0.966=-0.966
min416.000
max416.000-418.000=-2.000
mean0.082-0.085=-0.003
σ0.005-0.004=0.001
min0.076-0.082=-0.005
max0.090-0.094=-0.004
cache=y
dps=1
iters=10
policies=100
mean24.047-23.771=0.276
σ0.003-0.004=-0.001
min24.043-23.763=0.280
max24.051-23.777=0.274
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.067-0.068=-0.002
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.073-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.485=0.006
σ0.365-0.363=0.002
min1755.916-1755.910=0.006
max1757.078-1757.058=0.020
mean1654.050-1660.550=-6.500
σ646.487-638.253=8.234
min633.000
max2850.000-2754.000=96.000
mean2.372-2.342=0.030
σ0.157-0.118=0.040
min2.267-2.249=0.018
max2.984-2.779=0.205

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.763-324.715=0.047
σ0.051-0.032=0.019
min324.672-324.659=0.013
max324.793-324.739=0.055
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean0.429-0.423=0.006
σ0.010-0.002=0.009
min0.423-0.422=0.001
max0.447-0.426=0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.265=0.048
σ0.013-0.016=-0.003
min1985.300-1985.237=0.063
max1985.330-1985.275=0.054
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean2.665-2.658=0.006
σ0.136-0.125=0.012
min2.536-2.555=-0.019
max2.867-2.840=0.027
iters=5
new-facts=6402
prior-facts=1
mean4808.873-4808.919=-0.046
σ7.818-7.616=0.202
min4804.477-4805.429=-0.952
max4822.828-4822.543=0.284
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean8.776-9.130=-0.354
σ0.538-0.417=0.121
min7.908-8.582=-0.674
max9.171-9.688=-0.517
iters=5
new-facts=6402
prior-facts=6402
mean4996.545-4996.383=0.162
σ0.160-0.144=0.015
min4996.262-4996.127=0.135
max4996.637-4996.472=0.165
mean3053.200-3033.600=19.600
σ284.989-336.803=-51.814
min2850.000-2754.000=96.000
max3504.000-3538.000=-34.000
mean8.628-8.556=0.072
σ0.209-0.157=0.052
min8.436-8.461=-0.024
max8.940-8.831=0.108

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.983-0.946=0.036
σ0.141-0.055=0.086
min0.912-0.913=-0.001
max1.234-1.044=0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-462.970=0.243
σ574.773-574.247=0.526
min175.817-175.841=-0.025
max1325.372-1324.341=1.032
mean86.250
σ8.500
min82.000
max99.000
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean0.430-0.432=-0.002
σ0.295-0.296=-0.001
min0.280-0.282=-0.002
max0.873-0.876=-0.003
policies=20
mean1758.533-1758.707=-0.174
σ0.357-0.302=0.055
min1758.290-1758.512=-0.221
max1759.061-1759.155=-0.094
mean820.000
σ0.000
min820.000
max820.000
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean2.787-2.830=-0.042
σ0.010-0.078=-0.068
min2.777-2.783=-0.005
max2.800-2.947=-0.146
policies=200
mean17592.214-17592.479=-0.264
σ0.467-0.465=0.002
min17591.908-17592.217=-0.309
max17592.910-17593.175=-0.264
mean8200.000
σ0.000
min8200.000
max8200.000
mean2850.000-2754.000=96.000
σ0.000
min2850.000-2754.000=96.000
max2850.000-2754.000=96.000
mean28.019-27.448=0.570
σ0.344-0.096=0.247
min27.604-27.311=0.293
max28.344-27.532=0.812