Compare commits

Home / Compare b381bc0b .. eb198da6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtimetime_s
cache=disabled
datapoints=1
iterations=10
mean1223.321
σ2.668
min1222.320
max1230.829
mean3795.000
σ0.000
min3795.000
max3795.000
mean0.357
σ0.003
min0.352
max0.362
cache=enabled
datapoints=1
iterations=10
mean82.804
σ0.003
min82.799
max82.810
mean3795.000
σ0.000
min3795.000
max3795.000
mean0.041
σ0.004
min0.039
max0.053
cache=n
dps=1
iters=10
policies=100
mean36.428
σ0.616
min35.629
max36.921
mean3764.000
σ0.000
min3764.000
max3764.000
mean0.075
σ0.002
min0.073
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.414
σ0.646
min25.910
max27.167
mean3764.000
σ0.000
min3764.000
max3764.000
mean0.060
σ0.001
min0.058
max0.062

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.115-1753.901=0.214
σ0.372-0.370=0.002
min1753.541-1753.324=0.217
max1754.707-1754.498=0.209
mean1667.200-1671.850=-4.650
σ621.525-638.149=-16.624
min625.000-622.000=3.000
max2648.000-2687.000=-39.000
mean2.734-2.706=0.028
σ0.168-0.194=-0.027
min2.323-2.190=0.133
max2.984-2.992=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean190.714-190.717=-0.003
σ0.008-0.005=0.002
min190.704-190.713=-0.009
max190.723-190.723=-0.000
mean2648.000-2687.000=-39.000
σ0.000
min2648.000-2687.000=-39.000
max2648.000-2687.000=-39.000
mean0.281-0.279=0.002
σ0.001-0.002=-0.001
min0.280-0.277=0.003
max0.282-0.282=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1989.491-1989.503=-0.013
σ0.019-0.013=0.006
min1989.464-1989.492=-0.028
max1989.507-1989.524=-0.017
mean2648.000-2687.000=-39.000
σ0.000
min2648.000-2687.000=-39.000
max2648.000-2687.000=-39.000
mean2.530-2.612=-0.083
σ0.181-0.187=-0.006
min2.338-2.397=-0.059
max2.777-2.804=-0.027
iters=5
new-facts=6402
prior-facts=1
mean4879.934-4880.161=-0.227
σ0.449-0.603=-0.155
min4879.372-4879.864=-0.492
max4880.629-4881.240=-0.611
mean2648.000-2687.000=-39.000
σ0.000
min2648.000-2687.000=-39.000
max2648.000-2687.000=-39.000
mean8.215-8.281=-0.066
σ0.069-0.152=-0.084
min8.130-8.102=0.027
max8.290-8.447=-0.157
iters=5
new-facts=6402
prior-facts=6402
mean4891.790-4891.770=0.020
σ0.023-0.018=0.004
min4891.771-4891.758=0.013
max4891.825-4891.802=0.023
mean3309.600-3320.600=-11.000
σ453.011-493.896=-40.885
min2858.000-2687.000=171.000
max3764.000-3795.000=-31.000
mean8.201-8.129=0.072
σ0.182-0.120=0.061
min8.062-8.003=0.059
max8.471-8.299=0.172

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.480-1.097=0.383
σ0.306-0.204=0.102
min1.072-0.950=0.122
max1.789-1.374=0.415

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.477-456.477=-0.000
σ572.533-572.534=-0.001
min170.210-170.210=0.000
max1315.277-1315.279=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean432.000
σ0.000
min432.000
max432.000
mean0.558-0.563=-0.006
σ0.584-0.598=-0.015
min0.264-0.259=0.005
max1.433-1.461=-0.028
policies=20
mean1702.603-1702.596=0.007
σ0.320-0.307=0.013
min1702.365-1702.372=-0.007
max1703.072-1703.046=0.025
mean760.000
σ0.000
min760.000
max760.000
mean445.750-445.000=0.750
σ10.404-11.662=-1.258
min435.000-433.000=2.000
max460.000-461.000=-1.000
mean2.649-2.641=0.008
σ0.021-0.003=0.018
min2.628-2.638=-0.009
max2.678-2.643=0.034
policies=200
mean17035.380-17035.322=0.058
σ0.115-0.073=0.042
min17035.224-17035.262=-0.038
max17035.484-17035.423=0.061
mean7600.000
σ0.000
min7600.000
max7600.000
mean495.250-494.000=1.250
σ5.909-3.162=2.747
min488.000-490.000=-2.000
max501.000-497.000=4.000
mean26.582-26.526=0.056
σ0.050-0.054=-0.005
min26.513-26.452=0.060
max26.627-26.569=0.058