Compare commits

Home / Compare c1a4e652 .. 3af73917

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.100-34.101=-0.001
σ0.046-0.048=-0.001
min34.074-34.068=0.006
max34.228-34.231=-0.003
mean419.000-414.300=4.700
σ0.000-0.483=-0.483
min419.000-414.000=5.000
max419.000-415.000=4.000
mean0.084-0.084=-0.000
σ0.003-0.003=0.001
min0.082-0.082=-0.000
max0.091-0.089=0.002
cache=y
dps=1
iters=10
policies=100
mean23.422-23.423=-0.001
σ0.002-0.003=-0.000
min23.419-23.418=0.000
max23.428-23.427=0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.063-0.064=-0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.579-1758.513=0.067
σ0.365-0.364=0.001
min1758.006-1757.942=0.065
max1759.167-1759.104=0.063
mean1658.500-1641.250=17.250
σ636.778-641.114=-4.336
min633.000-628.000=5.000
max2802.000-2696.000=106.000
mean2.376-2.393=-0.017
σ0.082-0.128=-0.046
min2.268-2.172=0.095
max2.569-2.687=-0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean329.775-329.707=0.067
σ0.059-0.051=0.008
min329.670-329.617=0.053
max329.811-329.737=0.074
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean0.434-0.427=0.006
σ0.010-0.000=0.009
min0.426-0.427=-0.001
max0.449-0.428=0.021
iters=5
new-facts=1
prior-facts=6402
mean1991.935-1991.879=0.056
σ0.017-0.010=0.007
min1991.916-1991.865=0.051
max1991.955-1991.891=0.064
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean2.661-2.665=-0.004
σ0.055-0.089=-0.033
min2.625-2.570=0.056
max2.758-2.767=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4816.794-4816.729=0.064
σ7.728-7.719=0.009
min4813.243-4813.214=0.029
max4830.618-4830.538=0.080
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean8.796-8.856=-0.060
σ0.437-0.332=0.105
min8.270-8.371=-0.101
max9.159-9.173=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean5004.340-5004.202=0.138
σ0.017-0.174=-0.157
min5004.318-5003.893=0.425
max5004.354-5004.302=0.051
mean3015.600-3027.800=-12.200
σ220.445-288.567=-68.122
min2802.000-2696.000=106.000
max3327.000-3417.000=-90.000
mean9.601-9.808=-0.208
σ0.522-0.073=0.449
min8.673-9.721=-1.048
max9.908-9.912=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-0.944=0.057
σ0.067-0.053=0.014
min0.919-0.913=0.006
max1.054-1.037=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.551-465.480=0.071
σ574.766-574.772=-0.006
min178.157-178.087=0.070
max1327.700-1327.637=0.063
mean88.250
σ8.500
min84.000
max101.000
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean0.437-0.538=-0.101
σ0.306-0.527=-0.222
min0.283-0.270=0.013
max0.896-1.329=-0.433
policies=20
mean1781.827-1781.158=0.669
σ0.361-0.352=0.009
min1781.581-1780.932=0.649
max1782.362-1781.683=0.679
mean840.000
σ0.000
min840.000
max840.000
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean2.802-2.746=0.056
σ0.026-0.007=0.019
min2.776-2.736=0.040
max2.832-2.750=0.083
policies=200
mean17824.979-17818.565=6.414
σ0.607-0.389=0.218
min17824.625-17818.287=6.338
max17825.887-17819.131=6.755
mean8400.000
σ0.000
min8400.000
max8400.000
mean2802.000-2696.000=106.000
σ0.000
min2802.000-2696.000=106.000
max2802.000-2696.000=106.000
mean27.733-27.617=0.116
σ0.362-0.111=0.252
min27.432-27.490=-0.057
max28.259-27.729=0.529