Compare commits

Home / Compare c95cb7e4 .. e1672fb5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.963-35.964=-0.001
σ0.106-0.106=0.001
min35.915-35.911=0.004
max36.264-36.263=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.075-0.074=0.001
σ0.004-0.004=0.001
min0.070-0.070=0.001
max0.082-0.081=0.001
cache=y
dps=1
iters=10
policies=100
mean26.201-26.202=-0.001
σ0.003-0.003=-0.000
min26.196-26.195=0.001
max26.206-26.207=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.059-0.059=-0.000
σ0.003-0.003=0.000
min0.056-0.057=-0.001
max0.066-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.924-1756.924=-0.001
σ0.366-0.369=-0.003
min1756.350-1756.351=-0.001
max1757.517-1757.519=-0.002
mean1657.400-1658.700=-1.300
σ645.040-640.984=4.056
min612.000-609.000=3.000
max2634.000-2685.000=-51.000
mean2.385-2.394=-0.009
σ0.182-0.180=0.002
min2.238-2.211=0.027
max3.090-3.072=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.434-279.436=-0.002
σ0.010-0.005=0.005
min279.421-279.432=-0.011
max279.446-279.443=0.003
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean0.414-0.413=0.001
σ0.005-0.004=0.000
min0.410-0.410=-0.000
max0.420-0.421=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2269.499-2269.495=0.005
σ0.010-0.009=0.001
min2269.481-2269.479=0.002
max2269.507-2269.504=0.003
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean2.921-2.909=0.012
σ0.078-0.084=-0.006
min2.858-2.811=0.048
max3.050-3.043=0.007
iters=5
new-facts=6402
prior-facts=1
mean4954.897-4954.871=0.026
σ0.912-0.908=0.005
min4954.294-4954.308=-0.015
max4956.512-4956.480=0.032
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean7.981-8.099=-0.118
σ0.413-0.355=0.058
min7.718-7.774=-0.056
max8.691-8.609=0.082
iters=5
new-facts=6402
prior-facts=6402
mean5169.438-5169.239=0.199
σ0.088-0.314=-0.227
min5169.342-5168.820=0.522
max5169.505-5169.506=-0.001
mean3474.600-3399.600=75.000
σ465.328-484.723=-19.395
min2808.000-2820.000=-12.000
max4019.000-4064.000=-45.000
mean9.312-9.521=-0.209
σ0.478-0.502=-0.024
min8.532-9.136=-0.604
max9.700-10.397=-0.696

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.093=0.147
σ0.309-0.143=0.166
min0.974-0.954=0.020
max1.741-1.271=0.470

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean461.590-461.590=0.000
σ572.657-572.649=0.009
min175.259-175.256=0.004
max1320.576-1320.563=0.013
mean77.500
σ7.000
min74.000
max88.000
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean0.536-0.480=0.056
σ0.525-0.417=0.107
min0.271-0.267=0.004
max1.323-1.106=0.217
policies=20
mean1752.825-1752.806=0.020
σ0.321-0.326=-0.005
min1752.614-1752.596=0.018
max1753.302-1753.290=0.011
mean740.000
σ0.000
min740.000
max740.000
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean2.710-2.717=-0.007
σ0.015-0.015=0.000
min2.697-2.697=0.001
max2.731-2.731=0.001
policies=200
mean17534.893-17534.664=0.229
σ0.505-0.505=0.000
min17534.567-17534.357=0.210
max17535.647-17535.420=0.227
mean7400.000
σ0.000
min7400.000
max7400.000
mean2634.000-2685.000=-51.000
σ0.000
min2634.000-2685.000=-51.000
max2634.000-2685.000=-51.000
mean27.389-27.394=-0.005
σ0.165-0.051=0.114
min27.204-27.337=-0.133
max27.605-27.460=0.145