Compare commits

Home / Compare 15f7dee7 .. e2606131

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.975=-0.002
σ0.107-0.106=0.000
min35.922-35.929=-0.007
max36.276-36.277=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.078=0.000
σ0.004-0.004=0.000
min0.075-0.075=-0.000
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.002-0.004=-0.002
min26.204-26.204=-0.000
max26.211-26.214=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.060=0.001
σ0.003-0.004=-0.001
min0.059-0.057=0.002
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1758.364=-0.002
σ0.372-0.373=-0.001
min1757.786-1757.786=0.000
max1758.961-1758.964=-0.003
mean1655.150-1654.850=0.300
σ620.424-650.059=-29.635
min685.000-671.000=14.000
max2746.000-2756.000=-10.000
mean2.368-2.365=0.003
σ0.114-0.083=0.032
min2.178-2.247=-0.069
max2.634-2.501=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-279.507=0.005
σ0.007-0.005=0.002
min279.503-279.501=0.003
max279.517-279.515=0.002
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean0.409-0.408=0.000
σ0.002-0.007=-0.005
min0.405-0.405=0.001
max0.410-0.420=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2178.418-2178.438=-0.021
σ0.034-0.013=0.021
min2178.359-2178.421=-0.061
max2178.443-2178.455=-0.012
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean3.432-3.251=0.181
σ0.172-0.317=-0.145
min3.271-2.801=0.469
max3.620-3.694=-0.074
iters=5
new-facts=6402
prior-facts=1
mean5056.392-5056.359=0.033
σ1.004-0.998=0.005
min5055.790-5055.811=-0.020
max5058.177-5058.138=0.039
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean8.715-8.953=-0.239
σ0.657-0.578=0.080
min8.163-8.075=0.089
max9.736-9.589=0.147
iters=5
new-facts=6402
prior-facts=6402
mean5193.689-5193.756=-0.067
σ0.212-0.090=0.122
min5193.338-5193.678=-0.340
max5193.874-5193.854=0.020
mean3285.800-3215.600=70.200
σ404.146-454.919=-50.773
min2746.000-2756.000=-10.000
max3673.000-3846.000=-173.000
mean8.832-8.809=0.023
σ0.095-0.307=-0.212
min8.705-8.628=0.077
max8.970-9.352=-0.382

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-0.998=0.002
σ0.072-0.069=0.003
min0.937-0.941=-0.004
max1.080-1.074=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-465.487=-0.011
σ572.661-572.681=-0.020
min179.137-179.144=-0.006
max1324.468-1324.508=-0.041
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean0.474-0.545=-0.071
σ0.379-0.547=-0.168
min0.282-0.264=0.018
max1.042-1.365=-0.323
policies=20
mean1791.671-1791.681=-0.010
σ0.340-0.346=-0.006
min1791.474-1791.473=0.001
max1792.178-1792.198=-0.020
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean2.818-2.810=0.008
σ0.006-0.009=-0.003
min2.811-2.802=0.009
max2.824-2.820=0.004
policies=200
mean17923.168-17923.181=-0.013
σ0.510-0.820=-0.310
min17922.880-17922.476=0.405
max17923.933-17924.295=-0.362
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2756.000=-10.000
σ0.000
min2746.000-2756.000=-10.000
max2746.000-2756.000=-10.000
mean28.237-28.202=0.036
σ0.094-0.102=-0.008
min28.152-28.092=0.060
max28.368-28.295=0.073