Compare commits

Home / Compare a1c0afe5 .. fc71f499

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.957=0.017
σ0.107-0.101=0.005
min35.922-35.914=0.008
max36.276-36.244=0.031
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.078-0.077=0.001
σ0.004-0.003=0.001
min0.075-0.073=0.001
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.203=0.005
σ0.002-0.005=-0.004
min26.204-26.195=0.008
max26.211-26.210=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.061-0.059=0.002
σ0.003-0.003=-0.000
min0.059-0.056=0.003
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1756.305=2.058
σ0.372-0.368=0.004
min1757.786-1755.730=2.056
max1758.961-1756.896=2.065
mean1655.150-1635.650=19.500
σ620.424-632.207=-11.782
min685.000-618.000=67.000
max2746.000-2695.000=51.000
mean2.368-2.402=-0.034
σ0.114-0.105=0.009
min2.178-2.286=-0.108
max2.634-2.686=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-278.822=0.690
σ0.007-0.003=0.004
min279.503-278.819=0.684
max279.517-278.827=0.690
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean0.409-0.408=0.001
σ0.002-0.001=0.001
min0.405-0.407=-0.002
max0.410-0.410=0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.418-2268.876=-90.458
σ0.034-0.013=0.021
min2178.359-2268.864=-90.505
max2178.443-2268.896=-90.453
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean3.432-3.175=0.257
σ0.172-0.136=0.036
min3.271-3.036=0.234
max3.620-3.393=0.227
iters=5
new-facts=6402
prior-facts=1
mean5056.392-4787.958=268.434
σ1.004-372.128=-371.125
min5055.790-4122.277=933.513
max5058.177-4955.891=102.286
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean8.715-7.753=0.962
σ0.657-0.545=0.112
min8.163-6.880=1.283
max9.736-8.358=1.378
iters=5
new-facts=6402
prior-facts=6402
mean5193.689-5168.823=24.866
σ0.212-0.090=0.122
min5193.338-5168.718=24.620
max5193.874-5168.891=24.984
mean3285.800-3259.600=26.200
σ404.146-403.560=0.586
min2746.000-2853.000=-107.000
max3673.000-3660.000=13.000
mean8.832-9.164=-0.331
σ0.095-0.351=-0.256
min8.705-8.551=0.155
max8.970-9.378=-0.408

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-0.973=0.028
σ0.072-0.060=0.012
min0.937-0.935=0.002
max1.080-1.077=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-459.817=5.659
σ572.661-571.585=1.076
min179.137-174.017=5.120
max1324.468-1317.194=7.273
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean0.474-0.535=-0.061
σ0.379-0.528=-0.150
min0.282-0.269=0.013
max1.042-1.327=-0.285
policies=20
mean1791.671-1740.438=51.233
σ0.340-0.315=0.025
min1791.474-1740.255=51.219
max1792.178-1740.909=51.269
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean2.818-2.693=0.125
σ0.006-0.025=-0.018
min2.811-2.671=0.140
max2.824-2.724=0.100
policies=200
mean17923.168-17411.199=511.969
σ0.510-0.404=0.107
min17922.880-17410.969=511.911
max17923.933-17411.802=512.130
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2695.000=51.000
σ0.000
min2746.000-2695.000=51.000
max2746.000-2695.000=51.000
mean28.237-27.032=1.205
σ0.094-0.074=0.020
min28.152-26.924=1.228
max28.368-27.089=1.279