Compare commits

Home / Compare 4a5a7a09 .. fd16435b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.108-0.107=0.001
min35.925-35.928=-0.004
max36.280-36.278=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.074-0.076=-0.002
σ0.005-0.005=0.000
min0.070-0.070=-0.000
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.003=0.000
min26.202-26.203=-0.001
max26.215-26.214=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.061=-0.001
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.364=0.001
σ0.370-0.372=-0.002
min1757.791-1757.787=0.004
max1758.960-1758.963=-0.003
mean1652.950-1657.400=-4.450
σ649.610-624.196=25.413
min669.000-686.000=-17.000
max2753.000-2766.000=-13.000
mean2.366-2.371=-0.006
σ0.106-0.112=-0.006
min2.174-2.227=-0.053
max2.646-2.608=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-279.509=0.000
σ0.006-0.004=0.002
min279.501-279.502=-0.001
max279.515-279.513=0.001
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean0.408-0.409=-0.001
σ0.007-0.001=0.006
min0.404-0.407=-0.003
max0.420-0.410=0.010
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2178.436=0.002
σ0.014-0.009=0.005
min2178.426-2178.422=0.004
max2178.462-2178.444=0.018
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean3.347-3.259=0.087
σ0.123-0.260=-0.137
min3.225-2.830=0.395
max3.532-3.507=0.024
iters=5
new-facts=6402
prior-facts=1
mean5056.368-5056.375=-0.007
σ0.980-0.984=-0.003
min5055.761-5055.797=-0.036
max5058.104-5058.126=-0.022
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean9.120-8.695=0.424
σ0.536-0.557=-0.021
min8.210-8.150=0.060
max9.581-9.534=0.047
iters=5
new-facts=6402
prior-facts=6402
mean5193.760-5193.681=0.078
σ0.090-0.126=-0.036
min5193.686-5193.503=0.183
max5193.860-5193.855=0.005
mean3241.400-3238.400=3.000
σ340.469-331.760=8.708
min2753.000-2766.000=-13.000
max3683.000-3673.000=10.000
mean9.028-9.107=-0.079
σ0.390-0.516=-0.126
min8.747-8.698=0.048
max9.700-9.709=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.975=0.003
σ0.063-0.056=0.007
min0.941-0.939=0.002
max1.088-1.070=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.492-465.471=0.021
σ572.681-572.662=0.019
min179.139-179.139=0.000
max1324.514-1324.464=0.050
mean79.500
σ7.000
min76.000
max90.000
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean0.563-0.469=0.094
σ0.563-0.391=0.171
min0.278-0.265=0.013
max1.407-1.056=0.351
policies=20
mean1791.697-1791.673=0.024
σ0.342-0.317=0.025
min1791.478-1791.478=0.000
max1792.206-1792.144=0.062
mean760.000
σ0.000
min760.000
max760.000
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean2.808-2.790=0.018
σ0.007-0.015=-0.008
min2.804-2.775=0.030
max2.819-2.811=0.008
policies=200
mean17923.419-17923.239=0.181
σ0.418-0.527=-0.108
min17923.106-17922.943=0.163
max17924.033-17924.027=0.006
mean7600.000
σ0.000
min7600.000
max7600.000
mean2753.000-2766.000=-13.000
σ0.000
min2753.000-2766.000=-13.000
max2753.000-2766.000=-13.000
mean28.212-28.357=-0.145
σ0.121-0.047=0.074
min28.108-28.290=-0.182
max28.385-28.400=-0.014