Compare commits

Home / Compare 4f9c5be5 .. 3fe54444

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.974=-0.000
σ0.106-0.108=-0.002
min35.926-35.929=-0.003
max36.274-36.281=-0.007
mean416.000-415.600=0.400
σ0.000-0.516=-0.516
min416.000-415.000=1.000
max416.000
mean0.077-0.075=0.003
σ0.004-0.003=0.001
min0.074-0.071=0.003
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.003=0.002
min26.201-26.205=-0.004
max26.216-26.214=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.060-0.061=-0.001
σ0.003-0.004=-0.000
min0.057-0.057=-0.000
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.366=-0.000
σ0.370-0.370=-0.000
min1757.788-1757.789=-0.001
max1758.952-1758.961=-0.009
mean1642.850-1657.050=-14.200
σ628.364-620.311=8.053
min615.000-688.000=-73.000
max2771.000-2746.000=25.000
mean2.353-2.370=-0.017
σ0.091-0.073=0.017
min2.150-2.288=-0.138
max2.512-2.547=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.513=-0.002
σ0.006-0.007=-0.001
min279.502-279.504=-0.002
max279.517-279.519=-0.002
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean0.408-0.408=-0.000
σ0.005-0.006=-0.001
min0.403-0.404=-0.001
max0.415-0.418=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.440-2178.395=0.045
σ0.015-0.079=-0.065
min2178.421-2178.254=0.167
max2178.457-2178.447=0.010
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean3.265-3.476=-0.212
σ0.357-0.322=0.035
min2.763-3.253=-0.490
max3.619-4.040=-0.421
iters=5
new-facts=6402
prior-facts=1
mean5056.127-5056.371=-0.244
σ0.812-0.982=-0.169
min5055.395-5055.840=-0.444
max5057.514-5058.119=-0.605
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean8.842-9.020=-0.178
σ0.554-0.556=-0.002
min8.129-8.230=-0.101
max9.390-9.586=-0.196
iters=5
new-facts=6402
prior-facts=6402
mean5193.685-5193.534=0.151
σ0.120-0.133=-0.012
min5193.508-5193.346=0.162
max5193.848-5193.694=0.154
mean3236.600-3273.800=-37.200
σ342.575-383.682=-41.108
min2771.000-2746.000=25.000
max3668.000-3630.000=38.000
mean8.847-8.960=-0.113
σ0.209-0.218=-0.009
min8.667-8.736=-0.070
max9.197-9.314=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.004-0.995=0.010
σ0.137-0.066=0.071
min0.938-0.936=0.002
max1.249-1.070=0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.487-465.480=0.006
σ572.677-572.663=0.014
min179.138-179.140=-0.002
max1324.503-1324.475=0.028
mean79.500
σ7.000
min76.000
max90.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean0.491-0.491=-0.001
σ0.421-0.421=0.000
min0.279-0.278=0.000
max1.122-1.122=-0.000
policies=20
mean1791.680-1791.701=-0.020
σ0.351-0.334=0.017
min1791.452-1791.509=-0.057
max1792.202-1792.200=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean2.801-2.796=0.004
σ0.016-0.011=0.004
min2.783-2.784=-0.000
max2.820-2.811=0.010
policies=200
mean17923.530-17923.363=0.166
σ0.508-0.522=-0.014
min17923.260-17922.994=0.266
max17924.291-17924.125=0.166
mean7600.000
σ0.000
min7600.000
max7600.000
mean2771.000-2746.000=25.000
σ0.000
min2771.000-2746.000=25.000
max2771.000-2746.000=25.000
mean28.222-28.129=0.093
σ0.165-0.092=0.074
min28.091-28.033=0.058
max28.447-28.232=0.214