Compare commits

Home / Compare ce422976 .. a32e03cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.973=0.001
σ0.106-0.104=0.001
min35.922-35.926=-0.005
max36.273-36.269=0.005
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.077-0.075=0.001
σ0.004-0.005=-0.001
min0.074-0.070=0.005
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.003-0.004=-0.001
min26.202-26.201=0.001
max26.213
mean411.900-415.000=-3.100
σ0.316-0.000=0.316
min411.000-415.000=-4.000
max412.000-415.000=-3.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.000
min0.058-0.059=-0.002
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.366-1758.365=0.001
σ0.371-0.370=0.001
min1757.790-1757.787=0.003
max1758.967-1758.963=0.004
mean1644.350-1660.250=-15.900
σ632.300-624.261=8.038
min675.000-688.000=-13.000
max2844.000-2768.000=76.000
mean2.340-2.390=-0.050
σ0.077-0.109=-0.032
min2.211-2.276=-0.066
max2.486-2.608=-0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-279.511=0.001
σ0.009-0.009=0.001
min279.501-279.499=0.002
max279.520-279.519=0.001
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean0.409-0.411=-0.002
σ0.007-0.007=0.000
min0.404-0.405=-0.001
max0.420-0.421=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.444-2178.425=0.020
σ0.015-0.037=-0.022
min2178.422-2178.359=0.062
max2178.459-2178.449=0.009
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean3.288-3.389=-0.101
σ0.189-0.117=0.072
min3.035-3.268=-0.232
max3.491-3.530=-0.039
iters=5
new-facts=6402
prior-facts=1
mean5056.277-5056.357=-0.081
σ1.118-0.973=0.145
min5055.162-5055.766=-0.604
max5058.145-5058.083=0.062
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean9.310-9.034=0.276
σ0.749-0.490=0.258
min8.283-8.168=0.115
max10.308-9.359=0.949
iters=5
new-facts=6402
prior-facts=6402
mean5193.760-5193.674=0.085
σ0.089-0.125=-0.037
min5193.683-5193.505=0.178
max5193.857-5193.857=0.001
mean3251.600-3276.200=-24.600
σ305.788-460.996=-155.208
min2844.000-2768.000=76.000
max3673.000-3914.000=-241.000
mean8.965-8.976=-0.011
σ0.415-0.099=0.317
min8.624-8.861=-0.236
max9.665-9.094=0.570

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.933-0.956=-0.022
σ0.011-0.014=-0.003
min0.926-0.947=-0.020
max0.953-0.979=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.485-465.474=0.012
σ572.654-572.659=-0.004
min179.155-179.143=0.011
max1324.467-1324.461=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean0.439-0.484=-0.045
σ0.303-0.403=-0.101
min0.286-0.280=0.006
max0.892-1.089=-0.196
policies=20
mean1791.857-1791.705=0.152
σ0.356-0.330=0.025
min1791.611-1791.511=0.100
max1792.379-1792.197=0.182
mean760.000
σ0.000
min760.000
max760.000
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean2.876-2.804=0.072
σ0.017-0.008=0.009
min2.861-2.797=0.064
max2.901-2.814=0.087
policies=200
mean17923.911-17923.387=0.524
σ0.697-0.564=0.133
min17923.290-17923.065=0.225
max17924.806-17924.230=0.576
mean7600.000
σ0.000
min7600.000
max7600.000
mean2844.000-2768.000=76.000
σ0.000
min2844.000-2768.000=76.000
max2844.000-2768.000=76.000
mean28.400-28.250=0.150
σ0.438-0.112=0.327
min27.981-28.141=-0.160
max28.975-28.367=0.608