Compare commits

Home / Compare 7a6ed76d .. ca08f259

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.915=-0.268
σ0.367-0.368=-0.001
min53.516-53.776=-0.261
max54.690-54.960=-0.271
mean414.600-418.000=-3.400
σ0.516-0.000=0.516
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.136-0.136=-0.000
σ0.005-0.006=-0.001
min0.127-0.129=-0.001
max0.144-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean42.942-43.141=-0.199
σ0.006-0.007=-0.001
min42.932-43.131=-0.198
max42.951-43.151=-0.201
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.121-0.121=0.000
σ0.003-0.003=0.000
min0.118-0.118=-0.000
max0.127-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.810-991.816=-0.006
σ1.240-1.247=-0.007
min991.222-991.231=-0.009
max997.015-997.055=-0.040
mean1071.350-1071.550=-0.200
σ319.412-313.384=6.029
min613.000-618.000=-5.000
max1634.000-1647.000=-13.000
mean1.511-1.540=-0.028
σ0.058-0.064=-0.006
min1.347-1.466=-0.119
max1.608-1.731=-0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.386-285.413=-0.027
σ0.011-0.010=0.001
min285.371-285.398=-0.027
max285.398-285.422=-0.024
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean0.375-0.386=-0.011
σ0.010-0.011=-0.001
min0.366-0.374=-0.008
max0.386-0.397=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1285.351-1285.370=-0.019
σ0.130-0.118=0.012
min1285.287-1285.314=-0.028
max1285.584-1285.581=0.003
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean1.942-1.862=0.079
σ0.164-0.046=0.118
min1.850-1.801=0.049
max2.235-1.920=0.315
iters=5
new-facts=6402
prior-facts=1
mean1807.667-1807.702=-0.036
σ7.014-7.022=-0.008
min1804.316-1804.337=-0.021
max1820.198-1820.250=-0.052
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean4.149-4.165=-0.016
σ0.185-0.216=-0.031
min3.983-3.923=0.060
max4.445-4.446=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean2070.180-2070.194=-0.014
σ0.007-0.007=0.001
min2070.168-2070.186=-0.018
max2070.187-2070.202=-0.014
mean1832.400-1863.800=-31.400
σ170.638-199.589=-28.951
min1634.000-1647.000=-13.000
max2068.000-2106.000=-38.000
mean4.588-4.535=0.053
σ0.082-0.101=-0.019
min4.504-4.426=0.079
max4.720-4.688=0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.234=-0.027
σ0.327-0.347=-0.020
min0.914-0.917=-0.003
max1.757-1.817=-0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.789=-0.015
σ572.365-572.358=0.007
min150.586-150.600=-0.015
max1295.322-1295.326=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean0.521-0.531=-0.010
σ0.541-0.563=-0.022
min0.250-0.247=0.003
max1.332-1.376=-0.043
policies=20
mean1506.155-1506.276=-0.121
σ0.233-0.246=-0.013
min1505.997-1506.121=-0.124
max1506.500-1506.643=-0.142
mean860.000
σ0.000
min860.000
max860.000
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean2.507-2.531=-0.025
σ0.018-0.014=0.004
min2.484-2.516=-0.032
max2.525-2.549=-0.024
policies=200
mean15069.487-15070.261=-0.774
σ0.111-0.099=0.012
min15069.357-15070.136=-0.779
max15069.591-15070.379=-0.788
mean8600.000
σ0.000
min8600.000
max8600.000
mean1634.000-1647.000=-13.000
σ0.000
min1634.000-1647.000=-13.000
max1634.000-1647.000=-13.000
mean25.457-25.433=0.024
σ0.085-0.186=-0.101
min25.357-25.215=0.142
max25.541-25.646=-0.105