Compare commits

Home / Compare 4c58c775 .. 0e9a097b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.567=-0.005
σ0.046-0.044=0.001
min70.533-70.542=-0.009
max70.688-70.689=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.152-0.159=-0.007
σ0.012-0.006=0.006
min0.128-0.149=-0.021
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.001
σ0.003-0.003=0.000
min21.280-21.282=-0.003
max21.291-21.293=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.063=0.000
σ0.003-0.004=-0.000
min0.058-0.058=-0.000
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.375=-0.002
σ0.363-0.358=0.004
min1752.798-1752.806=-0.008
max1753.960-1753.942=0.018
mean1653.600-1662.400=-8.800
σ646.055-634.230=11.825
min632.000-618.000=14.000
max2897.000-2780.000=117.000
mean2.733-2.789=-0.056
σ0.212-0.195=0.017
min2.303-2.163=0.141
max2.951-2.987=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.728=0.029
σ0.006-0.008=-0.001
min271.750-271.716=0.034
max271.766-271.736=0.030
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean0.384-0.387=-0.003
σ0.010-0.009=0.001
min0.376-0.378=-0.002
max0.397-0.400=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.176=-0.004
σ0.006-0.019=-0.013
min1932.165-1932.147=0.018
max1932.182-1932.194=-0.013
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean2.992-3.001=-0.009
σ0.130-0.091=0.039
min2.792-2.857=-0.065
max3.121-3.099=0.022
iters=5
new-facts=6402
prior-facts=1
mean4752.793-4752.666=0.126
σ0.920-1.110=-0.190
min4752.019-4751.897=0.122
max4754.390-4754.611=-0.221
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean8.428-8.817=-0.389
σ0.349-0.325=0.024
min7.995-8.408=-0.413
max8.827-9.297=-0.470
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.371=0.006
σ0.016-0.015=0.001
min4943.360-4943.354=0.006
max4943.397-4943.387=0.010
mean3068.000-2998.200=69.800
σ184.957-290.951=-105.994
min2897.000-2780.000=117.000
max3344.000-3459.000=-115.000
mean8.540-8.472=0.068
σ0.161-0.178=-0.017
min8.370-8.349=0.021
max8.787-8.782=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.043=-0.044
σ0.137-0.114=0.023
min0.934-0.934=-0.000
max1.244-1.207=0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.852-467.858=4.994
σ575.916-575.940=-0.023
min184.887-179.885=5.002
max1336.727-1331.768=4.959
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean0.448-0.479=-0.031
σ0.305-0.402=-0.097
min0.294-0.274=0.019
max0.906-1.081=-0.175
policies=20
mean1849.221-1799.154=50.068
σ0.372-0.368=0.004
min1848.942-1798.930=50.011
max1849.761-1799.702=50.059
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean2.953-2.832=0.121
σ0.011-0.038=-0.027
min2.940-2.800=0.140
max2.963-2.871=0.091
policies=200
mean18498.620-17998.436=500.184
σ0.489-0.448=0.041
min18498.244-17998.096=500.148
max18499.307-17999.088=500.219
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2897.000-2780.000=117.000
σ0.000
min2897.000-2780.000=117.000
max2897.000-2780.000=117.000
mean29.232-28.248=0.984
σ0.455-0.155=0.300
min28.831-28.127=0.703
max29.715-28.452=1.263