Compare commits

Home / Compare 82754ddd .. ac95c8cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.368-0.368=-0.000
min53.787-53.779=0.008
max54.961-54.961=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.139=0.002
σ0.004-0.004=0.000
min0.136-0.135=0.001
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.001
σ0.006-0.006=-0.000
min43.130-43.132=-0.002
max43.149-43.151=-0.002
mean415.800-416.000=-0.200
σ0.422-0.000=0.422
min415.000-416.000=-1.000
max416.000
mean0.121-0.120=0.001
σ0.003-0.004=-0.001
min0.119-0.115=0.004
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-992.087=-0.274
σ1.227-1.234=-0.006
min991.230-991.493=-0.263
max996.970-997.258=-0.289
mean1075.900-1062.900=13.000
σ319.158-312.363=6.795
min615.000-604.000=11.000
max1639.000-1598.000=41.000
mean1.504-1.544=-0.040
σ0.050-0.109=-0.059
min1.447-1.411=0.036
max1.632-1.805=-0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.678=-0.267
σ0.013-0.016=-0.003
min285.398-285.653=-0.255
max285.424-285.695=-0.271
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean0.378-0.377=0.001
σ0.009-0.003=0.006
min0.368-0.373=-0.005
max0.388-0.382=0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.368-1285.637=-0.270
σ0.129-0.133=-0.003
min1285.305-1285.575=-0.270
max1285.599-1285.875=-0.276
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean1.867-1.871=-0.003
σ0.090-0.073=0.017
min1.804-1.821=-0.016
max2.013-1.999=0.014
iters=5
new-facts=6402
prior-facts=1
mean1807.718-1807.980=-0.262
σ6.960-7.028=-0.067
min1804.353-1804.610=-0.258
max1820.152-1820.536=-0.384
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean4.197-4.208=-0.011
σ0.179-0.196=-0.016
min4.027-3.956=0.071
max4.421-4.495=-0.073
iters=5
new-facts=6402
prior-facts=6402
mean2070.197-2070.463=-0.266
σ0.009-0.010=-0.001
min2070.189-2070.449=-0.260
max2070.213-2070.476=-0.263
mean1878.600-1858.400=20.200
σ227.992-209.716=18.276
min1639.000-1598.000=41.000
max2180.000-2089.000=91.000
mean4.504-4.490=0.014
σ0.084-0.074=0.010
min4.432-4.429=0.003
max4.642-4.608=0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.152-1.286=-0.134
σ0.322-0.306=0.017
min0.895-0.915=-0.019
max1.678-1.536=0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-437.385=-0.600
σ572.365-572.361=0.004
min150.597-151.195=-0.598
max1295.332-1295.927=-0.594
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean0.520-0.541=-0.021
σ0.539-0.584=-0.045
min0.248-0.235=0.013
max1.329-1.417=-0.089
policies=20
mean1506.262-1512.209=-5.947
σ0.240-0.247=-0.007
min1506.115-1512.045=-5.931
max1506.620-1512.577=-5.957
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean2.514-2.532=-0.017
σ0.011-0.011=-0.000
min2.503-2.518=-0.015
max2.529-2.542=-0.013
policies=200
mean15070.414-15129.726=-59.311
σ0.044-0.053=-0.009
min15070.368-15129.654=-59.286
max15070.467-15129.782=-59.314
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1598.000=41.000
σ0.000
min1639.000-1598.000=41.000
max1639.000-1598.000=41.000
mean25.514-25.601=-0.087
σ0.095-0.145=-0.050
min25.374-25.416=-0.042
max25.584-25.770=-0.186