Compare commits

Home / Compare 88105ed8 .. 5bbd50d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.001
σ0.366-0.367=-0.002
min53.778-53.786=-0.008
max54.955-54.959=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.136=0.004
σ0.005-0.005=-0.000
min0.135-0.130=0.005
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.144-43.141=0.003
σ0.012-0.005=0.006
min43.129-43.133=-0.004
max43.169-43.150=0.019
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.119-0.118=0.001
σ0.004-0.004=0.000
min0.114-0.113=0.001
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.085-992.085=-0.001
σ1.232-1.236=-0.004
min991.502-991.495=0.007
max997.254-997.273=-0.019
mean1064.800-1066.000=-1.200
σ322.441-310.938=11.502
min568.000-603.000=-35.000
max1639.000-1627.000=12.000
mean1.524-1.550=-0.026
σ0.069-0.130=-0.060
min1.416-1.445=-0.030
max1.715-2.046=-0.331

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.677-285.679=-0.002
σ0.015-0.010=0.006
min285.652-285.669=-0.016
max285.694-285.690=0.004
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean0.374-0.378=-0.004
σ0.001-0.006=-0.005
min0.373-0.375=-0.002
max0.375-0.388=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1285.646-1285.641=0.004
σ0.142-0.135=0.006
min1285.578-1285.577=0.001
max1285.899-1285.884=0.015
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean1.930-1.936=-0.005
σ0.143-0.128=0.015
min1.854-1.869=-0.015
max2.186-2.165=0.021
iters=5
new-facts=6402
prior-facts=1
mean1808.003-1807.988=0.015
σ6.991-7.019=-0.028
min1804.585-1804.629=-0.043
max1820.492-1820.530=-0.038
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean4.196-4.205=-0.009
σ0.251-0.271=-0.020
min3.873-3.942=-0.069
max4.393-4.527=-0.134
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-2070.466=0.001
σ0.012-0.008=0.004
min2070.453-2070.457=-0.004
max2070.485-2070.478=0.008
mean1843.600-1834.000=9.600
σ182.410-173.540=8.870
min1639.000-1627.000=12.000
max2081.000-2073.000=8.000
mean4.510-4.588=-0.078
σ0.020-0.116=-0.095
min4.481-4.492=-0.011
max4.535-4.790=-0.255

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.211=-0.019
σ0.301-0.275=0.027
min0.920-0.912=0.008
max1.695-1.639=0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.385-437.387=-0.002
σ572.361-572.361=0.000
min151.198-151.198=-0.001
max1295.927-1295.929=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean0.506-0.522=-0.016
σ0.502-0.528=-0.026
min0.253-0.257=-0.004
max1.259-1.314=-0.055
policies=20
mean1512.236-1512.252=-0.016
σ0.239-0.243=-0.004
min1512.085-1512.087=-0.002
max1512.593-1512.613=-0.020
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean2.533-2.524=0.008
σ0.021-0.012=0.009
min2.510-2.509=0.000
max2.560-2.538=0.023
policies=200
mean15130.071-15130.183=-0.112
σ0.153-0.047=0.106
min15129.954-15130.131=-0.177
max15130.277-15130.240=0.037
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1627.000=12.000
σ0.000
min1639.000-1627.000=12.000
max1639.000-1627.000=12.000
mean25.592-25.603=-0.011
σ0.115-0.058=0.057
min25.450-25.525=-0.075
max25.687-25.661=0.026