Compare commits

Home / Compare be464c71 .. 0a9e0416

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.913=0.000
σ0.365-0.368=-0.003
min53.782-53.786=-0.004
max54.952-54.961=-0.008
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.138-0.138=0.000
σ0.005-0.005=0.000
min0.130-0.131=-0.001
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.142-43.140=0.002
σ0.006-0.004=0.002
min43.131-43.136=-0.006
max43.151-43.146=0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.120=0.002
σ0.004-0.003=0.001
min0.118-0.115=0.003
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.815-992.081=-0.267
σ1.244-1.236=0.008
min991.230-991.497=-0.267
max997.041-997.271=-0.230
mean1068.700-1067.300=1.400
σ315.171-315.302=-0.130
min623.000-604.000=19.000
max1640.000-1584.000=56.000
mean1.538-1.540=-0.002
σ0.095-0.077=0.018
min1.388-1.467=-0.078
max1.782-1.784=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.416-285.654=-0.238
σ0.016-0.009=0.007
min285.395-285.642=-0.247
max285.432-285.667=-0.235
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean0.383-0.379=0.004
σ0.009-0.004=0.005
min0.373-0.375=-0.002
max0.393-0.385=0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1285.640=-0.262
σ0.130-0.125=0.005
min1285.316-1285.573=-0.257
max1285.611-1285.863=-0.252
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean1.986-1.912=0.074
σ0.167-0.070=0.097
min1.830-1.840=-0.010
max2.216-2.020=0.196
iters=5
new-facts=6402
prior-facts=1
mean1807.708-1807.965=-0.256
σ6.973-7.021=-0.048
min1804.326-1804.573=-0.246
max1820.166-1820.509=-0.343
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean4.150-4.208=-0.057
σ0.205-0.319=-0.114
min3.826-3.832=-0.006
max4.325-4.644=-0.319
iters=5
new-facts=6402
prior-facts=6402
mean2070.205-2070.465=-0.259
σ0.034-0.008=0.027
min2070.177-2070.460=-0.283
max2070.263-2070.479=-0.215
mean1816.800-1843.800=-27.000
σ155.283-181.237=-25.954
min1640.000-1616.000=24.000
max1971.000-2091.000=-120.000
mean4.760-4.486=0.273
σ0.370-0.031=0.339
min4.346-4.445=-0.099
max5.200-4.530=0.670

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.269=-0.079
σ0.244-0.368=-0.124
min0.908-0.905=0.003
max1.554-1.673=-0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-437.383=-0.597
σ572.357-572.359=-0.002
min150.596-151.192=-0.596
max1295.322-1295.922=-0.600
mean90.250
σ8.500
min86.000
max103.000
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean0.542-0.534=0.008
σ0.586-0.558=0.027
min0.246-0.251=-0.005
max1.421-1.372=0.049
policies=20
mean1506.251-1512.189=-5.938
σ0.234-0.255=-0.020
min1506.100-1512.025=-5.924
max1506.600-1512.569=-5.968
mean860.000
σ0.000
min860.000
max860.000
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean2.512-2.533=-0.022
σ0.013-0.017=-0.003
min2.495-2.518=-0.023
max2.527-2.554=-0.026
policies=200
mean15070.274-15129.614=-59.341
σ0.134-0.094=0.040
min15070.184-15129.517=-59.333
max15070.471-15129.713=-59.242
mean8600.000
σ0.000
min8600.000
max8600.000
mean1640.000-1584.000=56.000
σ0.000
min1640.000-1584.000=56.000
max1640.000-1584.000=56.000
mean25.382-25.684=-0.302
σ0.097-0.103=-0.006
min25.276-25.593=-0.316
max25.481-25.796=-0.315