Compare commits

Home / Compare 10552b55 .. cd06540a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.912=0.004
σ0.365-0.368=-0.003
min53.786-53.782=0.003
max54.955-54.959=-0.004
mean415.100-416.000=-0.900
σ0.316-0.000=0.316
min415.000-416.000=-1.000
max416.000
mean0.149-0.136=0.013
σ0.012-0.005=0.006
min0.136-0.129=0.007
max0.166-0.146=0.020
cache=y
dps=1
iters=10
policies=100
mean43.146-43.141=0.005
σ0.009-0.007=0.002
min43.138-43.132=0.006
max43.163-43.154=0.009
mean416.000
σ0.000
min416.000
max416.000
mean0.134-0.122=0.013
σ0.010-0.003=0.007
min0.120-0.118=0.002
max0.147-0.127=0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.816-991.814=0.001
σ1.245-1.260=-0.016
min991.230-991.247=-0.017
max997.046-997.119=-0.073
mean1071.400-1070.700=0.700
σ314.054-327.299=-13.244
min617.000-568.000=49.000
max1647.000-1644.000=3.000
mean1.511-1.546=-0.035
σ0.039-0.148=-0.109
min1.454-1.361=0.093
max1.587-2.027=-0.440

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.410=-0.000
σ0.014-0.011=0.003
min285.390-285.392=-0.003
max285.425-285.420=0.005
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.377-0.378=-0.001
σ0.006-0.006=0.001
min0.373-0.373=-0.000
max0.388-0.387=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.341-1285.370=-0.029
σ0.058-0.121=-0.063
min1285.307-1285.310=-0.004
max1285.444-1285.586=-0.142
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean1.923-1.833=0.090
σ0.180-0.023=0.157
min1.744-1.808=-0.064
max2.146-1.869=0.277
iters=5
new-facts=6402
prior-facts=1
mean1807.732-1807.707=0.025
σ6.979-7.026=-0.047
min1804.356-1804.345=0.011
max1820.201-1820.261=-0.060
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean4.297-4.213=0.084
σ0.418-0.270=0.148
min3.878-3.904=-0.026
max4.987-4.513=0.473
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.192=0.004
σ0.009-0.005=0.005
min2070.189-2070.186=0.003
max2070.212-2070.197=0.015
mean1845.400-1867.000=-21.600
σ177.981-199.295=-21.314
min1647.000-1644.000=3.000
max2080.000-2095.000=-15.000
mean4.502-4.519=-0.017
σ0.067-0.116=-0.048
min4.439-4.424=0.015
max4.615-4.674=-0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.135-1.202=-0.066
σ0.252-0.247=0.005
min0.912-1.046=-0.134
max1.465-1.622=-0.157

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.783-436.790=-0.007
σ572.354-572.364=-0.010
min150.595-150.599=-0.003
max1295.314-1295.337=-0.023
mean90.250
σ8.500
min86.000
max103.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.528-0.557=-0.029
σ0.558-0.596=-0.038
min0.247-0.256=-0.009
max1.365-1.451=-0.086
policies=20
mean1506.246-1506.271=-0.026
σ0.232-0.233=-0.002
min1506.097-1506.120=-0.024
max1506.591-1506.619=-0.028
mean860.000
σ0.000
min860.000
max860.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean2.508-2.516=-0.008
σ0.016-0.022=-0.006
min2.494-2.487=0.007
max2.530-2.537=-0.007
policies=200
mean15070.313-15070.372=-0.059
σ0.123-0.045=0.078
min15070.178-15070.323=-0.146
max15070.419-15070.425=-0.006
mean8600.000
σ0.000
min8600.000
max8600.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean25.442-25.474=-0.032
σ0.161-0.129=0.031
min25.282-25.358=-0.076
max25.611-25.619=-0.008