Compare commits

Home / Compare 648d2de3 .. f2d63246

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.366-0.366=-0.000
min53.778-53.784=-0.006
max54.955-54.956=-0.001
mean414.300-415.000=-0.700
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.139-0.139=0.000
σ0.004-0.004=-0.000
min0.135-0.134=0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.139-43.141=-0.001
σ0.006-0.007=-0.000
min43.129-43.128=0.001
max43.149-43.151=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.119-0.121=-0.002
σ0.004-0.004=-0.000
min0.114-0.116=-0.001
max0.124-0.126=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.816-991.812=0.005
σ1.248-1.264=-0.016
min991.229-991.254=-0.024
max997.060-997.133=-0.073
mean1069.550-1063.400=6.150
σ318.762-322.216=-3.454
min615.000-568.000=47.000
max1632.000-1636.000=-4.000
mean1.531-1.552=-0.021
σ0.081-0.087=-0.007
min1.464-1.457=0.007
max1.818-1.766=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.414=-0.007
σ0.011-0.010=0.001
min285.392-285.397=-0.006
max285.421-285.422=-0.001
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean0.375-0.384=-0.010
σ0.002-0.009=-0.008
min0.373-0.376=-0.004
max0.376-0.396=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1285.372-1285.378=-0.005
σ0.132-0.140=-0.007
min1285.307-1285.307=0.000
max1285.609-1285.627=-0.018
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean1.890-1.948=-0.057
σ0.070-0.123=-0.052
min1.819-1.831=-0.012
max2.008-2.146=-0.138
iters=5
new-facts=6402
prior-facts=1
mean1807.725-1807.715=0.009
σ6.988-7.025=-0.037
min1804.314-1804.312=0.002
max1820.206-1820.265=-0.058
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean4.221-4.168=0.053
σ0.272-0.247=0.025
min3.861-3.816=0.045
max4.568-4.420=0.147
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.198=-0.003
σ0.010-0.006=0.004
min2070.185-2070.194=-0.009
max2070.207-2070.208=-0.000
mean1841.600-1835.800=5.800
σ191.980-174.150=17.830
min1632.000-1636.000=-4.000
max2086.000-2071.000=15.000
mean4.478-4.521=-0.043
σ0.084-0.034=0.050
min4.431-4.482=-0.051
max4.627-4.559=0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.240=0.005
σ0.366-0.272=0.095
min0.915-1.057=-0.143
max1.835-1.677=0.158

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.786=-0.001
σ572.359-572.360=-0.001
min150.600-150.600=-0.001
max1295.324-1295.326=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean0.535-0.530=0.004
σ0.555-0.559=-0.003
min0.252-0.248=0.005
max1.367-1.368=-0.001
policies=20
mean1506.265-1506.274=-0.009
σ0.254-0.252=0.002
min1506.097-1506.111=-0.014
max1506.643-1506.650=-0.007
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean2.527-2.528=-0.001
σ0.010-0.018=-0.008
min2.518-2.508=0.010
max2.538-2.548=-0.010
policies=200
mean15070.406-15070.368=0.038
σ0.056-0.058=-0.002
min15070.343-15070.314=0.028
max15070.474-15070.428=0.046
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1636.000=-4.000
σ0.000
min1632.000-1636.000=-4.000
max1632.000-1636.000=-4.000
mean25.432-25.551=-0.119
σ0.146-0.113=0.033
min25.301-25.432=-0.131
max25.626-25.683=-0.057