Compare commits

Home / Compare d9fba2cd .. 6181bcfe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.364-0.367=-0.003
min53.782-53.785=-0.003
max54.950-54.959=-0.009
mean414.300-413.000=1.300
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.136-0.137=-0.002
σ0.004-0.004=-0.000
min0.130-0.132=-0.002
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.144-43.142=0.002
σ0.013-0.006=0.007
min43.130-43.130=0.000
max43.177-43.152=0.025
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.121-0.121=0.000
σ0.005-0.004=0.000
min0.118-0.114=0.003
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.811=-0.012
σ1.235-1.272=-0.037
min991.251-991.226=0.025
max997.001-997.168=-0.168
mean1071.150-1063.950=7.200
σ328.071-322.950=5.121
min568.000-566.000=2.000
max1643.000-1636.000=7.000
mean1.521-1.542=-0.022
σ0.065-0.092=-0.027
min1.452-1.417=0.035
max1.727-1.786=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.389=0.024
σ0.012-0.009=0.002
min285.393-285.377=0.016
max285.423-285.400=0.022
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean0.379-0.382=-0.002
σ0.007-0.012=-0.005
min0.374-0.374=-0.001
max0.389-0.402=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.373=0.002
σ0.135-0.133=0.003
min1285.307-1285.303=0.003
max1285.617-1285.610=0.007
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean1.937-1.858=0.079
σ0.112-0.023=0.089
min1.829-1.842=-0.013
max2.104-1.899=0.204
iters=5
new-facts=6402
prior-facts=1
mean1807.743-1807.743=0.000
σ6.987-6.958=0.029
min1804.396-1804.355=0.041
max1820.226-1820.178=0.048
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean4.269-4.290=-0.021
σ0.145-0.299=-0.153
min4.127-4.085=0.042
max4.491-4.766=-0.275
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.194=0.001
σ0.011-0.015=-0.005
min2070.183-2070.176=0.007
max2070.212-2070.216=-0.004
mean1842.800-1850.600=-7.800
σ178.595-208.260=-29.665
min1643.000-1636.000=7.000
max2078.000-2088.000=-10.000
mean4.506-4.560=-0.054
σ0.041-0.281=-0.240
min4.461-4.408=0.054
max4.559-5.062=-0.502

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.192=0.015
σ0.318-0.233=0.085
min0.910-0.908=0.002
max1.706-1.523=0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.001
σ572.364-572.363=0.001
min150.596-150.599=-0.003
max1295.331-1295.329=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean0.518-0.521=-0.003
σ0.536-0.538=-0.002
min0.250-0.248=0.001
max1.322-1.328=-0.006
policies=20
mean1506.250-1506.269=-0.019
σ0.239-0.235=0.003
min1506.091-1506.115=-0.024
max1506.605-1506.619=-0.014
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean2.513-2.516=-0.003
σ0.017-0.003=0.013
min2.496-2.513=-0.017
max2.532-2.520=0.012
policies=200
mean15070.321-15070.360=-0.039
σ0.092-0.047=0.045
min15070.266-15070.304=-0.037
max15070.459-15070.419=0.041
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1636.000=7.000
σ0.000
min1643.000-1636.000=7.000
max1643.000-1636.000=7.000
mean25.521-25.520=0.000
σ0.203-0.087=0.116
min25.338-25.449=-0.111
max25.784-25.639=0.145