Compare commits

Home / Compare 5a1ba3e4 .. 8a6b70b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.646=0.002
σ0.367-0.366=0.000
min53.524-53.510=0.014
max54.692-54.688=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.138-0.137=0.000
σ0.004-0.005=-0.001
min0.130-0.133=-0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.944-42.942=0.002
σ0.007-0.006=0.001
min42.935-42.932=0.002
max42.955-42.952=0.003
mean414.400-413.000=1.400
σ0.516-0.000=0.516
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.121-0.118=0.003
σ0.005-0.001=0.004
min0.115-0.117=-0.002
max0.129-0.120=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.799=0.004
σ1.271-1.250=0.021
min991.250-991.234=0.016
max997.155-997.062=0.093
mean1064.550-1063.650=0.900
σ321.237-322.894=-1.658
min568.000-565.000=3.000
max1632.000-1639.000=-7.000
mean1.526-1.522=0.004
σ0.132-0.084=0.047
min1.362-1.439=-0.078
max1.822-1.724=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.393=-0.001
σ0.007-0.013=-0.005
min285.386-285.372=0.014
max285.401-285.405=-0.003
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean0.382-0.378=0.004
σ0.007-0.008=-0.001
min0.373-0.374=-0.000
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.347=0.006
σ0.131-0.107=0.023
min1285.286-1285.290=-0.004
max1285.586-1285.538=0.048
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean1.964-2.002=-0.038
σ0.143-0.254=-0.112
min1.829-1.773=0.056
max2.151-2.381=-0.230
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.690=0.000
σ6.973-7.001=-0.028
min1804.359-1804.333=0.026
max1820.148-1820.199=-0.051
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean4.140-4.187=-0.047
σ0.070-0.200=-0.130
min4.064-3.861=0.203
max4.206-4.385=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.176=0.002
σ0.018-0.010=0.008
min2070.167-2070.168=-0.001
max2070.211-2070.193=0.017
mean1855.800-1837.000=18.800
σ199.416-169.663=29.753
min1632.000-1639.000=-7.000
max2084.000-2073.000=11.000
mean4.485-4.557=-0.071
σ0.083-0.127=-0.044
min4.407-4.459=-0.052
max4.581-4.776=-0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.162=0.013
σ0.243-0.277=-0.034
min0.917-0.894=0.023
max1.516-1.553=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.772=0.002
σ572.360-572.360=0.000
min150.588-150.587=0.002
max1295.314-1295.311=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean0.518-0.545=-0.027
σ0.538-0.579=-0.041
min0.245-0.249=-0.004
max1.325-1.413=-0.088
policies=20
mean1506.177-1506.159=0.018
σ0.226-0.220=0.006
min1506.029-1506.016=0.014
max1506.514-1506.488=0.027
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean2.500-2.493=0.007
σ0.030-0.029=0.001
min2.475-2.456=0.019
max2.535-2.528=0.007
policies=200
mean15069.481-15069.480=0.001
σ0.096-0.100=-0.004
min15069.396-15069.397=-0.001
max15069.616-15069.597=0.019
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1639.000=-7.000
σ0.000
min1632.000-1639.000=-7.000
max1632.000-1639.000=-7.000
mean25.422-25.394=0.028
σ0.090-0.087=0.003
min25.290-25.311=-0.020
max25.486-25.491=-0.005