Compare commits

Home / Compare fd4f5c1f .. c99a2396

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.913=0.002
σ0.368-0.366=0.001
min53.788-53.778=0.009
max54.961-54.955=0.006
mean413.800-415.000=-1.200
σ0.422-0.000=0.422
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.139-0.135=0.004
σ0.004-0.005=-0.001
min0.135-0.130=0.005
max0.145-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.139-43.140=-0.001
σ0.005-0.006=-0.001
min43.131-43.132=-0.001
max43.147-43.152=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.119-0.121=-0.002
σ0.003-0.004=-0.000
min0.115-0.118=-0.003
max0.124-0.129=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-991.807=0.007
σ1.265-1.259=0.007
min991.229-991.237=-0.008
max997.139-997.107=0.032
mean1064.700-1067.700=-3.000
σ321.838-321.227=0.611
min568.000-571.000=-3.000
max1637.000-1634.000=3.000
mean1.567-1.536=0.032
σ0.134-0.080=0.054
min1.431-1.456=-0.026
max2.005-1.760=0.244

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.413=-0.002
σ0.011-0.010=0.000
min285.393-285.395=-0.001
max285.421-285.421=0.000
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean0.376-0.377=-0.001
σ0.008-0.006=0.002
min0.369-0.374=-0.005
max0.384-0.388=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.367-1285.356=0.011
σ0.120-0.096=0.024
min1285.308-1285.307=0.002
max1285.582-1285.528=0.054
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean1.842-1.884=-0.042
σ0.028-0.088=-0.060
min1.807-1.821=-0.013
max1.868-2.039=-0.171
iters=5
new-facts=6402
prior-facts=1
mean1807.731-1807.723=0.007
σ6.985-6.999=-0.014
min1804.349-1804.327=0.022
max1820.208-1820.228=-0.020
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean4.259-4.266=-0.008
σ0.273-0.313=-0.041
min3.803-3.796=0.007
max4.529-4.626=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.195=0.001
σ0.010-0.007=0.003
min2070.184-2070.189=-0.006
max2070.208-2070.208=0.001
mean1847.800-1857.400=-9.600
σ175.952-209.782=-33.829
min1637.000-1634.000=3.000
max2093.000-2094.000=-1.000
mean4.515-4.623=-0.109
σ0.119-0.206=-0.087
min4.425-4.421=0.004
max4.649-4.906=-0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.281-1.175=0.107
σ0.336-0.242=0.094
min0.908-0.915=-0.007
max1.716-1.549=0.166

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.789-436.787=0.002
σ572.361-572.364=-0.004
min150.600-150.600=-0.000
max1295.330-1295.333=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean0.515-0.528=-0.013
σ0.530-0.559=-0.029
min0.249-0.247=0.001
max1.310-1.366=-0.057
policies=20
mean1506.258-1506.265=-0.007
σ0.222-0.231=-0.009
min1506.112-1506.113=-0.001
max1506.589-1506.609=-0.021
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean2.500-2.508=-0.008
σ0.009-0.014=-0.005
min2.489-2.491=-0.002
max2.510-2.526=-0.016
policies=200
mean15070.386-15070.330=0.057
σ0.041-0.039=0.002
min15070.354-15070.274=0.080
max15070.442-15070.363=0.078
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1634.000=3.000
σ0.000
min1637.000-1634.000=3.000
max1637.000-1634.000=3.000
mean25.466-25.476=-0.010
σ0.083-0.035=0.047
min25.382-25.428=-0.046
max25.562-25.513=0.049