Compare commits

Home / Compare 1d7bbd61 .. cd712238

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.646=0.002
σ0.366-0.366=0.000
min53.518-53.510=0.008
max54.690-54.688=0.002
mean412.000-419.000=-7.000
σ0.000
min412.000-419.000=-7.000
max412.000-419.000=-7.000
mean0.141-0.137=0.004
σ0.004-0.004=-0.000
min0.137-0.131=0.006
max0.149-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean42.945-42.941=0.004
σ0.011-0.006=0.006
min42.935-42.933=0.002
max42.974-42.952=0.022
mean412.800-419.000=-6.200
σ0.422-0.000=0.422
min412.000-419.000=-7.000
max413.000-419.000=-6.000
mean0.121-0.119=0.003
σ0.004-0.004=-0.000
min0.118-0.114=0.004
max0.128-0.124=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.800-991.811=-0.011
σ1.253-1.232=0.021
min991.240-991.223=0.017
max997.076-996.982=0.094
mean1065.700-1067.800=-2.100
σ318.475-318.343=0.132
min566.000-609.000=-43.000
max1649.000-1641.000=8.000
mean1.549-1.507=0.042
σ0.132-0.076=0.056
min1.460-1.424=0.036
max2.004-1.756=0.247

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.391-285.388=0.003
σ0.015-0.009=0.006
min285.368-285.375=-0.007
max285.405-285.396=0.009
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean0.379-0.376=0.003
σ0.006-0.002=0.005
min0.374-0.374=-0.000
max0.390-0.378=0.012
iters=5
new-facts=1
prior-facts=6402
mean1285.352-1285.357=-0.005
σ0.126-0.136=-0.010
min1285.289-1285.287=0.002
max1285.577-1285.600=-0.022
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean2.016-1.930=0.086
σ0.235-0.117=0.117
min1.834-1.789=0.045
max2.372-2.075=0.297
iters=5
new-facts=6402
prior-facts=1
mean1807.674-1807.730=-0.055
σ7.014-6.992=0.022
min1804.310-1804.381=-0.071
max1820.206-1820.221=-0.016
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean4.146-4.299=-0.153
σ0.183-0.170=0.013
min3.858-4.129=-0.271
max4.356-4.512=-0.156
iters=5
new-facts=6402
prior-facts=6402
mean2070.176-2070.180=-0.004
σ0.010-0.009=0.000
min2070.164-2070.173=-0.009
max2070.189-2070.197=-0.008
mean1833.400-1859.000=-25.600
σ165.920-197.242=-31.323
min1649.000-1641.000=8.000
max2067.000-2086.000=-19.000
mean4.522-4.533=-0.012
σ0.039-0.083=-0.043
min4.465-4.445=0.020
max4.566-4.653=-0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.328-1.146=0.181
σ0.322-0.213=0.110
min0.919-0.916=0.003
max1.759-1.470=0.289

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.777-436.769=0.007
σ572.355-572.347=0.007
min150.593-150.591=0.002
max1295.309-1295.290=0.018
mean90.250
σ8.500
min86.000
max103.000
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean0.526-0.528=-0.002
σ0.550-0.554=-0.004
min0.249-0.251=-0.001
max1.351-1.358=-0.008
policies=20
mean1506.188-1506.168=0.021
σ0.249-0.233=0.016
min1506.024-1506.008=0.016
max1506.559-1506.514=0.045
mean860.000
σ0.000
min860.000
max860.000
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean2.532-2.512=0.020
σ0.038-0.015=0.022
min2.507-2.492=0.015
max2.588-2.527=0.061
policies=200
mean15069.578-15069.489=0.089
σ0.036-0.125=-0.089
min15069.545-15069.360=0.185
max15069.625-15069.615=0.011
mean8600.000
σ0.000
min8600.000
max8600.000
mean1649.000-1641.000=8.000
σ0.000
min1649.000-1641.000=8.000
max1649.000-1641.000=8.000
mean25.644-25.541=0.103
σ0.171-0.184=-0.013
min25.482-25.382=0.100
max25.829-25.772=0.057