Compare commits

Home / Compare 14384b40 .. 3c76d004

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.915=-0.002
σ0.367-0.368=-0.001
min53.784-53.775=0.009
max54.957-54.961=-0.004
mean416.300-418.000=-1.700
σ0.483-0.000=0.483
min416.000-418.000=-2.000
max417.000-418.000=-1.000
mean0.136-0.140=-0.004
σ0.004-0.004=0.001
min0.130-0.137=-0.008
max0.145-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.007-0.007=-0.000
min43.131-43.129=0.002
max43.155-43.152=0.003
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.122-0.122=-0.000
σ0.004-0.003=0.000
min0.116-0.118=-0.002
max0.127-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-991.804=0.007
σ1.269-1.252=0.017
min991.253-991.256=-0.003
max997.153-997.076=0.077
mean1066.450-1067.450=-1.000
σ322.216-321.795=0.421
min570.000
max1641.000-1640.000=1.000
mean1.528-1.551=-0.023
σ0.084-0.100=-0.016
min1.394-1.458=-0.063
max1.758-1.775=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.411=-0.001
σ0.011-0.008=0.003
min285.392-285.398=-0.005
max285.417-285.417=0.000
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean0.378-0.378=-0.000
σ0.008-0.007=0.001
min0.374-0.371=0.002
max0.392-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.374=0.001
σ0.135-0.132=0.003
min1285.307-1285.306=0.000
max1285.616-1285.610=0.006
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean1.875-1.913=-0.037
σ0.059-0.112=-0.053
min1.829-1.831=-0.002
max1.976-2.105=-0.129
iters=5
new-facts=6402
prior-facts=1
mean1807.705-1807.703=0.002
σ7.014-7.010=0.004
min1804.343-1804.338=0.004
max1820.236-1820.227=0.010
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean4.179-4.181=-0.002
σ0.188-0.183=0.005
min3.976-3.910=0.066
max4.483-4.420=0.063
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.196=-0.001
σ0.012-0.012=-0.000
min2070.183-2070.185=-0.001
max2070.215-2070.216=-0.001
mean1850.400-1838.400=12.000
σ174.552-169.754=4.798
min1641.000-1640.000=1.000
max2094.000-2074.000=20.000
mean4.495-4.527=-0.032
σ0.080-0.031=0.049
min4.437-4.477=-0.040
max4.631-4.556=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.152-1.229=-0.077
σ0.266-0.243=0.023
min0.895-0.889=0.006
max1.585-1.573=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.785=-0.003
σ572.360-572.362=-0.001
min150.596-150.595=0.001
max1295.323-1295.328=-0.005
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean0.532-0.505=0.027
σ0.558-0.512=0.046
min0.250-0.245=0.005
max1.369-1.274=0.096
policies=20
mean1506.251-1506.245=0.006
σ0.225-0.248=-0.022
min1506.101-1506.076=0.025
max1506.586-1506.613=-0.026
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean2.501-2.525=-0.024
σ0.030-0.013=0.017
min2.465-2.511=-0.046
max2.538-2.538=0.000
policies=200
mean15070.369-15070.266=0.103
σ0.081-0.082=-0.001
min15070.295-15070.155=0.141
max15070.468-15070.349=0.120
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1640.000=1.000
σ0.000
min1641.000-1640.000=1.000
max1641.000-1640.000=1.000
mean25.460-25.486=-0.026
σ0.095-0.057=0.038
min25.359-25.407=-0.049
max25.582-25.538=0.044