Compare commits

Home / Compare 3a2db688 .. 7bfca93b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.913=0.002
σ0.367-0.368=-0.001
min53.788-53.782=0.006
max54.959-54.959=0.000
mean414.000-412.300=1.700
σ0.000-0.483=-0.483
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.137-0.135=0.002
σ0.005-0.004=0.000
min0.131-0.129=0.002
max0.145-0.141=0.004
cache=y
dps=1
iters=10
policies=100
mean43.140-43.142=-0.001
σ0.005-0.006=-0.001
min43.135-43.133=0.002
max43.148-43.154=-0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.121-0.122=-0.000
σ0.004-0.003=0.001
min0.118-0.118=0.000
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.074-992.081=-0.007
σ1.250-1.261=-0.011
min991.492-991.496=-0.005
max997.334-997.384=-0.050
mean1068.350-1068.050=0.300
σ323.522-323.948=-0.425
min570.000-580.000=-10.000
max1636.000
mean1.517-1.529=-0.012
σ0.066-0.059=0.006
min1.418-1.462=-0.044
max1.634-1.698=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.646-285.674=-0.028
σ0.009-0.009=-0.000
min285.634-285.660=-0.025
max285.657-285.683=-0.025
mean1636.000
σ0.000
min1636.000
max1636.000
mean0.376-0.375=0.001
σ0.001-0.001=0.000
min0.375-0.374=0.001
max0.377-0.376=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.633-1285.630=0.003
σ0.118-0.105=0.013
min1285.575-1285.580=-0.005
max1285.843-1285.817=0.026
mean1636.000
σ0.000
min1636.000
max1636.000
mean1.962-2.094=-0.132
σ0.212-0.198=0.015
min1.812-1.872=-0.060
max2.331-2.412=-0.081
iters=5
new-facts=6402
prior-facts=1
mean1807.979-1807.986=-0.007
σ7.005-7.005=-0.000
min1804.594-1804.602=-0.008
max1820.495-1820.501=-0.006
mean1636.000
σ0.000
min1636.000
max1636.000
mean4.286-4.221=0.065
σ0.265-0.198=0.067
min3.967-3.976=-0.009
max4.524-4.440=0.084
iters=5
new-facts=6402
prior-facts=6402
mean2070.465-2070.462=0.003
σ0.010-0.011=-0.001
min2070.455-2070.452=0.004
max2070.482-2070.479=0.003
mean1860.600-1835.200=25.400
σ199.759-185.900=13.860
min1636.000
max2090.000-2092.000=-2.000
mean4.568-4.504=0.064
σ0.117-0.118=-0.002
min4.434-4.362=0.072
max4.731-4.688=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.233=-0.033
σ0.307-0.350=-0.043
min0.916-0.907=0.009
max1.710-1.792=-0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.381-437.385=-0.004
σ572.364-572.359=0.005
min151.198-151.195=0.003
max1295.927-1295.923=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1636.000
σ0.000
min1636.000
max1636.000
mean0.521-0.531=-0.010
σ0.528-0.553=-0.025
min0.255-0.249=0.006
max1.313-1.360=-0.047
policies=20
mean1512.196-1512.196=0.001
σ0.254-0.248=0.006
min1512.029-1512.036=-0.007
max1512.574-1512.565=0.009
mean860.000
σ0.000
min860.000
max860.000
mean1636.000
σ0.000
min1636.000
max1636.000
mean2.534-2.523=0.011
σ0.011-0.008=0.003
min2.518-2.516=0.002
max2.544-2.534=0.010
policies=200
mean15129.637-15129.736=-0.099
σ0.100-0.066=0.034
min15129.515-15129.645=-0.130
max15129.720-15129.801=-0.081
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000
σ0.000
min1636.000
max1636.000
mean25.655-25.669=-0.015
σ0.097-0.184=-0.087
min25.564-25.505=0.058
max25.766-25.883=-0.117