Compare commits

Home / Compare 1d628b04 .. f9e21563

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1449.380-1449.376=0.003
σ0.407-0.405=0.002
min1449.211-1449.203=0.008
max1450.524-1450.512=0.012
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean2.257-2.261=-0.004
σ0.025-0.016=0.009
min2.206-2.231=-0.025
max2.287-2.282=0.005
cache=y
dps=1
iters=10
policies=100
mean1438.539-1438.539=0.000
σ0.011-0.015=-0.004
min1438.521-1438.518=0.002
max1438.560-1438.564=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean2.240-2.243=-0.003
σ0.029-0.021=0.008
min2.189-2.212=-0.023
max2.275-2.268=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1032.000-1031.996=0.005
σ1.125-1.126=-0.001
min1031.480-1031.450=0.030
max1036.721-1036.719=0.002
mean1058.650-1056.550=2.100
σ322.917-323.259=-0.342
min564.000-557.000=7.000
max1630.000-1628.000=2.000
mean1.541-1.599=-0.058
σ0.090-0.150=-0.060
min1.467-1.494=-0.027
max1.779-2.087=-0.309

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean399.348-399.323=0.025
σ0.089-0.075=0.014
min399.225-399.226=-0.001
max399.416-399.379=0.037
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean0.500-0.499=0.001
σ0.011-0.008=0.003
min0.492-0.493=-0.000
max0.515-0.511=0.004
iters=5
new-facts=1
prior-facts=6402
mean1400.842-1400.875=-0.033
σ0.018-0.045=-0.027
min1400.825-1400.837=-0.011
max1400.872-1400.935=-0.063
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean2.055-2.192=-0.137
σ0.051-0.271=-0.220
min2.009-1.993=0.016
max2.120-2.574=-0.455
iters=5
new-facts=6402
prior-facts=1
mean1923.082-1923.080=0.002
σ7.070-7.088=-0.017
min1919.774-1919.820=-0.045
max1935.724-1935.756=-0.032
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean4.300-4.372=-0.072
σ0.263-0.434=-0.170
min4.061-4.003=0.058
max4.635-5.103=-0.468
iters=5
new-facts=6402
prior-facts=6402
mean2185.753-2185.769=-0.016
σ0.009-0.057=-0.048
min2185.746-2185.694=0.052
max2185.768-2185.838=-0.070
mean1836.600-1796.400=40.200
σ172.726-170.594=2.132
min1630.000-1628.000=2.000
max2077.000-2041.000=36.000
mean4.689-4.728=-0.038
σ0.040-0.268=-0.228
min4.637-4.553=0.084
max4.739-5.203=-0.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.297-1.225=0.072
σ0.468-0.231=0.237
min0.910-1.040=-0.130
max1.874-1.623=0.251

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean458.934-458.938=-0.004
σ572.887-572.883=0.003
min172.488-172.494=-0.007
max1318.265-1318.263=0.001
mean98.250
σ8.500
min94.000
max111.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean0.564-0.574=-0.010
σ0.550-0.557=-0.007
min0.280-0.287=-0.007
max1.389-1.409=-0.021
policies=20
mean1725.170-1725.173=-0.003
σ0.404-0.413=-0.008
min1724.886-1724.864=0.022
max1725.762-1725.773=-0.011
mean940.000
σ0.000
min940.000
max940.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean2.832-2.851=-0.019
σ0.018-0.034=-0.016
min2.816-2.819=-0.003
max2.853-2.898=-0.045
policies=200
mean17259.538-17259.569=-0.031
σ0.118-0.126=-0.008
min17259.383-17259.428=-0.046
max17259.657-17259.733=-0.076
mean9400.000
σ0.000
min9400.000
max9400.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean28.628-28.703=-0.076
σ0.127-0.182=-0.055
min28.465-28.515=-0.050
max28.753-28.924=-0.172