Compare commits

Home / Compare 798b71f3 .. c6ff42a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1449.380-1449.379=0.001
σ0.409-0.406=0.003
min1449.201-1449.210=-0.008
max1450.528-1450.520=0.008
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean2.273-2.271=0.002
σ0.032-0.014=0.018
min2.232-2.247=-0.015
max2.350-2.293=0.057
cache=y
dps=1
iters=10
policies=100
mean1438.541-1438.539=0.002
σ0.015-0.013=0.002
min1438.519-1438.512=0.007
max1438.572-1438.554=0.018
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean2.236-2.256=-0.020
σ0.034-0.044=-0.010
min2.159-2.162=-0.004
max2.271-2.334=-0.063

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1031.999-1031.998=0.001
σ1.113-1.134=-0.021
min1031.482-1031.430=0.052
max1036.671-1036.754=-0.083
mean1056.700-1055.500=1.200
σ309.173-318.685=-9.513
min614.000-560.000=54.000
max1618.000-1569.000=49.000
mean1.557-1.562=-0.005
σ0.083-0.102=-0.018
min1.482-1.474=0.008
max1.759-1.909=-0.151

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean399.351-399.354=-0.003
σ0.088-0.089=-0.001
min399.224-399.223=0.001
max399.421-399.418=0.002
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean0.497-0.495=0.002
σ0.011-0.005=0.006
min0.489-0.492=-0.003
max0.516-0.503=0.012
iters=5
new-facts=1
prior-facts=6402
mean1400.843-1400.855=-0.012
σ0.023-0.031=-0.008
min1400.832-1400.835=-0.004
max1400.885-1400.907=-0.022
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean2.035-2.178=-0.143
σ0.096-0.235=-0.138
min1.964-2.043=-0.079
max2.201-2.595=-0.394
iters=5
new-facts=6402
prior-facts=1
mean1923.085-1923.095=-0.010
σ7.090-7.043=0.048
min1919.804-1919.813=-0.009
max1935.765-1935.687=0.078
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean4.470-4.361=0.109
σ0.326-0.153=0.172
min4.016-4.165=-0.148
max4.887-4.567=0.320
iters=5
new-facts=6402
prior-facts=6402
mean2185.759-2185.756=0.003
σ0.015-0.017=-0.002
min2185.747-2185.740=0.007
max2185.782-2185.785=-0.003
mean1823.600-1841.200=-17.600
σ171.363-232.977=-61.614
min1618.000-1569.000=49.000
max2060.000-2131.000=-71.000
mean4.676-4.707=-0.032
σ0.107-0.060=0.047
min4.565-4.642=-0.077
max4.840-4.774=0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.343=-0.154
σ0.373-0.393=-0.021
min0.911-0.942=-0.031
max1.814-1.791=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean458.942-458.939=0.003
σ572.889-572.886=0.004
min172.489-172.489=0.001
max1318.276-1318.268=0.008
mean98.250
σ8.500
min94.000
max111.000
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean0.560-0.577=-0.017
σ0.529-0.560=-0.031
min0.294-0.296=-0.002
max1.353-1.417=-0.064
policies=20
mean1725.194-1725.196=-0.003
σ0.400-0.408=-0.008
min1724.906-1724.907=-0.000
max1725.776-1725.790=-0.014
mean940.000
σ0.000
min940.000
max940.000
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean2.832-2.862=-0.029
σ0.019-0.016=0.003
min2.813-2.850=-0.037
max2.854-2.885=-0.031
policies=200
mean17259.578-17259.593=-0.015
σ0.129-0.088=0.042
min17259.426-17259.523=-0.097
max17259.742-17259.721=0.020
mean9400.000
σ0.000
min9400.000
max9400.000
mean1618.000-1569.000=49.000
σ0.000
min1618.000-1569.000=49.000
max1618.000-1569.000=49.000
mean28.639-28.761=-0.122
σ0.086-0.196=-0.110
min28.574-28.595=-0.022
max28.765-29.044=-0.279