Compare commits

Home / Compare 1123f40f .. d3d4bf8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.649=-0.001
σ0.368-0.364=0.004
min53.518-53.521=-0.004
max54.694-54.685=0.009
mean416.000-418.600=-2.600
σ0.000-0.516=-0.516
min416.000-418.000=-2.000
max416.000-419.000=-3.000
mean0.140-0.140=-0.000
σ0.005-0.004=0.001
min0.134-0.136=-0.002
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean42.942-42.941=0.000
σ0.006-0.006=0.001
min42.931-42.933=-0.003
max42.951-42.953=-0.002
mean416.800-419.000=-2.200
σ0.422-0.000=0.422
min416.000-419.000=-3.000
max417.000-419.000=-2.000
mean0.119-0.121=-0.003
σ0.005-0.003=0.002
min0.114-0.119=-0.005
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.857-991.864=-0.007
σ1.221-1.210=0.012
min991.266-991.331=-0.064
max996.975-996.929=0.046
mean1072.400-1059.850=12.550
σ318.050-313.143=4.907
min608.000-592.000=16.000
max1636.000-1534.000=102.000
mean1.513-1.516=-0.003
σ0.059-0.061=-0.001
min1.459-1.453=0.006
max1.702-1.648=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.439-285.436=0.003
σ0.014-0.012=0.002
min285.417-285.423=-0.006
max285.453-285.451=0.002
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean0.382-0.379=0.004
σ0.008-0.005=0.003
min0.376-0.375=0.000
max0.397-0.388=0.009
iters=5
new-facts=1
prior-facts=6402
mean1285.511-1285.465=0.046
σ0.090-0.073=0.017
min1285.355-1285.357=-0.002
max1285.581-1285.537=0.044
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean2.003-1.883=0.119
σ0.274-0.181=0.093
min1.813-1.687=0.126
max2.487-2.170=0.317
iters=5
new-facts=6402
prior-facts=1
mean1705.831-1705.829=0.002
σ6.860-6.849=0.010
min1702.647-1702.644=0.003
max1718.100-1718.078=0.021
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean2.962-2.913=0.049
σ0.175-0.258=-0.083
min2.781-2.560=0.222
max3.236-3.177=0.059
iters=5
new-facts=6402
prior-facts=6402
mean1968.407-1968.451=-0.044
σ0.044-0.015=0.029
min1968.335-1968.436=-0.101
max1968.437-1968.471=-0.034
mean1776.600-1855.200=-78.600
σ145.117-233.318=-88.201
min1636.000-1567.000=69.000
max1974.000-2139.000=-165.000
mean3.142-3.264=-0.122
σ0.109-0.112=-0.003
min3.074-3.148=-0.074
max3.335-3.429=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.133-1.533=-0.400
σ0.227-0.232=-0.004
min0.900-1.231=-0.330
max1.486-1.836=-0.350

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.770-436.769=0.000
σ572.348-572.351=-0.003
min150.590-150.587=0.002
max1295.292-1295.296=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean0.525-0.533=-0.008
σ0.545-0.558=-0.013
min0.251-0.251=-0.000
max1.342-1.369=-0.027
policies=20
mean1506.198-1506.155=0.043
σ0.247-0.245=0.003
min1506.041-1505.990=0.051
max1506.567-1506.518=0.049
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean2.539-2.525=0.015
σ0.035-0.018=0.017
min2.514-2.502=0.012
max2.591-2.540=0.051
policies=200
mean15069.449-15069.474=-0.025
σ0.139-0.115=0.024
min15069.336-15069.367=-0.032
max15069.629-15069.594=0.035
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1534.000=102.000
σ0.000
min1636.000-1534.000=102.000
max1636.000-1534.000=102.000
mean25.568-25.490=0.078
σ0.070-0.114=-0.044
min25.494-25.387=0.107
max25.630-25.619=0.011