Compare commits

Home / Compare be8e8fd1 .. 4a9dac5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.367-0.367=0.001
min53.776-53.779=-0.004
max54.958-54.957=0.001
mean419.800-415.000=4.800
σ0.422-0.000=0.422
min419.000-415.000=4.000
max420.000-415.000=5.000
mean0.137-0.139=-0.002
σ0.004-0.004=0.001
min0.131-0.135=-0.005
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.000
σ0.006-0.007=-0.001
min43.134-43.131=0.003
max43.150-43.155=-0.006
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.119-0.120=-0.002
σ0.004-0.003=0.001
min0.112-0.117=-0.005
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.809=-0.010
σ1.240-1.232=0.008
min991.254-991.232=0.022
max997.020-996.989=0.031
mean1073.150-1069.200=3.950
σ317.882-312.445=5.437
min615.000-616.000=-1.000
max1643.000-1642.000=1.000
mean1.523-1.514=0.009
σ0.070-0.087=-0.017
min1.448-1.397=0.051
max1.731-1.757=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.411=-0.002
σ0.012-0.011=0.001
min285.389-285.395=-0.005
max285.420-285.423=-0.004
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean0.379-0.377=0.002
σ0.007-0.007=0.000
min0.376-0.373=0.003
max0.391-0.389=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.371=0.003
σ0.132-0.126=0.006
min1285.313-1285.311=0.002
max1285.611-1285.596=0.014
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean1.845-1.889=-0.044
σ0.020-0.140=-0.120
min1.821-1.718=0.103
max1.871-2.074=-0.202
iters=5
new-facts=6402
prior-facts=1
mean1807.697-1807.698=-0.001
σ7.040-7.039=0.001
min1804.338-1804.325=0.013
max1820.275-1820.277=-0.002
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean4.165-4.187=-0.021
σ0.266-0.327=-0.061
min3.968-3.831=0.137
max4.606-4.626=-0.020
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-2070.195=-0.002
σ0.012-0.016=-0.004
min2070.183-2070.182=0.001
max2070.214-2070.222=-0.009
mean1857.800-1852.400=5.400
σ203.360-175.256=28.103
min1643.000-1642.000=1.000
max2083.000-2096.000=-13.000
mean4.465-4.481=-0.016
σ0.079-0.127=-0.049
min4.357-4.395=-0.039
max4.578-4.701=-0.124

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.308-1.087=0.221
σ0.376-0.219=0.158
min0.901-0.887=0.013
max1.757-1.404=0.353

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.790-436.786=0.004
σ572.362-572.357=0.005
min150.603-150.605=-0.002
max1295.334-1295.322=0.011
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean0.532-0.514=0.017
σ0.556-0.526=0.030
min0.251-0.250=0.001
max1.365-1.303=0.063
policies=20
mean1506.270-1506.274=-0.004
σ0.246-0.232=0.014
min1506.106-1506.123=-0.017
max1506.636-1506.620=0.016
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean2.526-2.516=0.009
σ0.030-0.011=0.019
min2.484-2.508=-0.024
max2.549-2.532=0.018
policies=200
mean15070.351-15070.319=0.032
σ0.064-0.095=-0.031
min15070.272-15070.244=0.028
max15070.421-15070.449=-0.029
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1642.000=1.000
σ0.000
min1643.000-1642.000=1.000
max1643.000-1642.000=1.000
mean25.609-25.556=0.053
σ0.179-0.146=0.032
min25.485-25.428=0.058
max25.873-25.757=0.116