Compare commits

Home / Compare f1d685f3 .. 2a8d9604

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.916=-0.003
σ0.369-0.367=0.002
min53.784-53.787=-0.002
max54.962-54.961=0.002
mean417.000-413.300=3.700
σ0.000-0.483=-0.483
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.137-0.141=-0.004
σ0.005-0.008=-0.003
min0.128-0.134=-0.006
max0.147-0.161=-0.015
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.001
σ0.008-0.004=0.004
min43.126-43.134=-0.008
max43.154-43.146=0.008
mean417.800-414.000=3.800
σ0.422-0.000=0.422
min417.000-414.000=3.000
max418.000-414.000=4.000
mean0.120-0.120=0.000
σ0.003-0.004=-0.001
min0.117-0.112=0.004
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.789-991.813=-0.025
σ1.270-1.260=0.010
min991.244-991.253=-0.009
max997.136-997.115=0.022
mean1068.000-1063.400=4.600
σ317.675-322.733=-5.058
min584.000-565.000=19.000
max1646.000-1636.000=10.000
mean1.546-1.565=-0.019
σ0.087-0.115=-0.028
min1.463-1.475=-0.012
max1.781-1.898=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.412=-0.003
σ0.013-0.013=0.001
min285.388-285.391=-0.003
max285.422-285.426=-0.004
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.378-0.376=0.002
σ0.006-0.006=0.000
min0.374-0.371=0.003
max0.389-0.385=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.371-1285.375=-0.004
σ0.131-0.135=-0.005
min1285.308-1285.307=0.002
max1285.605-1285.617=-0.012
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean1.889-1.878=0.011
σ0.163-0.068=0.094
min1.716-1.804=-0.088
max2.159-1.974=0.185
iters=5
new-facts=6402
prior-facts=1
mean1807.720-1807.691=0.029
σ6.998-7.002=-0.004
min1804.340-1804.330=0.011
max1820.220-1820.201=0.019
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean4.212-4.137=0.075
σ0.171-0.221=-0.051
min4.002-3.940=0.063
max4.407-4.403=0.004
iters=5
new-facts=6402
prior-facts=6402
mean2070.201-2070.195=0.006
σ0.012-0.010=0.002
min2070.192-2070.188=0.005
max2070.222-2070.211=0.011
mean1839.800-1850.600=-10.800
σ168.571-204.106=-35.535
min1646.000-1636.000=10.000
max2076.000-2073.000=3.000
mean4.611-4.600=0.011
σ0.139-0.223=-0.084
min4.471-4.421=0.050
max4.773-4.929=-0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.204=-0.092
σ0.090-0.262=-0.172
min1.040-0.917=0.123
max1.225-1.610=-0.385

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.787=-0.005
σ572.345-572.360=-0.015
min150.598-150.597=0.001
max1295.299-1295.328=-0.028
mean90.250
σ8.500
min86.000
max103.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean0.516-0.522=-0.006
σ0.534-0.542=-0.008
min0.248-0.250=-0.001
max1.317-1.335=-0.018
policies=20
mean1506.275-1506.256=0.018
σ0.245-0.240=0.005
min1506.116-1506.104=0.011
max1506.640-1506.615=0.025
mean860.000
σ0.000
min860.000
max860.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean2.524-2.523=0.002
σ0.017-0.003=0.014
min2.503-2.519=-0.016
max2.540-2.526=0.014
policies=200
mean15070.403-15070.376=0.027
σ0.049-0.045=0.004
min15070.333-15070.339=-0.006
max15070.446-15070.435=0.011
mean8600.000
σ0.000
min8600.000
max8600.000
mean1646.000-1636.000=10.000
σ0.000
min1646.000-1636.000=10.000
max1646.000-1636.000=10.000
mean25.568-25.458=0.110
σ0.133-0.150=-0.017
min25.445-25.279=0.166
max25.695-25.607=0.088