Compare commits

Home / Compare 5d9609a8 .. f84fc329

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.000
σ0.365-0.366=-0.001
min53.780-53.781=-0.000
max54.953-54.955=-0.002
mean417.100-413.000=4.100
σ0.316-0.000=0.316
min417.000-413.000=4.000
max418.000-413.000=5.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.134-0.136=-0.001
max0.145-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.144-43.144=-0.000
σ0.014-0.012=0.002
min43.129-43.127=0.001
max43.179-43.171=0.008
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.121-0.121=-0.001
σ0.003-0.004=-0.000
min0.117-0.118=-0.000
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.806-991.803=0.002
σ1.269-1.249=0.020
min991.258-991.249=0.009
max997.152-997.062=0.090
mean1066.500-1063.200=3.300
σ322.391-322.403=-0.013
min571.000-565.000=6.000
max1641.000-1638.000=3.000
mean1.535-1.534=0.000
σ0.092-0.087=0.005
min1.398-1.406=-0.008
max1.752-1.776=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.412=0.001
σ0.010-0.012=-0.002
min285.398-285.393=0.005
max285.422-285.424=-0.002
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean0.376-0.376=0.000
σ0.006-0.003=0.003
min0.371-0.373=-0.002
max0.385-0.380=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.369-1285.368=0.002
σ0.122-0.117=0.004
min1285.310-1285.307=0.003
max1285.587-1285.577=0.010
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean2.041-1.878=0.163
σ0.237-0.105=0.131
min1.856-1.813=0.043
max2.389-2.059=0.331
iters=5
new-facts=6402
prior-facts=1
mean1807.713-1807.695=0.018
σ7.039-7.013=0.026
min1804.318-1804.335=-0.017
max1820.288-1820.225=0.063
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean4.199-4.158=0.041
σ0.319-0.260=0.060
min3.812-3.859=-0.046
max4.662-4.450=0.213
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.198=0.001
σ0.012-0.005=0.007
min2070.185-2070.190=-0.005
max2070.214-2070.205=0.009
mean1838.000-1864.600=-26.600
σ170.209-194.754=-24.546
min1641.000-1638.000=3.000
max2075.000-2079.000=-4.000
mean4.611-4.519=0.092
σ0.241-0.119=0.122
min4.443-4.424=0.019
max5.031-4.724=0.307

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.290-1.223=0.067
σ0.394-0.306=0.088
min0.913-0.919=-0.006
max1.777-1.724=0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.788-436.791=-0.002
σ572.357-572.362=-0.005
min150.605-150.597=0.007
max1295.324-1295.334=-0.010
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean0.533-0.538=-0.006
σ0.556-0.583=-0.027
min0.250-0.243=0.007
max1.366-1.412=-0.046
policies=20
mean1506.256-1506.264=-0.007
σ0.238-0.237=0.001
min1506.096-1506.103=-0.006
max1506.610-1506.616=-0.006
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean2.518-2.515=0.003
σ0.012-0.013=-0.001
min2.503-2.504=-0.001
max2.533-2.532=0.001
policies=200
mean15070.408-15070.293=0.115
σ0.038-0.087=-0.049
min15070.353-15070.239=0.115
max15070.435-15070.421=0.014
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1638.000=3.000
σ0.000
min1641.000-1638.000=3.000
max1641.000-1638.000=3.000
mean25.433-25.451=-0.018
σ0.158-0.157=0.001
min25.284-25.304=-0.019
max25.571-25.592=-0.021