Compare commits

Home / Compare cfb3882c .. d0c477ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.645=0.002
σ0.365-0.366=-0.000
min53.514-53.511=0.002
max54.686-54.685=0.001
mean415.500-412.000=3.500
σ0.527-0.000=0.527
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.139-0.132=0.007
σ0.004-0.004=-0.001
min0.135-0.129=0.006
max0.146-0.140=0.006
cache=y
dps=1
iters=10
policies=100
mean42.943-42.945=-0.002
σ0.005-0.014=-0.009
min42.936-42.932=0.004
max42.954-42.980=-0.026
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.123-0.119=0.004
σ0.004-0.004=-0.000
min0.119-0.112=0.007
max0.129-0.125=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.813-991.803=0.010
σ1.247-1.262=-0.015
min991.229-991.252=-0.024
max997.054-997.118=-0.064
mean1070.050-1066.600=3.450
σ314.852-327.414=-12.562
min623.000-563.000=60.000
max1632.000
mean1.500-1.532=-0.033
σ0.070-0.128=-0.058
min1.367-1.445=-0.078
max1.703-1.957=-0.254

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.391-285.392=-0.001
σ0.009-0.015=-0.006
min285.375-285.367=0.009
max285.398-285.406=-0.008
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.377-0.375=0.002
σ0.006-0.007=-0.001
min0.374-0.372=0.002
max0.388-0.388=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.346-1285.351=-0.006
σ0.119-0.122=-0.002
min1285.288-1285.291=-0.003
max1285.559-1285.569=-0.009
mean1632.000
σ0.000
min1632.000
max1632.000
mean1.969-2.009=-0.040
σ0.143-0.198=-0.055
min1.825-1.852=-0.027
max2.134-2.280=-0.146
iters=5
new-facts=6402
prior-facts=1
mean1807.691-1807.690=0.001
σ6.997-6.999=-0.003
min1804.348-1804.344=0.004
max1820.192-1820.196=-0.004
mean1632.000
σ0.000
min1632.000
max1632.000
mean4.179-4.203=-0.023
σ0.209-0.161=0.048
min3.823-3.975=-0.152
max4.346-4.395=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean2070.174-2070.177=-0.003
σ0.010-0.014=-0.004
min2070.167-2070.166=0.000
max2070.191-2070.201=-0.009
mean1859.200-1860.800=-1.600
σ200.768-197.569=3.198
min1632.000
max2088.000-2086.000=2.000
mean4.466-4.504=-0.038
σ0.063-0.102=-0.039
min4.381-4.409=-0.028
max4.551-4.654=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.168=0.008
σ0.353-0.356=-0.003
min0.907-0.897=0.010
max1.762-1.765=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.777-436.775=0.002
σ572.365-572.366=-0.000
min150.592-150.591=0.001
max1295.325-1295.324=0.001
mean90.250
σ8.500
min86.000
max103.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.511-0.537=-0.025
σ0.519-0.564=-0.044
min0.249-0.246=0.003
max1.290-1.382=-0.092
policies=20
mean1506.170-1506.198=-0.028
σ0.210-0.252=-0.041
min1506.042-1506.053=-0.011
max1506.484-1506.575=-0.090
mean860.000
σ0.000
min860.000
max860.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean2.512-2.540=-0.028
σ0.006-0.050=-0.044
min2.507-2.490=0.017
max2.521-2.608=-0.086
policies=200
mean15069.477-15069.468=0.009
σ0.028-0.033=-0.006
min15069.453-15069.437=0.016
max15069.502-15069.510=-0.007
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean25.444-25.396=0.048
σ0.091-0.199=-0.108
min25.367-25.207=0.160
max25.544-25.638=-0.095