Compare commits

Home / Compare 4edd990e .. f97143d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.648=-0.002
σ0.369-0.367=0.002
min53.518-53.519=-0.001
max54.697-54.693=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.136-0.139=-0.002
σ0.005-0.004=0.001
min0.130-0.134=-0.004
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.942-42.942=0.000
σ0.005-0.005=0.000
min42.935-42.935=0.000
max42.952-42.950=0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.118-0.115=0.003
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.804-991.800=0.004
σ1.265-1.268=-0.003
min991.223-991.242=-0.020
max997.131-997.142=-0.011
mean1065.300-1065.250=0.050
σ323.294-322.595=0.699
min568.000-567.000=1.000
max1639.000
mean1.528-1.528=0.000
σ0.098-0.091=0.007
min1.443-1.452=-0.009
max1.735-1.821=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.395-285.396=-0.001
σ0.011-0.015=-0.004
min285.381-285.375=0.006
max285.407-285.416=-0.008
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.378-0.379=-0.001
σ0.007-0.008=-0.000
min0.374-0.374=0.000
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.351-1285.352=-0.000
σ0.130-0.128=0.002
min1285.290-1285.286=0.004
max1285.584-1285.581=0.003
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.049-2.009=0.040
σ0.235-0.249=-0.014
min1.862-1.792=0.070
max2.396-2.407=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.674=0.017
σ7.013-7.015=-0.002
min1804.321-1804.310=0.011
max1820.218-1820.206=0.012
mean1639.000
σ0.000
min1639.000
max1639.000
mean4.180-4.130=0.049
σ0.223-0.191=0.032
min3.866-3.841=0.025
max4.470-4.371=0.099
iters=5
new-facts=6402
prior-facts=6402
mean2070.177-2070.177=0.000
σ0.007-0.008=-0.001
min2070.169-2070.164=0.005
max2070.185-2070.182=0.003
mean1832.600-1837.200=-4.600
σ170.616-174.292=-3.676
min1639.000
max2068.000-2073.000=-5.000
mean4.585-4.536=0.049
σ0.134-0.054=0.080
min4.478-4.481=-0.003
max4.810-4.607=0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.177-1.198=-0.020
σ0.300-0.248=0.052
min0.916-0.908=0.008
max1.675-1.560=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.777-436.773=0.003
σ572.365-572.366=-0.001
min150.591-150.586=0.005
max1295.325-1295.322=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.529-0.505=0.023
σ0.557-0.510=0.047
min0.248-0.247=0.001
max1.364-1.270=0.094
policies=20
mean1506.172-1506.164=0.008
σ0.217-0.240=-0.023
min1506.026-1506.003=0.023
max1506.495-1506.520=-0.026
mean860.000
σ0.000
min860.000
max860.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.509-2.517=-0.008
σ0.011-0.013=-0.002
min2.495-2.501=-0.006
max2.521-2.532=-0.011
policies=200
mean15069.441-15069.370=0.070
σ0.137-0.086=0.051
min15069.315-15069.263=0.052
max15069.617-15069.474=0.142
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean25.442-25.460=-0.018
σ0.140-0.125=0.015
min25.267-25.319=-0.052
max25.591-25.621=-0.030