Compare commits

Home / Compare 3457ae4b .. ebd26ca0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.001
σ0.369-0.367=0.002
min53.510-53.513=-0.003
max54.697-54.690=0.007
mean413.000-412.400=0.600
σ0.000-0.516=-0.516
min413.000-412.000=1.000
max413.000
mean0.138-0.136=0.002
σ0.006-0.004=0.001
min0.129-0.130=-0.001
max0.146-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean42.943-42.942=0.001
σ0.006-0.007=-0.001
min42.933-42.929=0.004
max42.950-42.952=-0.002
mean413.800-413.000=0.800
σ0.422-0.000=0.422
min413.000
max414.000-413.000=1.000
mean0.119-0.119=-0.000
σ0.004-0.004=0.000
min0.114-0.113=0.000
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.797-991.792=0.005
σ1.240-1.241=-0.001
min991.223-991.238=-0.015
max997.017-997.019=-0.002
mean1069.750-1069.850=-0.100
σ314.730-317.160=-2.430
min614.000-619.000=-5.000
max1653.000-1631.000=22.000
mean1.514-1.547=-0.033
σ0.057-0.121=-0.064
min1.452-1.447=0.004
max1.662-2.009=-0.346

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-285.397=-0.008
σ0.013-0.010=0.003
min285.369-285.385=-0.016
max285.402-285.410=-0.008
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean0.370-0.385=-0.015
σ0.004-0.012=-0.007
min0.365-0.371=-0.006
max0.377-0.396=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.356=-0.002
σ0.132-0.140=-0.008
min1285.285-1285.289=-0.003
max1285.589-1285.606=-0.017
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean1.913-1.946=-0.033
σ0.150-0.137=0.014
min1.787-1.832=-0.045
max2.174-2.138=0.036
iters=5
new-facts=6402
prior-facts=1
mean1807.688-1807.690=-0.001
σ6.990-6.981=0.009
min1804.306-1804.361=-0.055
max1820.174-1820.162=0.012
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean4.174-4.168=0.007
σ0.196-0.081=0.115
min3.913-4.059=-0.146
max4.387-4.267=0.120
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.178=0.000
σ0.008-0.013=-0.004
min2070.167-2070.164=0.003
max2070.190-2070.198=-0.008
mean1847.800-1858.400=-10.600
σ178.622-200.807=-22.185
min1653.000-1631.000=22.000
max2081.000-2089.000=-8.000
mean4.517-4.514=0.003
σ0.049-0.050=-0.001
min4.455-4.472=-0.017
max4.571-4.584=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.214=-0.007
σ0.368-0.354=0.014
min0.911-0.911=-0.000
max1.786-1.814=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.776-436.778=-0.003
σ572.361-572.358=0.003
min150.590-150.589=0.001
max1295.318-1295.315=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean0.512-0.537=-0.025
σ0.522-0.573=-0.051
min0.247-0.249=-0.002
max1.296-1.397=-0.101
policies=20
mean1506.191-1506.163=0.028
σ0.245-0.231=0.014
min1506.036-1506.010=0.026
max1506.556-1506.507=0.049
mean860.000
σ0.000
min860.000
max860.000
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean2.526-2.508=0.017
σ0.016-0.023=-0.007
min2.509-2.482=0.027
max2.543-2.536=0.007
policies=200
mean15069.554-15069.480=0.075
σ0.047-0.085=-0.038
min15069.492-15069.370=0.122
max15069.607-15069.571=0.035
mean8600.000
σ0.000
min8600.000
max8600.000
mean1653.000-1631.000=22.000
σ0.000
min1653.000-1631.000=22.000
max1653.000-1631.000=22.000
mean25.581-25.399=0.182
σ0.212-0.168=0.044
min25.315-25.231=0.084
max25.784-25.601=0.183