Compare commits

Home / Compare 3a9b8d99 .. eb3529cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.368-0.367=0.001
min53.784-53.787=-0.003
max54.962-54.959=0.003
mean414.800-418.800=-4.000
σ0.422
min414.000-418.000=-4.000
max415.000-419.000=-4.000
mean0.139-0.137=0.002
σ0.003-0.004=-0.001
min0.135-0.131=0.004
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.002
σ0.006-0.006=-0.001
min43.134-43.136=-0.001
max43.152-43.156=-0.004
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.121-0.126=-0.005
σ0.004-0.009=-0.005
min0.117-0.119=-0.002
max0.128-0.144=-0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.816-991.819=-0.003
σ1.237-1.250=-0.013
min991.232-991.231=0.001
max997.007-997.070=-0.063
mean1071.600-1076.000=-4.400
σ317.284-313.752=3.532
min621.000-620.000=1.000
max1634.000-1653.000=-19.000
mean1.533-1.528=0.005
σ0.056-0.077=-0.021
min1.434-1.414=0.020
max1.621-1.714=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.415-285.415=-0.000
σ0.013-0.010=0.003
min285.395-285.399=-0.003
max285.431-285.423=0.008
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean0.385-0.379=0.006
σ0.011-0.008=0.003
min0.375-0.373=0.003
max0.399-0.389=0.010
iters=5
new-facts=1
prior-facts=6402
mean1285.366-1285.375=-0.009
σ0.122-0.137=-0.015
min1285.308-1285.308=0.000
max1285.585-1285.621=-0.036
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean1.923-1.880=0.043
σ0.144-0.074=0.069
min1.809-1.807=0.002
max2.173-1.993=0.180
iters=5
new-facts=6402
prior-facts=1
mean1807.711-1807.691=0.020
σ7.047-7.017=0.030
min1804.344-1804.327=0.017
max1820.305-1820.231=0.073
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean4.225-4.122=0.102
σ0.284-0.215=0.069
min3.910-3.806=0.103
max4.586-4.395=0.191
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-2070.202=-0.008
σ0.010-0.014=-0.004
min2070.179-2070.190=-0.010
max2070.207-2070.226=-0.020
mean1835.400-1840.800=-5.400
σ171.468-165.940=5.528
min1634.000-1653.000=-19.000
max2073.000-2068.000=5.000
mean4.476-4.517=-0.041
σ0.077-0.175=-0.098
min4.389-4.300=0.089
max4.588-4.750=-0.162

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.221=-0.017
σ0.390-0.305=0.085
min0.917-0.913=0.004
max1.862-1.714=0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.791-436.788=0.003
σ572.362-572.360=0.001
min150.598-150.603=-0.004
max1295.334-1295.329=0.005
mean90.250
σ8.500
min86.000
max103.000
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean0.522-0.515=0.007
σ0.539-0.531=0.008
min0.250-0.248=0.002
max1.331-1.311=0.020
policies=20
mean1506.270-1506.256=0.015
σ0.235-0.242=-0.008
min1506.118-1506.101=0.017
max1506.620-1506.617=0.003
mean860.000
σ0.000
min860.000
max860.000
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean2.514-2.526=-0.012
σ0.013-0.018=-0.005
min2.505-2.501=0.004
max2.533-2.540=-0.006
policies=200
mean15070.383-15070.390=-0.007
σ0.056-0.043=0.014
min15070.304-15070.339=-0.035
max15070.430-15070.443=-0.013
mean8600.000
σ0.000
min8600.000
max8600.000
mean1634.000-1653.000=-19.000
σ0.000
min1634.000-1653.000=-19.000
max1634.000-1653.000=-19.000
mean25.415-25.485=-0.070
σ0.134-0.102=0.032
min25.216-25.371=-0.155
max25.492-25.614=-0.122