Compare commits

Home / Compare d729751a .. c308828d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.985-33.986=-0.001
σ0.054-0.054=-0.000
min33.958-33.957=0.000
max34.138-34.140=-0.002
mean415.000-412.800=2.200
σ0.000-0.422=-0.422
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.085-0.084=0.001
σ0.004-0.003=0.001
min0.082-0.082=0.001
max0.092-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=0.000
σ0.002-0.003=-0.001
min23.322-23.320=0.001
max23.327-23.331=-0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.064=0.002
σ0.002-0.004=-0.002
min0.065-0.059=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.727-1756.727=-0.000
σ0.364-0.364=0.000
min1756.152-1756.154=-0.002
max1757.311-1757.321=-0.011
mean1665.750-1630.750=35.000
σ623.021-627.205=-4.184
min618.000-636.000=-18.000
max2687.000-2824.000=-137.000
mean2.358-2.360=-0.003
σ0.087-0.129=-0.042
min2.270-2.163=0.107
max2.627-2.653=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.311-325.309=0.003
σ0.058-0.055=0.003
min325.208-325.213=-0.004
max325.343-325.344=-0.001
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean0.428-0.424=0.004
σ0.008-0.001=0.007
min0.422-0.422=-0.000
max0.442-0.426=0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.868-1985.877=-0.009
σ0.015-0.013=0.002
min1985.859-1985.863=-0.004
max1985.894-1985.892=0.003
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean2.803-2.835=-0.032
σ0.111-0.179=-0.068
min2.641-2.616=0.025
max2.922-3.112=-0.190
iters=5
new-facts=6402
prior-facts=1
mean4809.629-4809.515=0.114
σ7.702-7.779=-0.077
min4806.150-4805.636=0.514
max4823.407-4823.424=-0.017
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean8.933-8.978=-0.045
σ0.102-0.080=0.022
min8.832-8.837=-0.005
max9.086-9.031=0.055
iters=5
new-facts=6402
prior-facts=6402
mean4997.193-4997.193=0.000
σ0.023-0.015=0.007
min4997.166-4997.174=-0.008
max4997.226-4997.213=0.012
mean3015.600-3042.200=-26.600
σ277.304-280.956=-3.652
min2687.000-2824.000=-137.000
max3274.000-3474.000=-200.000
mean9.006-8.866=0.140
σ0.328-0.305=0.024
min8.643-8.637=0.005
max9.455-9.337=0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.936-0.976=-0.040
σ0.057-0.068=-0.011
min0.891-0.917=-0.026
max1.033-1.054=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.375-463.381=-0.006
σ574.770-574.770=-0.000
min175.976-175.985=-0.008
max1325.530-1325.536=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean0.542-0.427=0.116
σ0.540-0.292=0.248
min0.271-0.280=-0.009
max1.352-0.865=0.487
policies=20
mean1760.120-1760.160=-0.040
σ0.349-0.355=-0.006
min1759.902-1759.917=-0.016
max1760.639-1760.684=-0.045
mean820.000
σ0.000
min820.000
max820.000
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean2.732-2.807=-0.074
σ0.018-0.006=0.012
min2.708-2.801=-0.093
max2.747-2.813=-0.066
policies=200
mean17608.402-17608.337=0.064
σ0.492-0.401=0.091
min17608.153-17607.966=0.188
max17609.140-17608.907=0.233
mean8200.000
σ0.000
min8200.000
max8200.000
mean2687.000-2824.000=-137.000
σ0.000
min2687.000-2824.000=-137.000
max2687.000-2824.000=-137.000
mean27.518-27.802=-0.284
σ0.077-0.391=-0.314
min27.407-27.376=0.031
max27.578-28.261=-0.683