Compare commits

Home / Compare 37c1b966 .. a3177898

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.106=-0.000
min35.755-35.752=0.003
max36.098-36.099=-0.001
mean413.000-412.900=0.100
σ0.000-0.316=-0.316
min413.000-412.000=1.000
max413.000
mean0.072-0.076=-0.004
σ0.005-0.004=0.001
min0.068-0.073=-0.004
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.003-0.003=0.000
min26.058-26.059=-0.001
max26.071-26.068=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.059-0.061=-0.002
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.002
σ0.364-0.367=-0.003
min1755.353-1755.350=0.003
max1756.513-1756.520=-0.008
mean1660.250-1671.650=-11.400
σ619.775-631.637=-11.862
min630.000-667.000=-37.000
max2497.000-2630.000=-133.000
mean2.850-2.803=0.046
σ0.124-0.207=-0.083
min2.564-2.348=0.216
max3.022-3.092=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.196=-0.002
σ0.006-0.004=0.002
min277.189-277.193=-0.004
max277.202-277.201=0.001
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean0.396-0.395=0.002
σ0.007-0.001=0.005
min0.393-0.393=-0.000
max0.409-0.396=0.012
iters=5
new-facts=1
prior-facts=6402
mean2174.422-2174.424=-0.002
σ0.028-0.021=0.007
min2174.374-2174.400=-0.026
max2174.443-2174.449=-0.006
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean2.829-3.011=-0.182
σ0.122-0.331=-0.209
min2.724-2.804=-0.080
max3.039-3.579=-0.540
iters=5
new-facts=6402
prior-facts=1
mean5052.476-5052.605=-0.129
σ1.066-0.977=0.088
min5051.534-5052.031=-0.496
max5054.316-5054.343=-0.027
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean8.787-9.031=-0.243
σ0.540-0.438=0.102
min8.146-8.497=-0.351
max9.353-9.514=-0.160
iters=5
new-facts=6402
prior-facts=6402
mean5188.268-5188.398=-0.130
σ0.367-0.126=0.241
min5187.634-5188.221=-0.587
max5188.531-5188.524=0.006
mean3246.000-3215.600=30.400
σ353.050-499.782=-146.732
min2843.000-2630.000=213.000
max3766.000-3891.000=-125.000
mean8.788-8.754=0.035
σ0.036-0.167=-0.131
min8.751-8.616=0.135
max8.841-9.045=-0.204

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.768-1.211=0.557
σ0.159-0.262=-0.103
min1.492-0.945=0.546
max1.861-1.548=0.313

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.845-464.855=-0.009
σ572.645-572.656=-0.012
min178.521-178.524=-0.003
max1323.812-1323.839=-0.027
mean79.500
σ7.000
min76.000
max90.000
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean0.541-0.566=-0.026
σ0.500-0.562=-0.062
min0.283-0.280=0.003
max1.290-1.409=-0.119
policies=20
mean1785.488-1785.488=0.000
σ0.347-0.344=0.003
min1785.256-1785.253=0.004
max1786.001-1785.997=0.004
mean760.000
σ0.000
min760.000
max760.000
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean2.808-2.802=0.006
σ0.018-0.019=-0.001
min2.791-2.782=0.009
max2.829-2.827=0.002
policies=200
mean17861.508-17861.410=0.099
σ0.463-0.573=-0.110
min17861.257-17861.070=0.187
max17862.202-17862.267=-0.064
mean7600.000
σ0.000
min7600.000
max7600.000
mean2497.000-2630.000=-133.000
σ0.000
min2497.000-2630.000=-133.000
max2497.000-2630.000=-133.000
mean28.326-28.342=-0.017
σ0.146-0.081=0.065
min28.169-28.250=-0.081
max28.473-28.417=0.056