Compare commits

Home / Compare e447d946 .. 508fd00d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.616=0.002
σ0.050-0.051=-0.001
min35.588-35.581=0.007
max35.758-35.757=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.085-0.083=0.003
σ0.003-0.006=-0.003
min0.083-0.076=0.007
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=0.001
σ0.003-0.005=-0.002
min24.043-24.041=0.001
max24.052-24.059=-0.007
mean415.000-414.700=0.300
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.069-0.068=0.001
σ0.003-0.003=0.000
min0.066-0.066=0.000
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.063-1757.062=0.001
σ0.364-0.364=0.000
min1756.489-1756.488=0.000
max1757.652-1757.652=0.000
mean1665.650-1660.200=5.450
σ633.823-622.068=11.755
min670.000-669.000=1.000
max2615.000-2597.000=18.000
mean2.358-2.386=-0.028
σ0.112-0.145=-0.033
min2.182-2.226=-0.045
max2.677-2.691=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean423.112-422.731=0.381
σ0.076-0.076=-0.001
min422.979-422.596=0.383
max423.154-422.773=0.381
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean0.585-0.572=0.013
σ0.013-0.004=0.009
min0.573-0.569=0.004
max0.606-0.579=0.026
iters=5
new-facts=1
prior-facts=6402
mean2122.368-2122.009=0.359
σ0.054-0.016=0.038
min2122.273-2121.991=0.282
max2122.403-2122.031=0.371
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean2.980-2.943=0.037
σ0.161-0.144=0.017
min2.710-2.752=-0.042
max3.135-3.098=0.037
iters=5
new-facts=6402
prior-facts=1
mean5110.253-5109.835=0.418
σ7.827-7.489=0.339
min5106.318-5106.443=-0.125
max5124.247-5123.231=1.017
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean9.687-9.507=0.180
σ0.152-0.271=-0.119
min9.456-9.078=0.378
max9.823-9.771=0.053
iters=5
new-facts=6402
prior-facts=6402
mean5295.534-5295.002=0.532
σ0.023-0.304=-0.282
min5295.497-5294.462=1.035
max5295.555-5295.183=0.372
mean3090.000-3044.400=45.600
σ403.081-356.867=46.214
min2615.000-2597.000=18.000
max3621.000-3518.000=103.000
mean9.323-9.249=0.074
σ0.147-0.282=-0.135
min9.144-9.017=0.127
max9.495-9.571=-0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.148=0.043
σ0.376-0.260=0.116
min0.902-0.927=-0.026
max1.822-1.525=0.297

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.262-464.266=-0.004
σ574.786-574.780=0.006
min176.864-176.869=-0.005
max1326.441-1326.436=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean0.556-0.549=0.008
σ0.556-0.547=0.009
min0.276-0.273=0.002
max1.390-1.369=0.021
policies=20
mean1769.029-1769.017=0.013
σ0.366-0.354=0.012
min1768.792-1768.798=-0.006
max1769.574-1769.544=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean2.759-2.738=0.021
σ0.024-0.013=0.010
min2.724-2.720=0.004
max2.775-2.752=0.023
policies=200
mean17697.352-17697.553=-0.201
σ0.421-0.490=-0.069
min17697.055-17697.293=-0.238
max17697.973-17698.287=-0.314
mean8400.000
σ0.000
min8400.000
max8400.000
mean2615.000-2597.000=18.000
σ0.000
min2615.000-2597.000=18.000
max2615.000-2597.000=18.000
mean27.716-27.583=0.134
σ0.197-0.089=0.108
min27.483-27.493=-0.010
max27.965-27.662=0.304