Compare commits

Home / Compare e83ba4b3 .. db2057c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.971-35.796=0.175
σ0.104-0.104=-0.001
min35.915-35.741=0.174
max36.265-36.092=0.173
mean417.000-414.200=2.800
σ0.000-0.422=-0.422
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.076-0.073=0.003
σ0.003-0.004=-0.001
min0.074-0.069=0.005
max0.082-0.081=0.001
cache=y
dps=1
iters=10
policies=100
mean26.206-26.063=0.143
σ0.003-0.003=0.001
min26.199-26.058=0.142
max26.210-26.067=0.143
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.059-0.062=-0.002
σ0.003-0.003=0.001
min0.057-0.060=-0.003
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1755.924=2.440
σ0.369-0.366=0.003
min1757.787-1755.347=2.441
max1758.951-1756.515=2.436
mean1659.050-1662.550=-3.500
σ620.319-627.956=-7.637
min690.000-671.000=19.000
max2750.000-2659.000=91.000
mean2.362-2.788=-0.426
σ0.099-0.157=-0.058
min2.264-2.346=-0.082
max2.590-2.954=-0.364

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.516-277.196=2.320
σ0.009-0.009=-0.000
min279.506-277.189=2.317
max279.527-277.210=2.317
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean0.411-0.392=0.019
σ0.010-0.002=0.009
min0.403-0.390=0.013
max0.428-0.394=0.034
iters=5
new-facts=1
prior-facts=6402
mean2178.458-2174.423=4.035
σ0.020-0.011=0.009
min2178.439-2174.406=4.033
max2178.487-2174.433=4.054
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean3.352-2.840=0.512
σ0.352-0.121=0.232
min3.084-2.721=0.362
max3.968-2.991=0.977
iters=5
new-facts=6402
prior-facts=1
mean5056.248-5052.612=3.636
σ1.088-0.967=0.121
min5055.241-5052.132=3.109
max5058.100-5054.337=3.763
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean8.693-9.040=-0.346
σ0.593-0.670=-0.077
min7.984-8.031=-0.046
max9.459-9.637=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean5193.748-5188.416=5.332
σ0.091-0.096=-0.006
min5193.660-5188.312=5.349
max5193.850-5188.526=5.325
mean3252.000-3216.200=35.800
σ498.351-478.804=19.547
min2750.000-2659.000=91.000
max3952.000-3865.000=87.000
mean8.730-8.823=-0.093
σ0.111-0.216=-0.105
min8.660-8.643=0.017
max8.926-9.124=-0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.230=-0.205
σ0.069-0.334=-0.265
min0.942-0.945=-0.003
max1.080-1.793=-0.713

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.473-464.857=0.615
σ572.660-572.656=0.003
min179.142-178.528=0.614
max1324.462-1323.842=0.621
mean79.500
σ7.000
min76.000
max90.000
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean0.459-0.559=-0.100
σ0.353-0.558=-0.205
min0.281-0.278=0.003
max0.988-1.395=-0.407
policies=20
mean1791.682-1785.474=6.207
σ0.335-0.354=-0.020
min1791.495-1785.242=6.253
max1792.182-1786.001=6.181
mean760.000
σ0.000
min760.000
max760.000
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean2.783-2.782=0.001
σ0.021-0.015=0.006
min2.752-2.761=-0.008
max2.796-2.792=0.003
policies=200
mean17923.448-17861.435=62.012
σ0.515-0.411=0.104
min17923.004-17861.181=61.822
max17924.187-17862.042=62.145
mean7600.000
σ0.000
min7600.000
max7600.000
mean2750.000-2659.000=91.000
σ0.000
min2750.000-2659.000=91.000
max2750.000-2659.000=91.000
mean28.099-28.067=0.031
σ0.142-0.123=0.019
min27.895-27.940=-0.046
max28.222-28.236=-0.013