Compare commits

Home / Compare 6d5fdd2f .. 32a3619b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.000
σ0.109-0.105=0.004
min35.753-35.750=0.004
max36.108-36.095=0.012
mean413.000-415.800=-2.800
σ0.000-0.422=-0.422
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.073-0.076=-0.002
σ0.005-0.003=0.002
min0.069-0.073=-0.004
max0.081-0.082=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.004=-0.000
min26.059-26.060=-0.001
max26.070-26.072=-0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.061-0.061=-0.001
σ0.003-0.003=0.001
min0.056-0.059=-0.003
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.924=-0.002
σ0.363-0.366=-0.002
min1755.351-1755.350=0.001
max1756.514-1756.502=0.013
mean1665.800-1663.600=2.200
σ627.560-629.930=-2.370
min674.000
max2663.000-2698.000=-35.000
mean2.799-2.801=-0.003
σ0.139-0.170=-0.031
min2.337-2.436=-0.099
max2.946-3.197=-0.250

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.198=-0.000
σ0.006-0.003=0.002
min277.190-277.192=-0.003
max277.204-277.200=0.004
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean0.401-0.403=-0.002
σ0.001-0.002=-0.001
min0.400-0.402=-0.002
max0.402-0.407=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2174.427-2174.425=0.002
σ0.015-0.009=0.005
min2174.405-2174.416=-0.011
max2174.439-2174.436=0.003
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean3.037-3.017=0.020
σ0.235-0.161=0.074
min2.754-2.767=-0.013
max3.408-3.163=0.245
iters=5
new-facts=6402
prior-facts=1
mean5052.594-5052.479=0.115
σ0.919-1.068=-0.150
min5051.988-5051.664=0.323
max5054.198-5054.346=-0.148
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean8.788-8.871=-0.083
σ0.545-0.552=-0.006
min8.070-8.085=-0.016
max9.406-9.464=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean5188.429-5188.212=0.217
σ0.083-0.139=-0.057
min5188.360-5188.017=0.343
max5188.529-5188.358=0.171
mean3287.400-3235.600=51.800
σ424.555-387.207=37.348
min2688.000-2698.000=-10.000
max3678.000-3725.000=-47.000
mean8.948-8.927=0.021
σ0.237-0.350=-0.113
min8.655-8.655=-0.001
max9.307-9.532=-0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.086=0.051
σ0.221-0.147=0.074
min0.947-0.943=0.004
max1.463-1.257=0.206

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.859-464.853=0.006
σ572.667-572.660=0.006
min178.521-178.521=0.000
max1323.859-1323.844=0.015
mean79.500
σ7.000
min76.000
max90.000
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean0.574-0.534=0.040
σ0.568-0.500=0.068
min0.287-0.279=0.008
max1.426-1.283=0.143
policies=20
mean1785.458-1785.484=-0.025
σ0.353-0.353=-0.001
min1785.233-1785.245=-0.012
max1785.982-1786.008=-0.026
mean760.000
σ0.000
min760.000
max760.000
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean2.789-2.778=0.011
σ0.024-0.015=0.009
min2.754-2.763=-0.009
max2.805-2.795=0.010
policies=200
mean17861.546-17861.410=0.137
σ0.519-0.476=0.043
min17861.259-17861.046=0.213
max17862.324-17862.100=0.224
mean7600.000
σ0.000
min7600.000
max7600.000
mean2663.000-2698.000=-35.000
σ0.000
min2663.000-2698.000=-35.000
max2663.000-2698.000=-35.000
mean28.076-28.127=-0.051
σ0.117-0.157=-0.041
min27.949-27.986=-0.037
max28.193-28.302=-0.110