Compare commits

Home / Compare 42202fc4 .. 984828c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.791-35.793=-0.002
σ0.108-0.106=0.002
min35.745-35.746=-0.001
max36.098-36.095=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.073-0.076=-0.003
σ0.004-0.004=0.001
min0.068-0.073=-0.005
max0.080-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.003=-0.000
min26.062-26.060=0.002
max26.071-26.069=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.059=0.002
σ0.002-0.003=-0.001
min0.059-0.056=0.003
max0.065-0.065=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.887-1752.888=-0.001
σ0.361-0.366=-0.005
min1752.319-1752.318=0.001
max1753.452-1753.476=-0.024
mean1660.100-1661.750=-1.650
σ622.321-626.322=-4.001
min671.000-670.000=1.000
max2651.000-2666.000=-15.000
mean2.843-2.805=0.038
σ0.150-0.164=-0.014
min2.411-2.314=0.098
max3.062-3.047=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-277.193=0.000
σ0.005-0.007=-0.002
min277.186-277.184=0.002
max277.197-277.203=-0.006
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean0.396-0.402=-0.006
σ0.007-0.012=-0.005
min0.391-0.392=-0.001
max0.408-0.422=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2169.684-2169.690=-0.006
σ0.018-0.025=-0.007
min2169.654-2169.666=-0.012
max2169.700-2169.730=-0.030
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean2.941-2.915=0.026
σ0.228-0.135=0.093
min2.766-2.803=-0.037
max3.318-3.090=0.228
iters=5
new-facts=6402
prior-facts=1
mean5049.573-5049.571=0.002
σ0.975-0.982=-0.007
min5049.020-5049.056=-0.036
max5051.307-5051.320=-0.012
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean9.018-9.056=-0.038
σ0.647-0.611=0.036
min8.054-8.107=-0.053
max9.700-9.597=0.103
iters=5
new-facts=6402
prior-facts=6402
mean5180.618-5180.651=-0.033
σ0.142-0.093=0.050
min5180.400-5180.565=-0.165
max5180.748-5180.759=-0.011
mean3216.600-3258.400=-41.800
σ463.084-445.662=17.422
min2651.000-2666.000=-15.000
max3815.000-3847.000=-32.000
mean8.700-8.986=-0.286
σ0.102-0.472=-0.370
min8.620-8.695=-0.075
max8.872-9.802=-0.930

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.176=0.029
σ0.363-0.277=0.086
min0.951-0.955=-0.004
max1.815-1.619=0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.854-464.858=-0.005
σ572.660-572.663=-0.003
min178.522-178.523=-0.001
max1323.844-1323.853=-0.009
mean79.500
σ7.000
min76.000
max90.000
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean0.575-0.569=0.006
σ0.581-0.565=0.016
min0.281-0.281=-0.000
max1.447-1.416=0.030
policies=20
mean1785.484-1785.492=-0.008
σ0.347-0.344=0.003
min1785.256-1785.264=-0.008
max1786.000-1786.001=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean2.784-2.805=-0.021
σ0.010-0.016=-0.006
min2.770-2.784=-0.014
max2.794-2.823=-0.028
policies=200
mean17861.533-17861.426=0.108
σ0.468-0.410=0.058
min17861.290-17861.157=0.133
max17862.235-17862.034=0.200
mean7600.000
σ0.000
min7600.000
max7600.000
mean2651.000-2666.000=-15.000
σ0.000
min2651.000-2666.000=-15.000
max2651.000-2666.000=-15.000
mean28.233-28.349=-0.116
σ0.181-0.088=0.094
min28.057-28.272=-0.215
max28.421-28.451=-0.030