Compare commits

Home / Compare 7ac71cb9 .. 94673944

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.107=-0.001
min35.754-35.749=0.005
max36.099-36.103=-0.004
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.073-0.077=-0.004
σ0.003-0.004=-0.001
min0.069-0.073=-0.005
max0.077-0.084=-0.007
cache=y
dps=1
iters=10
policies=100
mean26.066-26.065=0.001
σ0.003-0.003=0.000
min26.062-26.060=0.002
max26.071-26.067=0.004
mean410.600-414.000=-3.400
σ0.516-0.000=0.516
min410.000-414.000=-4.000
max411.000-414.000=-3.000
mean0.061-0.060=0.000
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.924=-4.688
σ0.361-0.364=-0.003
min1750.670-1755.353=-4.683
max1751.803-1756.527=-4.724
mean1651.550-1661.850=-10.300
σ643.493-627.479=16.014
min624.000-609.000=15.000
max2844.000-2718.000=126.000
mean2.810-2.856=-0.046
σ0.147-0.195=-0.048
min2.462-2.330=0.132
max3.012-3.128=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.193=-1.625
σ0.007-0.006=0.002
min275.557-277.188=-1.631
max275.575-277.202=-1.627
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean0.404-0.394=0.011
σ0.007-0.002=0.005
min0.397-0.391=0.005
max0.411-0.396=0.015
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2174.424=-6.323
σ0.010-0.013=-0.003
min2168.089-2174.405=-6.316
max2168.113-2174.433=-6.321
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean3.050-2.901=0.150
σ0.172-0.154=0.018
min2.811-2.773=0.038
max3.223-3.085=0.138
iters=5
new-facts=6402
prior-facts=1
mean5047.888-5052.593=-4.704
σ0.878-0.988=-0.110
min5047.414-5052.000=-4.587
max5049.450-5054.345=-4.895
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean8.830-8.941=-0.111
σ0.374-0.586=-0.211
min8.214-8.073=0.141
max9.122-9.552=-0.430
iters=5
new-facts=6402
prior-facts=6402
mean5178.908-5188.350=-9.442
σ0.263-0.127=0.136
min5178.625-5188.164=-9.539
max5179.149-5188.523=-9.374
mean3250.600-3225.400=25.200
σ328.141-461.621=-133.480
min2844.000-2718.000=126.000
max3695.000-3863.000=-168.000
mean9.855-8.729=1.126
σ0.323-0.115=0.208
min9.463-8.666=0.797
max10.222-8.935=1.287

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.085=-0.008
σ0.109-0.109=0.001
min0.944-0.941=0.004
max1.249-1.246=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-464.855=-1.651
σ572.653-572.656=-0.003
min176.873-178.518=-1.644
max1322.184-1323.839=-1.655
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean0.435-0.545=-0.110
σ0.304-0.519=-0.215
min0.282-0.282=0.000
max0.891-1.323=-0.432
policies=20
mean1769.005-1785.460=-16.456
σ0.331-0.342=-0.010
min1768.773-1785.230=-16.457
max1769.494-1785.968=-16.474
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean2.824-2.798=0.026
σ0.009-0.014=-0.005
min2.811-2.782=0.029
max2.831-2.816=0.015
policies=200
mean17696.164-17861.444=-165.280
σ0.533-0.422=0.112
min17695.728-17861.112=-165.384
max17696.910-17862.059=-165.149
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2844.000-2718.000=126.000
σ0.000
min2844.000-2718.000=126.000
max2844.000-2718.000=126.000
mean28.069-28.242=-0.174
σ0.545-0.212=0.333
min27.509-27.990=-0.481
max28.609-28.458=0.151