Compare commits

Home / Compare 169cd317 .. 17cbeb67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.108=-0.001
min35.754-35.751=0.003
max36.099-36.104=-0.006
mean410.000-411.000=-1.000
σ0.000
min410.000-411.000=-1.000
max410.000-411.000=-1.000
mean0.073-0.076=-0.003
σ0.003-0.003=0.000
min0.069-0.074=-0.005
max0.077-0.084=-0.007
cache=y
dps=1
iters=10
policies=100
mean26.066-26.065=0.001
σ0.003-0.004=-0.001
min26.062-26.058=0.003
max26.071-26.072=-0.001
mean410.600-411.000=-0.400
σ0.516-0.000=0.516
min410.000-411.000=-1.000
max411.000
mean0.061-0.060=0.000
σ0.003-0.003=-0.000
min0.059-0.057=0.002
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.924=-4.688
σ0.361-0.367=-0.005
min1750.670-1755.354=-4.685
max1751.803-1756.514=-4.712
mean1651.550-1658.400=-6.850
σ643.493-637.852=5.641
min624.000-620.000=4.000
max2844.000-2699.000=145.000
mean2.810-2.772=0.038
σ0.147-0.202=-0.055
min2.462-2.297=0.165
max3.012-3.077=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.198=-1.630
σ0.007-0.008=-0.001
min275.557-277.188=-1.631
max275.575-277.208=-1.633
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean0.404-0.407=-0.002
σ0.007-0.008=-0.001
min0.397-0.399=-0.002
max0.411-0.419=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2174.432=-6.332
σ0.010-0.011=-0.001
min2168.089-2174.421=-6.332
max2168.113-2174.448=-6.336
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean3.050-2.987=0.064
σ0.172-0.138=0.034
min2.811-2.771=0.039
max3.223-3.096=0.127
iters=5
new-facts=6402
prior-facts=1
mean5047.888-5052.644=-4.756
σ0.878-0.995=-0.117
min5047.414-5051.999=-4.586
max5049.450-5054.404=-4.954
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean8.830-8.682=0.147
σ0.374-0.730=-0.356
min8.214-8.083=0.131
max9.122-9.807=-0.685
iters=5
new-facts=6402
prior-facts=6402
mean5178.908-5188.424=-9.516
σ0.263-0.089=0.174
min5178.625-5188.350=-9.726
max5179.149-5188.521=-9.373
mean3250.600-3283.000=-32.400
σ328.141-426.320=-98.179
min2844.000-2699.000=145.000
max3695.000-3680.000=15.000
mean9.855-9.025=0.830
σ0.323-0.321=0.002
min9.463-8.826=0.637
max10.222-9.582=0.640

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.092=-0.016
σ0.109-0.137=-0.027
min0.944-0.958=-0.014
max1.249-1.260=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-464.859=-1.654
σ572.653-572.656=-0.004
min176.873-178.526=-1.653
max1322.184-1323.843=-1.659
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean0.435-0.567=-0.132
σ0.304-0.570=-0.266
min0.282-0.276=0.005
max0.891-1.421=-0.530
policies=20
mean1769.005-1785.487=-16.482
σ0.331-0.352=-0.021
min1768.773-1785.250=-16.476
max1769.494-1786.010=-16.516
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean2.824-2.787=0.037
σ0.009-0.013=-0.004
min2.811-2.769=0.043
max2.831-2.798=0.033
policies=200
mean17696.164-17861.517=-165.353
σ0.533-0.510=0.024
min17695.728-17861.236=-165.507
max17696.910-17862.281=-165.371
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2844.000-2699.000=145.000
σ0.000
min2844.000-2699.000=145.000
max2844.000-2699.000=145.000
mean28.069-28.178=-0.109
σ0.545-0.143=0.402
min27.509-28.037=-0.528
max28.609-28.311=0.298