Compare commits

Home / Compare 5a625c02 .. d8462947

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.107=-0.001
min35.755-35.751=0.003
max36.100-36.104=-0.004
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.074-0.075=-0.001
σ0.005-0.004=0.001
min0.069-0.070=-0.001
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.066-26.065=0.001
σ0.003-0.004=-0.001
min26.062-26.060=0.002
max26.070-26.071=-0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.061-0.061=0.000
σ0.003-0.002=0.001
min0.059-0.060=-0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.924=-0.002
σ0.368-0.365=0.003
min1755.352-1755.351=0.001
max1756.519-1756.513=0.006
mean1662.550-1666.300=-3.750
σ631.246-629.443=1.803
min663.000-671.000=-8.000
max2613.000-2663.000=-50.000
mean2.779-2.797=-0.018
σ0.207-0.159=0.048
min2.269-2.320=-0.051
max3.038-2.977=0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.200-277.196=0.004
σ0.008-0.006=0.002
min277.192-277.190=0.002
max277.209-277.205=0.005
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean0.410-0.407=0.003
σ0.015-0.008=0.007
min0.399-0.399=-0.000
max0.430-0.416=0.014
iters=5
new-facts=1
prior-facts=6402
mean2174.426-2174.427=-0.001
σ0.016-0.017=-0.001
min2174.399-2174.410=-0.011
max2174.436-2174.451=-0.015
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean2.825-3.126=-0.301
σ0.115-0.214=-0.098
min2.743-2.836=-0.094
max3.027-3.433=-0.406
iters=5
new-facts=6402
prior-facts=1
mean5052.490-5052.602=-0.112
σ1.121-0.941=0.180
min5051.498-5051.991=-0.493
max5054.424-5054.268=0.156
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean8.929-8.833=0.096
σ0.697-0.591=0.106
min8.062-8.172=-0.110
max9.823-9.372=0.451
iters=5
new-facts=6402
prior-facts=6402
mean5188.417-5188.413=0.004
σ0.095-0.073=0.022
min5188.329-5188.359=-0.029
max5188.521-5188.526=-0.004
mean3239.200-3282.600=-43.400
σ363.234-423.635=-60.401
min2830.000-2684.000=146.000
max3779.000-3672.000=107.000
mean8.758-8.978=-0.220
σ0.127-0.317=-0.190
min8.572-8.700=-0.128
max8.885-9.493=-0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.189=0.154
σ0.423-0.272=0.151
min0.944-0.947=-0.003
max1.837-1.501=0.336

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-464.863=-0.007
σ572.661-572.671=-0.009
min178.522-178.524=-0.002
max1323.848-1323.869=-0.021
mean79.500
σ7.000
min76.000
max90.000
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean0.566-0.552=0.014
σ0.556-0.528=0.028
min0.281-0.282=-0.001
max1.400-1.344=0.056
policies=20
mean1785.487-1785.485=0.002
σ0.352-0.348=0.004
min1785.257-1785.262=-0.005
max1786.010-1786.003=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean2.786-2.780=0.006
σ0.023-0.011=0.012
min2.755-2.766=-0.012
max2.807-2.793=0.014
policies=200
mean17861.398-17861.522=-0.125
σ0.595-0.393=0.202
min17861.062-17861.314=-0.252
max17862.289-17862.112=0.178
mean7600.000
σ0.000
min7600.000
max7600.000
mean2613.000-2663.000=-50.000
σ0.000
min2613.000-2663.000=-50.000
max2613.000-2663.000=-50.000
mean28.119-28.109=0.010
σ0.188-0.386=-0.198
min27.981-27.592=0.390
max28.387-28.478=-0.091