Compare commits

Home / Compare 9607b5f8 .. b95d5bd3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.001
σ0.049-0.051=-0.002
min31.003-31.003=-0.000
max31.176-31.182=-0.006
mean413.200-412.000=1.200
σ0.422-0.000=0.422
min413.000-412.000=1.000
max414.000-412.000=2.000
mean0.080-0.079=0.000
σ0.003-0.003=-0.000
min0.077-0.077=0.001
max0.087-0.086=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.003=-0.001
min21.140-21.138=0.002
max21.147-21.147=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.065=-0.001
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.412=-0.000
σ0.362-0.360=0.003
min1750.845-1750.842=0.003
max1751.996-1751.987=0.008
mean1637.600-1634.900=2.700
σ615.405-615.674=-0.269
min631.000-629.000=2.000
max2473.000-2470.000=3.000
mean2.843-2.849=-0.006
σ0.151-0.192=-0.041
min2.506-2.214=0.292
max3.027-3.048=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.765-266.784=-0.019
σ0.015-0.010=0.005
min266.752-266.774=-0.022
max266.790-266.799=-0.008
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean0.375-0.378=-0.003
σ0.002-0.009=-0.007
min0.373-0.372=0.001
max0.377-0.392=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1927.220-1927.207=0.013
σ0.014-0.011=0.003
min1927.206-1927.197=0.009
max1927.236-1927.223=0.013
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean2.915-2.999=-0.083
σ0.255-0.072=0.183
min2.476-2.890=-0.413
max3.126-3.088=0.037
iters=5
new-facts=6402
prior-facts=1
mean4747.726-4747.738=-0.012
σ0.816-0.822=-0.006
min4747.315-4747.220=0.095
max4749.184-4749.191=-0.007
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean8.322-8.317=0.004
σ0.680-0.531=0.150
min7.697-7.810=-0.113
max9.112-9.071=0.042
iters=5
new-facts=6402
prior-facts=6402
mean4938.088-4938.166=-0.079
σ0.124-0.082=0.043
min4937.899-4938.103=-0.204
max4938.247-4938.257=-0.011
mean2942.200-2943.600=-1.400
σ408.109-416.301=-8.192
min2483.000-2470.000=13.000
max3483.000-3514.000=-31.000
mean8.462-8.440=0.023
σ0.075-0.100=-0.026
min8.414-8.340=0.074
max8.595-8.577=0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.776-1.836=-0.060
σ0.060-0.102=-0.042
min1.704-1.718=-0.015
max1.853-1.947=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.107-465.112=-0.005
σ575.754-575.754=0.000
min177.230-177.234=-0.004
max1328.738-1328.743=-0.005
mean79.750
σ7.500
min76.000
max91.000
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean0.550-0.524=0.026
σ0.539-0.492=0.048
min0.276-0.276=-0.000
max1.359-1.261=0.098
policies=20
mean1772.547-1772.593=-0.046
σ0.340-0.347=-0.007
min1772.325-1772.364=-0.039
max1773.051-1773.108=-0.057
mean760.000
σ0.000
min760.000
max760.000
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean2.744-2.782=-0.038
σ0.023-0.025=-0.002
min2.726-2.754=-0.029
max2.777-2.815=-0.038
policies=200
mean17732.408-17732.440=-0.032
σ0.556-0.345=0.211
min17732.034-17732.232=-0.198
max17733.214-17732.955=0.260
mean7600.000
σ0.000
min7600.000
max7600.000
mean2473.000-2470.000=3.000
σ0.000
min2473.000-2470.000=3.000
max2473.000-2470.000=3.000
mean27.746-27.700=0.046
σ0.104-0.065=0.039
min27.639-27.634=0.005
max27.880-27.785=0.095