Compare commits

Home / Compare 6a642bf4 .. 2daa1394

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.977-35.977=-0.001
σ0.104-0.098=0.007
min35.929-35.934=-0.005
max36.273-36.255=0.018
mean3715.000-3975.000=-260.000
σ0.000
min3715.000-3975.000=-260.000
max3715.000-3975.000=-260.000
mean0.074-0.091=-0.017
σ0.002-0.070=-0.068
min0.072-0.069=0.003
max0.080-0.290=-0.210
cache=y
dps=1
iters=10
policies=100
mean26.209-26.204=0.006
σ0.009-0.014=-0.004
min26.200-26.196=0.004
max26.233-26.241=-0.009
mean3715.000-3975.000=-260.000
σ0.000
min3715.000-3975.000=-260.000
max3715.000-3975.000=-260.000
mean0.059-0.032=0.026
σ0.002-0.003=-0.000
min0.054-0.029=0.025
max0.064-0.037=0.026

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.358=-0.000
σ0.373-0.372=0.001
min1755.784-1755.785=-0.000
max1756.962-1756.963=-0.001
mean1631.750-1660.150=-28.400
σ624.392-646.289=-21.897
min622.000
max2816.000-2851.000=-35.000
mean2.242-2.251=-0.009
σ0.084-0.074=0.009
min2.132-2.151=-0.020
max2.376-2.389=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.676-278.681=-0.005
σ0.012-0.006=0.006
min278.661-278.672=-0.011
max278.692-278.689=0.003
mean2816.000-2851.000=-35.000
σ0.000
min2816.000-2851.000=-35.000
max2816.000-2851.000=-35.000
mean0.422-0.418=0.004
σ0.010-0.001=0.009
min0.416-0.416=0.000
max0.440-0.419=0.021
iters=5
new-facts=1
prior-facts=6402
mean2268.845-2268.846=-0.001
σ0.010-0.007=0.003
min2268.830-2268.835=-0.005
max2268.855-2268.853=0.002
mean2816.000-2851.000=-35.000
σ0.000
min2816.000-2851.000=-35.000
max2816.000-2851.000=-35.000
mean3.148-2.963=0.185
σ0.225-0.129=0.096
min2.791-2.887=-0.096
max3.349-3.192=0.157
iters=5
new-facts=6402
prior-facts=1
mean4952.203-4952.203=-0.000
σ0.766-0.747=0.019
min4951.816-4951.836=-0.020
max4953.571-4953.538=0.033
mean2816.000-2851.000=-35.000
σ0.000
min2816.000-2851.000=-35.000
max2816.000-2851.000=-35.000
mean7.730-7.723=0.007
σ0.148-0.097=0.052
min7.586-7.639=-0.053
max7.915-7.833=0.082
iters=5
new-facts=6402
prior-facts=6402
mean5166.891-5166.823=0.068
σ0.022-0.163=-0.141
min5166.868-5166.532=0.335
max5166.915-5166.911=0.005
mean3335.800-3390.400=-54.600
σ389.056-422.393=-33.337
min2938.000-2851.000=87.000
max3715.000-3975.000=-260.000
mean8.758-8.728=0.030
σ0.337-0.125=0.212
min8.459-8.628=-0.169
max9.133-8.937=0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.468-0.971=0.496
σ0.240-0.060=0.180
min1.166-0.922=0.244
max1.783-1.074=0.709

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.254-460.254=0.000
σ572.608-572.608=-0.000
min173.950-173.950=0.000
max1319.166-1319.166=0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.567-0.558=0.009
σ0.582-0.562=0.020
min0.268-0.273=-0.006
max1.440-1.401=0.039
policies=20
mean1740.007-1740.007=-0.000
σ0.339-0.338=0.001
min1739.762-1739.770=-0.008
max1740.505-1740.505=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean446.250-446.750=-0.500
σ9.032-9.605=-0.572
min437.000
max454.000-455.000=-1.000
mean2.672-2.672=-0.001
σ0.015-0.013=0.002
min2.656-2.655=0.002
max2.690-2.686=0.004
policies=200
mean17409.205-17409.198=0.007
σ0.126-0.062=0.064
min17409.039-17409.142=-0.103
max17409.327-17409.268=0.059
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.000-487.250=0.750
σ0.000-0.957=-0.957
min488.000-486.000=2.000
max488.000
mean26.874-26.966=-0.093
σ0.098-0.162=-0.064
min26.761-26.805=-0.044
max26.991-27.138=-0.147