Compare commits

Home / Compare 61143b49 .. 4926a89f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.727=0.000
σ0.687-0.614=0.072
min35.922-35.928=-0.006
max37.531-37.213=0.318
mean3924.000-3829.000=95.000
σ0.000
min3924.000-3829.000=95.000
max3924.000-3829.000=95.000
mean0.075-0.076=-0.001
σ0.001-0.002=-0.001
min0.074-0.075=-0.000
max0.077-0.081=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.587-26.713=-0.126
σ0.606-0.647=-0.041
min26.205-26.205=0.000
max27.465-27.469=-0.004
mean3924.000-3829.000=95.000
σ0.000
min3924.000-3829.000=95.000
max3924.000-3829.000=95.000
mean0.060-0.061=-0.000
σ0.001-0.001=-0.001
min0.059-0.060=-0.001
max0.062-0.065=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.366=0.001
σ0.373-0.372=0.001
min1755.800-1755.789=0.011
max1756.960-1756.956=0.003
mean1652.000-1663.750=-11.750
σ632.187-632.515=-0.328
min620.000-684.000=-64.000
max2594.000-2616.000=-22.000
mean2.324-2.222=0.102
σ0.185-0.071=0.114
min2.145-2.141=0.004
max2.741-2.345=0.397

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.698-278.698=-0.000
σ0.015-0.013=0.002
min278.682-278.683=-0.001
max278.721-278.715=0.006
mean2594.000-2616.000=-22.000
σ0.000
min2594.000-2616.000=-22.000
max2594.000-2616.000=-22.000
mean0.425-0.417=0.008
σ0.012-0.002=0.010
min0.416-0.415=0.001
max0.439-0.419=0.019
iters=5
new-facts=1
prior-facts=6402
mean2268.867-2268.854=0.013
σ0.009-0.024=-0.015
min2268.853-2268.825=0.029
max2268.875-2268.874=0.002
mean2594.000-2616.000=-22.000
σ0.000
min2594.000-2616.000=-22.000
max2594.000-2616.000=-22.000
mean2.985-3.140=-0.155
σ0.144-0.148=-0.004
min2.887-2.912=-0.025
max3.240-3.272=-0.032
iters=5
new-facts=6402
prior-facts=1
mean4952.244-4952.120=0.124
σ0.962-0.713=0.250
min4951.431-4951.416=0.015
max4953.914-4953.317=0.597
mean2594.000-2616.000=-22.000
σ0.000
min2594.000-2616.000=-22.000
max2594.000-2616.000=-22.000
mean7.934-7.892=0.043
σ0.288-0.381=-0.093
min7.636-7.555=0.080
max8.366-8.547=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean5167.076-5167.067=0.008
σ0.014-0.015=-0.001
min5167.062-5167.055=0.007
max5167.098-5167.093=0.005
mean3374.400-3366.600=7.800
σ425.087-452.598=-27.510
min2801.000-2925.000=-124.000
max3924.000-3829.000=95.000
mean9.300-9.106=0.194
σ0.229-0.422=-0.194
min9.066-8.547=0.519
max9.557-9.705=-0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.557=-0.476
σ0.093-0.376=-0.283
min0.946-1.081=-0.135
max1.209-1.860=-0.651

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.261-460.257=0.004
σ572.607-572.608=-0.000
min173.955-173.952=0.003
max1319.172-1319.169=0.003
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.550-0.559=-0.008
σ0.562-0.563=-0.001
min0.263-0.274=-0.011
max1.393-1.402=-0.009
policies=20
mean1740.066-1740.045=0.022
σ0.326-0.332=-0.006
min1739.832-1739.798=0.034
max1740.545-1740.530=0.015
mean760.000
σ0.000
min760.000
max760.000
mean446.250
σ9.032-9.179=-0.146
min437.000-436.000=1.000
max454.000
mean2.653-2.665=-0.013
σ0.023-0.008=0.015
min2.633-2.658=-0.025
max2.683-2.675=0.009
policies=200
mean17409.864-17409.776=0.089
σ0.076-0.059=0.018
min17409.774-17409.711=0.062
max17409.960-17409.841=0.119
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.750
σ4.856-3.096=1.761
min486.000-488.000=-2.000
max497.000-495.000=2.000
mean26.828-26.837=-0.009
σ0.022-0.164=-0.142
min26.801-26.684=0.117
max26.854-27.065=-0.210