Compare commits

Home / Compare 6dc26adb .. 5334d425

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.770=0.271
σ0.049-0.047=0.003
min31.002-30.729=0.274
max31.178-30.898=0.280
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.079-0.077=0.002
σ0.002-0.004=-0.002
min0.076-0.071=0.005
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.061=0.081
σ0.002-0.002=-0.000
min21.138-21.058=0.081
max21.146-21.065=0.081
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.420=-0.007
σ0.363-0.359=0.004
min1750.846-1750.856=-0.010
max1752.002-1752.004=-0.002
mean1637.900-1661.350=-23.450
σ616.745-625.830=-9.085
min625.000-657.000=-32.000
max2474.000-2513.000=-39.000
mean2.861-2.828=0.034
σ0.153-0.144=0.010
min2.384-2.451=-0.066
max3.053-3.154=-0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.785-275.754=-8.969
σ0.004-0.010=-0.005
min266.781-275.743=-8.962
max266.792-275.765=-8.973
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean0.373-0.392=-0.019
σ0.002-0.006=-0.004
min0.371-0.387=-0.016
max0.375-0.400=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1927.204-2168.271=-241.066
σ0.012-0.011=0.001
min1927.185-2168.258=-241.073
max1927.219-2168.285=-241.066
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean3.056-2.858=0.198
σ0.095-0.097=-0.002
min2.960-2.773=0.187
max3.186-2.971=0.215
iters=5
new-facts=6402
prior-facts=1
mean4747.767-5048.110=-300.343
σ0.785-0.958=-0.173
min4747.357-5047.533=-300.176
max4749.163-5049.814=-300.651
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean8.165-8.847=-0.683
σ0.425-0.561=-0.136
min7.861-8.007=-0.146
max8.911-9.468=-0.557
iters=5
new-facts=6402
prior-facts=6402
mean4938.171-5179.237=-241.066
σ0.083-0.091=-0.008
min4938.106-5179.158=-241.052
max4938.264-5179.345=-241.081
mean2939.800-3268.400=-328.600
σ389.762-508.844=-119.082
min2474.000-2647.000=-173.000
max3466.000-3955.000=-489.000
mean8.473-10.027=-1.555
σ0.162-0.110=0.053
min8.329-9.932=-1.603
max8.717-10.178=-1.461

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.839-1.740=0.099
σ0.148-0.136=0.012
min1.610-1.526=0.084
max1.979-1.853=0.126

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.109-463.568=1.541
σ575.755-572.653=3.102
min177.232-177.239=-0.008
max1328.741-1322.547=6.194
mean79.750
σ7.500
min76.000
max91.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean0.575-0.561=0.013
σ0.590-0.567=0.023
min0.276-0.275=0.001
max1.460-1.412=0.048
policies=20
mean1772.584-1772.640=-0.056
σ0.340-0.331=0.009
min1772.350-1772.412=-0.062
max1773.088-1773.130=-0.042
mean760.000
σ0.000
min760.000
max760.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean2.762-2.775=-0.013
σ0.006-0.069=-0.063
min2.753-2.716=0.037
max2.766-2.871=-0.105
policies=200
mean17732.357-17733.030=-0.672
σ0.454-0.453=0.001
min17732.052-17732.742=-0.690
max17733.021-17733.704=-0.683
mean7600.000
σ0.000
min7600.000
max7600.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean27.658-27.671=-0.012
σ0.078-0.104=-0.026
min27.544-27.616=-0.072
max27.713-27.826=-0.114