Compare commits

Home / Compare ef80919a .. 2cdbf2c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-30.959=0.000
σ0.049-0.049=0.000
min30.918-30.919=-0.001
max31.094-31.095=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.079-0.078=0.001
σ0.003-0.004=-0.000
min0.076-0.076=0.000
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.062-21.060=0.001
σ0.002-0.002=0.000
min21.058-21.057=0.002
max21.065-21.063=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.063=0.000
σ0.002-0.002=0.000
min0.062-0.061=0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.412=-0.002
σ0.362-0.361=0.002
min1750.841-1750.840=0.001
max1751.993-1751.978=0.015
mean1638.950-1641.850=-2.900
σ618.851-619.032=-0.181
min650.000-651.000=-1.000
max2475.000-2478.000=-3.000
mean2.765-2.796=-0.031
σ0.192-0.158=0.033
min2.321-2.271=0.050
max3.204-2.959=0.245

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.402-273.403=-0.002
σ0.014-0.011=0.003
min273.387-273.395=-0.008
max273.416-273.418=-0.002
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean0.384-0.387=-0.003
σ0.008-0.008=0.000
min0.376-0.377=-0.001
max0.395-0.398=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.844-1933.839=0.005
σ0.007-0.011=-0.004
min1933.835-1933.826=0.008
max1933.854-1933.850=0.004
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean3.109-2.913=0.196
σ0.133-0.262=-0.129
min2.976-2.471=0.506
max3.285-3.118=0.167
iters=5
new-facts=6402
prior-facts=1
mean4754.366-4754.357=0.009
σ0.844-0.853=-0.009
min4753.769-4753.735=0.034
max4755.846-4755.859=-0.013
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean8.812-8.648=0.164
σ0.889-0.610=0.279
min7.769-7.754=0.015
max10.152-9.465=0.686
iters=5
new-facts=6402
prior-facts=6402
mean4944.730-4944.803=-0.073
σ0.206-0.078=0.128
min4944.388-4944.737=-0.349
max4944.900-4944.888=0.012
mean2988.200-3015.200=-27.000
σ357.623-359.008=-1.385
min2530.000-2533.000=-3.000
max3332.000-3348.000=-16.000
mean8.627-8.873=-0.246
σ0.161-0.390=-0.229
min8.401-8.524=-0.123
max8.835-9.422=-0.587

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.801-1.705=0.096
σ0.081-0.137=-0.056
min1.697-1.590=0.108
max1.904-1.924=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.330-463.334=-0.005
σ572.194-572.196=-0.003
min177.231-177.233=-0.002
max1321.620-1321.629=-0.009
mean79.750
σ7.500
min76.000
max91.000
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean0.541-0.558=-0.017
σ0.532-0.548=-0.016
min0.271-0.278=-0.006
max1.339-1.380=-0.041
policies=20
mean1772.574-1772.562=0.013
σ0.332-0.316=0.016
min1772.351-1772.357=-0.006
max1773.066-1773.032=0.034
mean760.000
σ0.000
min760.000
max760.000
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean2.739-2.733=0.006
σ0.014-0.014=-0.000
min2.722-2.713=0.009
max2.753-2.744=0.008
policies=200
mean17732.234-17732.432=-0.198
σ0.488-0.570=-0.082
min17731.857-17732.058=-0.201
max17732.936-17733.269=-0.333
mean7600.000
σ0.000
min7600.000
max7600.000
mean2475.000-2478.000=-3.000
σ0.000
min2475.000-2478.000=-3.000
max2475.000-2478.000=-3.000
mean27.641-27.692=-0.051
σ0.107-0.161=-0.054
min27.507-27.571=-0.065
max27.766-27.929=-0.163