Compare commits

Home / Compare 846a1be7 .. 1f79de0c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.855-30.855=0.000
σ0.047-0.046=0.001
min30.835-30.832=0.003
max30.988-30.983=0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.078-0.079=-0.001
σ0.005-0.004=0.001
min0.070-0.072=-0.002
max0.087-0.087=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.141-21.142=-0.000
σ0.004-0.004=-0.000
min21.138-21.136=0.001
max21.148-21.151=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.064=0.000
σ0.002-0.004=-0.002
min0.063-0.057=0.005
max0.070-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.235=0.000
σ0.362-0.361=0.000
min1750.668-1750.667=0.001
max1751.813-1751.818=-0.006
mean1654.450-1668.000=-13.550
σ629.932-639.191=-9.259
min688.000-681.000=7.000
max2769.000-2698.000=71.000
mean2.752-2.794=-0.042
σ0.219-0.151=0.067
min2.275-2.401=-0.126
max3.102-2.998=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.564=0.005
σ0.007-0.007=-0.000
min275.563-275.557=0.006
max275.580-275.575=0.005
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean0.390-0.393=-0.003
σ0.007-0.009=-0.002
min0.386-0.386=0.000
max0.403-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2168.097=-0.008
σ0.014-0.008=0.006
min2168.076-2168.086=-0.011
max2168.110-2168.108=0.001
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean3.022-2.987=0.035
σ0.201-0.154=0.047
min2.725-2.790=-0.065
max3.168-3.137=0.031
iters=5
new-facts=6402
prior-facts=1
mean5047.886-5047.899=-0.013
σ0.901-0.914=-0.013
min5047.401-5047.400=0.000
max5049.492-5049.529=-0.037
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean8.857-8.898=-0.041
σ0.354-0.456=-0.102
min8.226-8.173=0.053
max9.048-9.318=-0.270
iters=5
new-facts=6402
prior-facts=6402
mean5179.051-5179.055=-0.004
σ0.090-0.082=0.008
min5178.962-5178.971=-0.009
max5179.151-5179.147=0.004
mean3250.800-3234.200=16.600
σ355.287-395.427=-40.140
min2769.000-2698.000=71.000
max3691.000-3742.000=-51.000
mean9.907-10.214=-0.308
σ0.359-0.649=-0.289
min9.359-9.680=-0.321
max10.295-11.343=-1.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.058=0.032
σ0.264-0.149=0.115
min0.939-0.947=-0.009
max1.551-1.248=0.302

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.206=-0.001
σ572.669-572.658=0.011
min176.868-176.867=0.001
max1322.208-1322.192=0.016
mean77.500
σ7.000
min74.000
max88.000
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean0.465-0.547=-0.082
σ0.379-0.549=-0.170
min0.274-0.271=0.003
max1.034-1.370=-0.336
policies=20
mean1768.971-1768.948=0.024
σ0.319-0.339=-0.020
min1768.752-1768.726=0.026
max1769.444-1769.452=-0.008
mean740.000
σ0.000
min740.000
max740.000
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean2.731-2.751=-0.019
σ0.007-0.027=-0.020
min2.724-2.725=-0.001
max2.740-2.787=-0.046
policies=200
mean17695.981-17696.243=-0.262
σ0.520-0.534=-0.014
min17695.632-17695.928=-0.296
max17696.740-17697.039=-0.299
mean7400.000
σ0.000
min7400.000
max7400.000
mean2769.000-2698.000=71.000
σ0.000
min2769.000-2698.000=71.000
max2769.000-2698.000=71.000
mean27.654-27.696=-0.042
σ0.072-0.154=-0.082
min27.550-27.541=0.010
max27.710-27.862=-0.152