Compare commits

Home / Compare 9e91dec3 .. 6c8f8a51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956
σ0.103
min35.915
max36.248
mean414.000
σ0.000
min414.000
max414.000
mean0.077
σ0.005
min0.074
max0.085
cache=y
dps=1
iters=10
policies=100
mean26.203
σ0.005
min26.194
max26.208
mean414.000
σ0.000
min414.000
max414.000
mean0.059
σ0.003
min0.056
max0.068

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1740.743=15.561
σ0.368-0.352=0.016
min1755.729-1740.181=15.548
max1756.899-1741.313=15.586
mean1656.650-1646.350=10.300
σ631.303-616.822=14.481
min611.000-634.000=-23.000
max2725.000-2476.000=249.000
mean2.366-2.610=-0.243
σ0.093-0.163=-0.070
min2.273-2.181=0.093
max2.590-2.801=-0.211

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.828
σ0.004
min278.822
max278.830
mean2725.000
σ0.000
min2725.000
max2725.000
mean0.414
σ0.009
min0.406
max0.427
iters=5
new-facts=1
prior-facts=6402
mean2268.882
σ0.006
min2268.872
max2268.886
mean2725.000
σ0.000
min2725.000
max2725.000
mean2.995
σ0.108
min2.888
max3.119
iters=5
new-facts=6402
prior-facts=1
mean4954.281
σ0.838
min4953.803
max4955.775
mean2725.000
σ0.000
min2725.000
max2725.000
mean7.974
σ0.217
min7.722
max8.267
iters=5
new-facts=6402
prior-facts=6402
mean5168.753
σ0.224
min5168.375
max5168.911
mean3503.800
σ490.698
min2858.000
max4178.000
mean9.399
σ0.236
min9.050
max9.655

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.095-1.647=-0.552
σ0.189-0.111=0.079
min0.943-1.570=-0.627
max1.347-1.841=-0.494

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.822-454.597=5.225
σ571.585-572.515=-0.930
min174.023-168.339=5.685
max1317.199-1313.369=3.830
mean79.500
σ7.000
min76.000
max90.000
mean2725.000-432.000=2293.000
σ0.000
min2725.000-432.000=2293.000
max2725.000-432.000=2293.000
mean0.522-0.523=-0.001
σ0.503-0.515=-0.012
min0.269-0.258=0.011
max1.276-1.295=-0.019
policies=20
mean1740.426-1683.885=56.541
σ0.309-0.311=-0.002
min1740.229-1683.658=56.571
max1740.887-1684.340=56.547
mean760.000
σ0.000
min760.000
max760.000
mean2725.000-446.500=2278.500
σ0.000-11.561=-11.561
min2725.000-434.000=2291.000
max2725.000-462.000=2263.000
mean2.679-2.624=0.055
σ0.018-0.042=-0.024
min2.664-2.587=0.076
max2.705-2.672=0.032
policies=200
mean17411.283-16848.058=563.225
σ0.455-0.123=0.331
min17411.019-16847.938=563.081
max17411.962-16848.210=563.752
mean7600.000
σ0.000
min7600.000
max7600.000
mean2725.000-492.500=2232.500
σ0.000-3.873=-3.873
min2725.000-488.000=2237.000
max2725.000-497.000=2228.000
mean27.049-26.076=0.974
σ0.043-0.066=-0.023
min27.018-25.988=1.029
max27.111-26.141=0.970