Compare commits

Home / Compare be3345bb .. 7a324799

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.050=-0.001
min31.006-31.003=0.003
max31.178-31.178=-0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.079-0.078=0.002
σ0.004-0.005=-0.001
min0.077-0.072=0.005
max0.087-0.086=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.002
σ0.003-0.002=0.001
min21.141-21.137=0.004
max21.150-21.145=0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=0.001
σ0.360-0.361=-0.001
min1750.838-1750.840=-0.002
max1751.998-1751.992=0.006
mean1655.600-1643.100=12.500
σ645.273-616.063=29.210
min633.000-631.000=2.000
max2852.000-2478.000=374.000
mean2.841-2.815=0.026
σ0.129-0.151=-0.023
min2.498-2.351=0.147
max3.024-2.987=0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-271.647=-4.866
σ0.010-0.011=-0.002
min266.773-271.637=-4.864
max266.797-271.661=-4.864
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean0.367-0.383=-0.016
σ0.006-0.008=-0.001
min0.363-0.377=-0.014
max0.379-0.395=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1927.207-1932.106=-4.899
σ0.003-0.022=-0.019
min1927.204-1932.069=-4.865
max1927.211-1932.122=-4.911
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean3.068-2.629=0.440
σ0.123-0.111=0.013
min2.972-2.516=0.456
max3.260-2.761=0.499
iters=5
new-facts=6402
prior-facts=1
mean4747.699-4752.612=-4.913
σ0.848-0.851=-0.003
min4747.190-4752.121=-4.931
max4749.207-4754.119=-4.911
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean8.484-8.371=0.112
σ0.609-0.404=0.204
min7.677-7.909=-0.232
max9.198-8.874=0.324
iters=5
new-facts=6402
prior-facts=6402
mean4938.166-4943.045=-4.879
σ0.087-0.080=0.007
min4938.090-4942.978=-4.889
max4938.269-4943.139=-4.870
mean3058.200-2946.200=112.000
σ187.182-421.038=-233.856
min2852.000-2478.000=374.000
max3322.000-3514.000=-192.000
mean8.593-8.447=0.147
σ0.281-0.088=0.193
min8.369-8.326=0.043
max8.925-8.575=0.350

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.722=-0.640
σ0.111-0.145=-0.034
min0.946-1.550=-0.604
max1.256-1.873=-0.617

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.121-465.114=0.007
σ575.766-575.755=0.011
min177.229-177.231=-0.002
max1328.770-1328.747=0.023
mean79.750
σ7.500
min76.000
max91.000
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean0.439-0.535=-0.097
σ0.305-0.509=-0.204
min0.283-0.279=0.005
max0.896-1.299=-0.403
policies=20
mean1772.617-1772.586=0.031
σ0.337-0.331=0.006
min1772.367-1772.355=0.012
max1773.111-1773.076=0.035
mean760.000
σ0.000
min760.000
max760.000
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean2.826-2.769=0.057
σ0.006-0.027=-0.021
min2.819-2.751=0.068
max2.833-2.810=0.023
policies=200
mean17732.544-17732.384=0.160
σ0.383-0.607=-0.224
min17732.278-17731.986=0.292
max17733.111-17733.280=-0.169
mean7600.000
σ0.000
min7600.000
max7600.000
mean2852.000-2478.000=374.000
σ0.000
min2852.000-2478.000=374.000
max2852.000-2478.000=374.000
mean28.108-27.794=0.314
σ0.473-0.149=0.324
min27.575-27.672=-0.098
max28.563-28.010=0.552