Compare commits

Home / Compare f29e369c .. 7adcafb5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.646=0.001
σ0.367-0.367=0.000
min53.511-53.513=-0.002
max54.691-54.688=0.002
mean414.800-417.000=-2.200
σ0.422-0.000=0.422
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.138-0.137=0.001
σ0.004-0.004=0.000
min0.131-0.132=-0.001
max0.143-0.144=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.943-42.942=0.002
σ0.006-0.007=-0.001
min42.934-42.932=0.002
max42.955-42.956=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.118=0.004
σ0.003-0.003=-0.000
min0.119-0.114=0.005
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.867-991.865=0.002
σ1.194-1.222=-0.028
min991.324-991.271=0.053
max996.875-996.968=-0.093
mean1060.250-1072.850=-12.600
σ319.514-328.970=-9.457
min588.000-580.000=8.000
max1552.000-1656.000=-104.000
mean1.520-1.564=-0.045
σ0.061-0.155=-0.094
min1.457-1.464=-0.007
max1.633-2.159=-0.527

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.442=-0.033
σ0.009-0.008=0.001
min285.395-285.428=-0.033
max285.417-285.451=-0.034
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean0.377-0.386=-0.009
σ0.007-0.015=-0.009
min0.372-0.376=-0.003
max0.388-0.412=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1285.522-1285.494=0.028
σ0.068-0.085=-0.018
min1285.405-1285.348=0.057
max1285.567-1285.567=-0.000
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean1.876-1.899=-0.024
σ0.099-0.034=0.065
min1.817-1.859=-0.042
max2.049-1.941=0.108
iters=5
new-facts=6402
prior-facts=1
mean1705.834-1705.834=-0.001
σ6.853-6.863=-0.009
min1702.657-1702.648=0.009
max1718.091-1718.107=-0.016
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean2.913-3.102=-0.189
σ0.200-0.328=-0.128
min2.776-2.813=-0.037
max3.267-3.641=-0.374
iters=5
new-facts=6402
prior-facts=6402
mean1968.437-1968.382=0.055
σ0.004-0.052=-0.048
min1968.433-1968.335=0.098
max1968.444-1968.446=-0.002
mean1842.000-1794.400=47.600
σ183.138-140.884=42.254
min1613.000-1656.000=-43.000
max2056.000-1983.000=73.000
mean3.190-3.268=-0.078
σ0.109-0.416=-0.307
min3.019-3.059=-0.039
max3.304-4.011=-0.707

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.510-1.141=0.368
σ0.278-0.287=-0.010
min1.188-0.908=0.280
max1.750-1.610=0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.769-436.775=-0.006
σ572.357-572.366=-0.009
min150.587-150.590=-0.003
max1295.304-1295.324=-0.020
mean90.250
σ8.500
min86.000
max103.000
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean0.516-0.531=-0.015
σ0.525-0.561=-0.035
min0.251-0.249=0.001
max1.304-1.372=-0.068
policies=20
mean1506.179-1506.193=-0.014
σ0.240-0.245=-0.005
min1506.011-1506.043=-0.032
max1506.535-1506.558=-0.024
mean860.000
σ0.000
min860.000
max860.000
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean2.515-2.533=-0.019
σ0.015-0.032=-0.018
min2.503-2.506=-0.003
max2.535-2.571=-0.037
policies=200
mean15069.539-15069.453=0.086
σ0.032-0.108=-0.076
min15069.508-15069.345=0.163
max15069.583-15069.601=-0.018
mean8600.000
σ0.000
min8600.000
max8600.000
mean1552.000-1656.000=-104.000
σ0.000
min1552.000-1656.000=-104.000
max1552.000-1656.000=-104.000
mean25.549-25.545=0.004
σ0.124-0.135=-0.010
min25.405-25.416=-0.011
max25.662-25.698=-0.036