Compare commits

Home / Compare 60b59342 .. 153df320

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.973-53.972=0.000
σ0.365-0.365=0.000
min53.839-53.838=0.001
max55.011-55.010=0.001
mean416.800-415.800=1.000
σ0.422
min416.000-415.000=1.000
max417.000-416.000=1.000
mean0.140-0.139=0.000
σ0.003-0.004=-0.001
min0.137-0.136=0.001
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.177-43.177=-0.000
σ0.006-0.006=0.000
min43.166-43.164=0.002
max43.189-43.183=0.005
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.121=-0.001
σ0.004-0.003=0.001
min0.114-0.119=-0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.847-994.836=0.010
σ1.266-1.248=0.018
min994.264-994.292=-0.027
max1000.176-1000.091=0.084
mean1067.800-1064.050=3.750
σ317.703-321.498=-3.795
min578.000-570.000=8.000
max1616.000-1624.000=-8.000
mean1.473-1.476=-0.003
σ0.102-0.099=0.003
min1.350-1.263=0.088
max1.813-1.657=0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.290-297.290=-0.000
σ0.004-0.013=-0.009
min297.285-297.275=0.010
max297.294-297.307=-0.013
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean0.382-0.389=-0.007
σ0.005-0.007=-0.003
min0.379-0.381=-0.001
max0.390-0.397=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1298.543-1298.541=0.002
σ0.138-0.134=0.004
min1298.476-1298.475=0.001
max1298.789-1298.780=0.009
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean1.909-1.936=-0.027
σ0.054-0.064=-0.010
min1.862-1.859=0.003
max1.995-2.003=-0.007
iters=5
new-facts=6402
prior-facts=1
mean1820.781-1820.759=0.022
σ7.019-7.032=-0.014
min1817.439-1817.366=0.073
max1833.323-1833.323=-0.001
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean4.219-4.104=0.115
σ0.120-0.177=-0.057
min4.091-3.840=0.251
max4.410-4.259=0.151
iters=5
new-facts=6402
prior-facts=6402
mean2083.377-2083.378=-0.002
σ0.009-0.007=0.002
min2083.369-2083.366=0.003
max2083.393-2083.384=0.008
mean1839.000-1849.600=-10.600
σ215.000-200.131=14.869
min1616.000-1624.000=-8.000
max2083.000-2080.000=3.000
mean4.474-4.605=-0.131
σ0.103-0.160=-0.058
min4.333-4.477=-0.143
max4.620-4.859=-0.239

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.234-1.302=-0.069
σ0.341-0.351=-0.010
min0.952-0.905=0.047
max1.771-1.812=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.380-440.382=-0.001
σ572.875-572.875=-0.001
min153.935-153.935=0.000
max1299.692-1299.694=-0.002
mean94.250
σ8.500
min90.000
max107.000
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean0.537-0.545=-0.007
σ0.563-0.551=0.011
min0.254-0.267=-0.013
max1.381-1.372=0.009
policies=20
mean1539.594-1539.590=0.005
σ0.310-0.305=0.006
min1539.399-1539.396=0.003
max1540.057-1540.044=0.013
mean900.000
σ0.000
min900.000
max900.000
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean2.577-2.566=0.011
σ0.035-0.039=-0.003
min2.541-2.531=0.010
max2.625-2.619=0.005
policies=200
mean15404.044-15403.810=0.234
σ0.097-0.117=-0.020
min15403.921-15403.666=0.255
max15404.131-15403.950=0.181
mean9000.000
σ0.000
min9000.000
max9000.000
mean1616.000-1624.000=-8.000
σ0.000
min1616.000-1624.000=-8.000
max1616.000-1624.000=-8.000
mean26.037-25.881=0.156
σ0.200-0.181=0.019
min25.874-25.699=0.175
max26.323-26.092=0.231