Compare commits

Home / Compare 175f93c1 .. 9d722f05

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-70.706=-35.462
σ0.053-0.046=0.007
min35.221-70.673=-35.453
max35.395-70.835=-35.440
mean415.000
σ0.000
min415.000
max415.000
mean0.085-0.159=-0.074
σ0.003-0.004=-0.001
min0.083-0.152=-0.069
max0.091-0.166=-0.075
cache=y
dps=1
iters=10
policies=100
mean23.770-21.411=2.359
σ0.002-0.002=0.000
min23.766-21.408=2.358
max23.773-21.415=2.358
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.069-0.065=0.004
σ0.004-0.002=0.002
min0.066-0.063=0.003
max0.077-0.072=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.595-1755.161=1.434
σ0.366-0.360=0.007
min1756.022-1754.598=1.424
max1757.184-1755.740=1.444
mean1642.400-1632.600=9.800
σ632.311-597.117=35.194
min623.000-634.000=-11.000
max2699.000-2434.000=265.000
mean2.364-2.770=-0.406
σ0.113-0.217=-0.104
min2.191-2.180=0.010
max2.583-3.224=-0.641

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.585-272.797=51.788
σ0.054-0.004=0.050
min324.488-272.792=51.696
max324.614-272.801=51.813
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean0.431-0.383=0.047
σ0.013-0.009=0.003
min0.421-0.378=0.042
max0.453-0.400=0.053
iters=5
new-facts=1
prior-facts=6402
mean1985.374-1933.452=51.922
σ0.009-0.013=-0.004
min1985.364-1933.433=51.931
max1985.385-1933.469=51.917
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean2.692-3.097=-0.405
σ0.139-0.097=0.042
min2.543-3.010=-0.467
max2.887-3.256=-0.369
iters=5
new-facts=6402
prior-facts=1
mean4808.749-4757.180=51.569
σ7.858-7.573=0.285
min4804.893-4753.696=51.198
max4822.795-4770.727=52.068
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean8.894-8.525=0.370
σ0.338-0.382=-0.044
min8.579-7.939=0.640
max9.300-8.991=0.309
iters=5
new-facts=6402
prior-facts=6402
mean4996.526-4944.615=51.911
σ0.129-0.162=-0.034
min4996.297-4944.326=51.971
max4996.596-4944.708=51.888
mean3044.000-2948.600=95.400
σ290.025-400.414=-110.389
min2699.000-2450.000=249.000
max3332.000-3493.000=-161.000
mean8.990-8.544=0.447
σ0.490-0.232=0.259
min8.518-8.302=0.216
max9.597-8.861=0.736

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.637=-0.630
σ0.142-0.127=0.015
min0.911-1.462=-0.551
max1.240-1.778=-0.538

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.958-468.306=-5.348
σ574.254-574.228=0.026
min175.824-181.186=-5.363
max1324.339-1329.648=-5.310
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean0.559-0.558=0.000
σ0.564-0.546=0.018
min0.275-0.283=-0.008
max1.404-1.378=0.026
policies=20
mean1758.514-1812.180=-53.665
σ0.337-0.387=-0.049
min1758.295-1811.924=-53.629
max1759.017-1812.752=-53.735
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean2.718-2.822=-0.104
σ0.014-0.020=-0.006
min2.702-2.799=-0.097
max2.736-2.840=-0.105
policies=200
mean17592.568-18129.263=-536.695
σ0.552-0.512=0.040
min17592.180-18128.822=-536.642
max17593.380-18129.995=-536.615
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2699.000-2434.000=265.000
σ0.000
min2699.000-2434.000=265.000
max2699.000-2434.000=265.000
mean27.490-28.397=-0.907
σ0.122-0.075=0.047
min27.320-28.327=-1.007
max27.589-28.491=-0.902