Compare commits

Home / Compare cd1dea7d .. 33a14ad8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.958=0.000
σ0.050-0.049=0.001
min30.923-30.921=0.002
max31.097-31.094=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.078-0.080=-0.002
σ0.003-0.004=-0.001
min0.076-0.076=-0.001
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.001
σ0.002-0.003=-0.001
min21.056-21.055=0.001
max21.063-21.064=-0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.059-0.061=-0.002
σ0.003-0.003=-0.000
min0.057-0.058=-0.001
max0.065-0.067=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.413=-0.005
σ0.365-0.361=0.004
min1750.851-1750.844=0.007
max1751.982-1751.989=-0.007
mean1655.800-1642.300=13.500
σ646.746-617.236=29.510
min641.000-670.000=-29.000
max2851.000-2554.000=297.000
mean2.821-2.846=-0.025
σ0.127-0.121=0.006
min2.526-2.591=-0.065
max3.037-3.079=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.055-279.073=-0.018
σ0.017-0.008=0.008
min279.038-279.064=-0.026
max279.074-279.085=-0.011
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean0.389-0.392=-0.003
σ0.005-0.005=0.000
min0.385-0.386=-0.001
max0.398-0.398=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1939.511-1939.511=-0.000
σ0.006-0.008=-0.002
min1939.501-1939.498=0.003
max1939.517-1939.518=-0.000
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean3.071-3.039=0.033
σ0.078-0.054=0.024
min3.002-3.003=-0.001
max3.195-3.134=0.061
iters=5
new-facts=6402
prior-facts=1
mean4759.954-4760.070=-0.116
σ0.984-0.857=0.127
min4759.043-4759.559=-0.517
max4761.629-4761.592=0.037
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean8.240-8.190=0.049
σ0.629-0.565=0.064
min7.827-7.713=0.114
max9.327-9.164=0.163
iters=5
new-facts=6402
prior-facts=6402
mean4950.391-4950.469=-0.079
σ0.125-0.083=0.042
min4950.207-4950.401=-0.194
max4950.559-4950.571=-0.012
mean3047.600-2961.800=85.800
σ268.336-393.388=-125.052
min2851.000-2554.000=297.000
max3456.000-3516.000=-60.000
mean8.429-8.521=-0.092
σ0.045-0.278=-0.233
min8.359-8.324=0.035
max8.473-9.008=-0.534

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.587=-0.536
σ0.117-0.233=-0.116
min0.940-1.221=-0.281
max1.225-1.786=-0.561

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.342-463.336=0.006
σ572.195-572.201=-0.006
min177.238-177.232=0.005
max1321.634-1321.638=-0.004
mean79.750
σ7.500
min76.000
max91.000
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean0.435-0.572=-0.136
σ0.304-0.578=-0.274
min0.280-0.276=0.004
max0.891-1.439=-0.548
policies=20
mean1772.629-1772.590=0.039
σ0.330-0.325=0.004
min1772.395-1772.373=0.022
max1773.114-1773.073=0.041
mean760.000
σ0.000
min760.000
max760.000
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean2.840-2.737=0.103
σ0.013-0.013=-0.000
min2.828-2.718=0.110
max2.854-2.748=0.106
policies=200
mean17732.547-17732.440=0.108
σ0.420-0.408=0.012
min17732.225-17732.197=0.027
max17733.164-17733.051=0.113
mean7600.000
σ0.000
min7600.000
max7600.000
mean2851.000-2554.000=297.000
σ0.000
min2851.000-2554.000=297.000
max2851.000-2554.000=297.000
mean28.110-27.640=0.469
σ0.579-0.163=0.417
min27.551-27.463=0.089
max28.731-27.809=0.922