Compare commits

Home / Compare 6f51978a .. b233a3e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.001
σ0.047-0.048=-0.001
min30.730-30.725=0.005
max30.899-30.902=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.076=0.001
σ0.002-0.003=-0.000
min0.075-0.071=0.005
max0.084-0.081=0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.004-0.002=0.002
min21.056-21.054=0.001
max21.068-21.062=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.059=0.003
σ0.002-0.003=-0.001
min0.056-0.056=0.000
max0.064-0.065=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.418=0.001
σ0.361-0.362=-0.001
min1750.852-1750.857=-0.005
max1752.008-1752.009=-0.000
mean1670.550-1658.150=12.400
σ640.447-639.226=1.221
min678.000-620.000=58.000
max2691.000-2719.000=-28.000
mean2.808-2.801=0.006
σ0.163-0.197=-0.033
min2.449-2.177=0.272
max2.980-3.100=-0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.193-282.193=0.000
σ0.009-0.010=-0.001
min282.184-282.185=-0.001
max282.205-282.206=-0.001
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean0.412-0.397=0.015
σ0.011-0.001=0.010
min0.405-0.395=0.009
max0.432-0.399=0.033
iters=5
new-facts=1
prior-facts=6402
mean2174.715-2174.711=0.003
σ0.012-0.013=-0.001
min2174.700-2174.693=0.008
max2174.729-2174.728=0.001
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean2.926-2.969=-0.043
σ0.119-0.100=0.020
min2.770-2.809=-0.039
max3.048-3.067=-0.018
iters=5
new-facts=6402
prior-facts=1
mean5054.536-5054.549=-0.014
σ0.963-0.979=-0.016
min5054.011-5053.962=0.049
max5056.250-5056.292=-0.042
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean8.994-8.928=0.065
σ0.457-0.628=-0.171
min8.258-8.063=0.195
max9.425-9.688=-0.263
iters=5
new-facts=6402
prior-facts=6402
mean5185.661-5185.681=-0.020
σ0.079-0.078=0.001
min5185.580-5185.616=-0.036
max5185.750-5185.781=-0.032
mean3234.400-3304.200=-69.800
σ392.210-443.498=-51.288
min2702.000-2719.000=-17.000
max3738.000-3730.000=8.000
mean9.616-10.079=-0.463
σ0.509-0.289=0.219
min8.746-9.700=-0.954
max10.065-10.451=-0.386

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.144=-0.075
σ0.130-0.102=0.028
min0.939-1.065=-0.126
max1.236-1.262=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.579-463.575=0.005
σ572.666-572.676=-0.010
min177.238-177.236=0.002
max1322.578-1322.588=-0.010
mean79.750
σ7.500
min76.000
max91.000
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean0.540-0.562=-0.022
σ0.534-0.575=-0.040
min0.266-0.274=-0.008
max1.342-1.425=-0.083
policies=20
mean1772.647-1772.643=0.004
σ0.323-0.328=-0.005
min1772.427-1772.418=0.009
max1773.126-1773.129=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean2.743-2.743=0.000
σ0.013-0.008=0.004
min2.732-2.732=-0.001
max2.759-2.751=0.008
policies=200
mean17733.035-17732.899=0.136
σ0.487-0.483=0.004
min17732.735-17732.597=0.138
max17733.761-17733.611=0.150
mean7600.000
σ0.000
min7600.000
max7600.000
mean2691.000-2719.000=-28.000
σ0.000
min2691.000-2719.000=-28.000
max2691.000-2719.000=-28.000
mean27.701-27.654=0.047
σ0.198-0.101=0.097
min27.577-27.557=0.020
max27.997-27.744=0.253