Compare commits

Home / Compare e29caf4b .. 675d2fdc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.768=0.002
σ0.048-0.048=0.001
min30.725-30.726=-0.001
max30.902-30.900=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.076-0.076=0.001
σ0.003-0.004=-0.002
min0.071-0.070=0.001
max0.081-0.086=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-21.061=-0.001
σ0.002-0.002=-0.000
min21.054-21.057=-0.003
max21.062-21.064=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.059-0.064=-0.005
σ0.003-0.004=-0.001
min0.056-0.061=-0.005
max0.065-0.071=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.417=0.001
σ0.362-0.364=-0.002
min1750.857-1750.852=0.006
max1752.009-1751.994=0.015
mean1658.150-1649.350=8.800
σ639.226-621.165=18.061
min620.000-681.000=-61.000
max2719.000-2646.000=73.000
mean2.801-2.845=-0.043
σ0.197-0.128=0.069
min2.177-2.485=-0.308
max3.100-3.024=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.193-282.191=0.001
σ0.010-0.008=0.002
min282.185-282.185=-0.000
max282.206-282.205=0.001
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean0.397-0.408=-0.011
σ0.001-0.004=-0.002
min0.395-0.405=-0.010
max0.399-0.414=-0.015
iters=5
new-facts=1
prior-facts=6402
mean2174.711-2174.720=-0.009
σ0.013-0.007=0.006
min2174.693-2174.709=-0.016
max2174.728-2174.727=0.001
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean2.969-3.004=-0.035
σ0.100-0.154=-0.055
min2.809-2.814=-0.005
max3.067-3.128=-0.062
iters=5
new-facts=6402
prior-facts=1
mean5054.549-5054.551=-0.001
σ0.979-0.941=0.037
min5053.962-5053.978=-0.016
max5056.292-5056.226=0.066
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean8.928-8.680=0.248
σ0.628-0.567=0.061
min8.063-7.928=0.134
max9.688-9.391=0.297
iters=5
new-facts=6402
prior-facts=6402
mean5185.681-5185.598=0.083
σ0.078-0.213=-0.135
min5185.616-5185.235=0.381
max5185.781-5185.753=0.029
mean3304.200-3224.200=80.000
σ443.498-389.390=54.108
min2719.000-2688.000=31.000
max3730.000-3711.000=19.000
mean10.079-9.799=0.280
σ0.289-0.236=0.053
min9.700-9.610=0.090
max10.451-10.140=0.311

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.144-1.214=-0.070
σ0.102-0.429=-0.327
min1.065-0.919=0.145
max1.262-1.872=-0.610

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.575-463.578=-0.003
σ572.676-572.676=0.000
min177.236-177.236=-0.000
max1322.588-1322.591=-0.003
mean79.750
σ7.500
min76.000
max91.000
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean0.562-0.562=0.000
σ0.575-0.564=0.011
min0.274-0.276=-0.002
max1.425-1.408=0.017
policies=20
mean1772.643-1772.622=0.021
σ0.328-0.323=0.005
min1772.418-1772.403=0.015
max1773.129-1773.100=0.029
mean760.000
σ0.000
min760.000
max760.000
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean2.743-2.735=0.008
σ0.008-0.020=-0.011
min2.732-2.710=0.022
max2.751-2.758=-0.007
policies=200
mean17732.899-17733.060=-0.162
σ0.483-0.499=-0.016
min17732.597-17732.804=-0.206
max17733.611-17733.808=-0.198
mean7600.000
σ0.000
min7600.000
max7600.000
mean2719.000-2646.000=73.000
σ0.000
min2719.000-2646.000=73.000
max2719.000-2646.000=73.000
mean27.654-27.632=0.022
σ0.101-0.170=-0.068
min27.557-27.490=0.066
max27.744-27.876=-0.133