Compare commits

Home / Compare afeb22b2 .. 377868c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.000
σ0.050-0.048=0.002
min30.725-30.727=-0.002
max30.906-30.900=0.006
mean416.000
σ0.000
min416.000
max416.000
mean0.075-0.078=-0.003
σ0.005-0.004=0.002
min0.070-0.075=-0.005
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.002-0.003=-0.000
min21.057-21.056=0.001
max21.064-21.064=0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.063-0.062=0.002
σ0.002-0.004=-0.002
min0.062-0.058=0.004
max0.069-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=0.000
σ0.361-0.362=-0.001
min1750.848-1750.854=-0.005
max1752.002-1752.002=-0.000
mean1647.500-1662.350=-14.850
σ619.546-624.460=-4.914
min682.000-660.000=22.000
max2640.000-2510.000=130.000
mean2.839-2.848=-0.010
σ0.144-0.177=-0.033
min2.498-2.369=0.129
max3.119-3.110=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.196-275.767=6.429
σ0.008-0.008=0.000
min282.189-275.758=6.431
max282.206-275.778=6.428
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean0.406-0.406=0.000
σ0.005-0.011=-0.006
min0.404-0.396=0.007
max0.414-0.418=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.722-2168.279=6.443
σ0.003-0.022=-0.020
min2174.717-2168.251=6.467
max2174.724-2168.303=6.421
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean2.965-3.054=-0.088
σ0.142-0.209=-0.067
min2.781-2.798=-0.017
max3.118-3.254=-0.136
iters=5
new-facts=6402
prior-facts=1
mean5054.593-5048.025=6.568
σ0.913-1.010=-0.096
min5054.116-5047.307=6.808
max5056.222-5049.786=6.436
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean8.434-9.207=-0.773
σ0.501-0.649=-0.149
min7.951-8.269=-0.318
max9.281-9.984=-0.703
iters=5
new-facts=6402
prior-facts=6402
mean5185.593-5179.240=6.353
σ0.184-0.067=0.116
min5185.291-5179.184=6.107
max5185.744-5179.323=6.421
mean3227.000-3260.200=-33.200
σ391.578-361.714=29.863
min2690.000-2739.000=-49.000
max3722.000-3687.000=35.000
mean9.922-9.772=0.150
σ0.119-0.621=-0.502
min9.760-8.665=1.095
max10.092-10.138=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.275-1.583=-0.308
σ0.437-0.129=0.309
min0.936-1.442=-0.506
max2.032-1.741=0.291

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.573-463.567=0.007
σ572.658-572.654=0.004
min177.241-177.237=0.004
max1322.560-1322.548=0.012
mean79.750
σ7.500
min76.000
max91.000
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean0.555-0.556=-0.002
σ0.562-0.551=0.010
min0.273-0.278=-0.005
max1.397-1.383=0.014
policies=20
mean1772.642-1772.628=0.015
σ0.334-0.334=-0.001
min1772.419-1772.414=0.005
max1773.138-1773.124=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean2.744-2.761=-0.017
σ0.015-0.006=0.009
min2.724-2.756=-0.032
max2.758-2.769=-0.011
policies=200
mean17733.052-17732.908=0.144
σ0.505-0.419=0.086
min17732.780-17732.570=0.210
max17733.809-17733.520=0.289
mean7600.000
σ0.000
min7600.000
max7600.000
mean2640.000-2510.000=130.000
σ0.000
min2640.000-2510.000=130.000
max2640.000-2510.000=130.000
mean27.590-27.838=-0.248
σ0.080-0.076=0.004
min27.523-27.757=-0.234
max27.687-27.934=-0.247