Compare commits

Home / Compare 8ec7534a .. 2553b615

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.002
σ0.048-0.046=0.002
min30.728-30.734=-0.005
max30.901-30.896=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.078-0.079=-0.001
σ0.003-0.003=-0.000
min0.072-0.076=-0.004
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.001
σ0.002-0.003=-0.000
min21.054-21.056=-0.002
max21.064-21.064=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.060-0.062=-0.002
σ0.004-0.004=0.000
min0.056-0.058=-0.002
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.418=0.001
σ0.362-0.361=0.001
min1750.854-1750.848=0.007
max1752.002-1752.006=-0.004
mean1649.050-1659.950=-10.900
σ622.142-620.430=1.711
min679.000-661.000=18.000
max2649.000-2497.000=152.000
mean2.823-2.800=0.023
σ0.166-0.211=-0.044
min2.277-2.189=0.089
max3.002-3.085=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-275.757=0.000
σ0.011-0.008=0.003
min275.744-275.748=-0.004
max275.769-275.766=0.002
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean0.401-0.403=-0.002
σ0.009-0.009=0.001
min0.394-0.398=-0.004
max0.415-0.418=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.274-2168.274=-0.000
σ0.036-0.017=0.019
min2168.213-2168.251=-0.038
max2168.302-2168.290=0.013
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean2.986-2.977=0.009
σ0.114-0.123=-0.008
min2.788-2.810=-0.022
max3.078-3.117=-0.039
iters=5
new-facts=6402
prior-facts=1
mean5048.098-5047.866=0.232
σ0.963-1.184=-0.221
min5047.515-5046.413=1.102
max5049.805-5049.709=0.095
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean8.939-8.901=0.038
σ0.489-0.480=0.009
min8.178-8.139=0.039
max9.376-9.456=-0.080
iters=5
new-facts=6402
prior-facts=6402
mean5179.248-5179.246=0.002
σ0.075-0.083=-0.008
min5179.179-5179.176=0.003
max5179.341-5179.360=-0.019
mean3236.400-3271.400=-35.000
σ379.104-379.796=-0.692
min2702.000-2734.000=-32.000
max3695.000-3728.000=-33.000
mean10.064-10.129=-0.065
σ0.319-0.453=-0.134
min9.549-9.579=-0.030
max10.412-10.837=-0.425

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.106-1.756=-0.650
σ0.180-0.135=0.045
min0.936-1.517=-0.581
max1.344-1.843=-0.500

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.576-463.563=0.013
σ572.677-572.650=0.027
min177.235-177.238=-0.003
max1322.591-1322.538=0.053
mean79.750
σ7.500
min76.000
max91.000
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean0.560-0.541=0.018
σ0.562-0.533=0.029
min0.276-0.273=0.003
max1.403-1.341=0.062
policies=20
mean1772.618-1772.610=0.009
σ0.327-0.329=-0.002
min1772.394-1772.400=-0.006
max1773.103-1773.099=0.004
mean760.000
σ0.000
min760.000
max760.000
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean2.743-2.741=0.001
σ0.007-0.015=-0.008
min2.733-2.721=0.011
max2.750-2.755=-0.006
policies=200
mean17733.021-17733.022=-0.001
σ0.503-0.498=0.005
min17732.696-17732.626=0.070
max17733.771-17733.750=0.022
mean7600.000
σ0.000
min7600.000
max7600.000
mean2649.000-2497.000=152.000
σ0.000
min2649.000-2497.000=152.000
max2649.000-2497.000=152.000
mean27.764-27.726=0.038
σ0.192-0.135=0.057
min27.532-27.583=-0.052
max27.997-27.855=0.142