Compare commits

Home / Compare 3bc9710d .. 99bbcc2f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.990-35.992=-0.001
σ0.100-0.102=-0.001
min35.945-35.948=-0.003
max36.274-36.280=-0.005
mean3790.000-3767.000=23.000
σ0.000
min3790.000-3767.000=23.000
max3790.000-3767.000=23.000
mean0.076-0.077=-0.001
σ0.002-0.003=-0.000
min0.074-0.075=-0.001
max0.082-0.082=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.212-26.212=-0.000
σ0.004-0.006=-0.002
min26.205-26.204=0.001
max26.217-26.220=-0.003
mean3790.000-3767.000=23.000
σ0.000
min3790.000-3767.000=23.000
max3790.000-3767.000=23.000
mean0.059-0.060=-0.001
σ0.002-0.001=0.002
min0.057-0.059=-0.003
max0.065-0.061=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1756.358=0.001
σ0.374-0.373=0.001
min1755.786-1755.789=-0.003
max1756.953-1756.956=-0.003
mean1656.500-1651.750=4.750
σ628.629-625.628=3.000
min612.000-610.000=2.000
max2672.000-2659.000=13.000
mean2.303-2.260=0.044
σ0.147-0.126=0.022
min2.157-2.123=0.034
max2.744-2.582=0.163

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.675-278.673=0.002
σ0.014-0.007=0.007
min278.661-278.666=-0.005
max278.697-278.683=0.014
mean2672.000-2659.000=13.000
σ0.000
min2672.000-2659.000=13.000
max2672.000-2659.000=13.000
mean0.421-0.419=0.003
σ0.001-0.002=-0.001
min0.420-0.417=0.004
max0.422-0.422=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.834-2268.823=0.010
σ0.016-0.016=0.000
min2268.815-2268.808=0.007
max2268.848-2268.845=0.002
mean2672.000-2659.000=13.000
σ0.000
min2672.000-2659.000=13.000
max2672.000-2659.000=13.000
mean3.187-3.072=0.115
σ0.141-0.149=-0.008
min2.958-2.870=0.088
max3.346-3.236=0.110
iters=5
new-facts=6402
prior-facts=1
mean4952.055-4952.172=-0.117
σ0.874-0.779=0.095
min4951.263-4951.772=-0.509
max4953.554-4953.564=-0.010
mean2672.000-2659.000=13.000
σ0.000
min2672.000-2659.000=13.000
max2672.000-2659.000=13.000
mean7.934-7.839=0.095
σ0.245-0.163=0.082
min7.676-7.640=0.036
max8.296-8.016=0.280
iters=5
new-facts=6402
prior-facts=6402
mean5166.894-5166.897=-0.003
σ0.012-0.013=-0.001
min5166.876-5166.888=-0.012
max5166.908-5166.921=-0.012
mean3360.400-3361.400=-1.000
σ426.556-395.711=30.846
min2937.000-2977.000=-40.000
max3790.000-3767.000=23.000
mean9.065-9.385=-0.320
σ0.350-0.448=-0.099
min8.656-8.986=-0.330
max9.525-10.135=-0.610

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.579-1.585=-0.006
σ0.287-0.258=0.029
min1.246-1.234=0.012
max1.811-1.790=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-460.255=-0.000
σ572.608-572.608=0.000
min173.949-173.949=0.000
max1319.167-1319.167=0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.566-0.549=0.017
σ0.581-0.542=0.039
min0.273-0.277=-0.004
max1.437-1.362=0.075
policies=20
mean1740.016-1740.008=0.008
σ0.336-0.329=0.007
min1739.774-1739.770=0.004
max1740.508-1740.489=0.019
mean760.000
σ0.000
min760.000
max760.000
mean448.250-446.000=2.250
σ10.308-9.381=0.927
min437.000-436.000=1.000
max457.000-454.000=3.000
mean2.676-2.654=0.022
σ0.016-0.012=0.004
min2.658-2.643=0.016
max2.697-2.670=0.027
policies=200
mean17409.307-17409.313=-0.005
σ0.105-0.127=-0.022
min17409.186-17409.172=0.014
max17409.432-17409.469=-0.038
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-488.500=2.750
σ1.708-1.915=-0.207
min489.000-486.000=3.000
max493.000-490.000=3.000
mean26.995-26.945=0.050
σ0.098-0.096=0.002
min26.885-26.850=0.035
max27.114-27.029=0.085