Compare commits

Home / Compare a7b6a819 .. 2c133cee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.379=0.010
σ0.046-0.045=0.001
min70.359-70.354=0.005
max70.518-70.504=0.014
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.162-0.159=0.002
σ0.003-0.003=-0.000
min0.158-0.156=0.002
max0.165-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.001
σ0.003-0.003=-0.000
min21.139-21.139=0.000
max21.148-21.149=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.386=0.007
σ0.360-0.362=-0.002
min1751.825-1751.820=0.004
max1752.980-1752.970=0.010
mean1657.250-1632.600=24.650
σ632.386-609.620=22.767
min617.000-629.000=-12.000
max2772.000-2453.000=319.000
mean2.762-2.829=-0.067
σ0.188-0.123=0.065
min2.272-2.612=-0.340
max2.970-3.061=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.133=0.009
σ0.009-0.006=0.003
min270.130-270.125=0.006
max270.154-270.139=0.015
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean0.377-0.388=-0.011
σ0.006-0.008=-0.002
min0.371-0.380=-0.009
max0.387-0.400=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.594=0.015
σ0.007-0.009=-0.002
min1930.600-1930.584=0.016
max1930.618-1930.605=0.013
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean2.558-2.587=-0.029
σ0.130-0.125=0.005
min2.420-2.452=-0.032
max2.744-2.781=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4751.222-4751.139=0.083
σ0.973-0.805=0.168
min4750.520-4750.651=-0.130
max4752.927-4752.568=0.358
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean8.489-8.119=0.370
σ0.539-0.389=0.150
min7.820-7.746=0.074
max9.068-8.559=0.509
iters=5
new-facts=6402
prior-facts=6402
mean4941.774-4941.530=0.244
σ0.015-0.087=-0.071
min4941.762-4941.452=0.310
max4941.799-4941.629=0.169
mean3043.400-2968.000=75.400
σ208.711-436.458=-227.747
min2772.000-2476.000=296.000
max3320.000-3562.000=-242.000
mean8.580-8.590=-0.010
σ0.134-0.297=-0.162
min8.430-8.345=0.085
max8.780-9.006=-0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.731=-0.662
σ0.216-0.179=0.037
min0.943-1.505=-0.562
max1.444-1.939=-0.495

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.366-466.363=0.003
σ575.921-575.934=-0.013
min178.399-178.390=0.009
max1330.248-1330.264=-0.016
mean84.250
σ8.500
min80.000
max97.000
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean0.444-0.568=-0.124
σ0.307-0.567=-0.259
min0.285-0.281=0.004
max0.905-1.419=-0.513
policies=20
mean1784.347-1784.202=0.145
σ0.340-0.349=-0.009
min1784.105-1783.978=0.127
max1784.850-1784.721=0.129
mean800.000
σ0.000
min800.000
max800.000
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean2.855-2.790=0.065
σ0.107-0.028=0.079
min2.773-2.761=0.012
max3.009-2.828=0.181
policies=200
mean17849.866-17848.876=0.990
σ0.558-0.501=0.058
min17849.430-17848.475=0.955
max17850.684-17849.607=1.077
mean8000.000
σ0.000
min8000.000
max8000.000
mean2772.000-2453.000=319.000
σ0.000
min2772.000-2453.000=319.000
max2772.000-2453.000=319.000
mean27.977-27.995=-0.018
σ0.177-0.041=0.136
min27.772-27.960=-0.188
max28.204-28.054=0.150