Compare commits

Home / Compare 11ec3819 .. cf618c0e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.390=0.000
σ0.047-0.045=0.001
min70.359-70.365=-0.005
max70.520-70.516=0.004
mean413.000-413.600=-0.600
σ0.000-0.516=-0.516
min413.000
max413.000-414.000=-1.000
mean0.162-0.162=-0.001
σ0.002-0.003=-0.001
min0.159-0.160=-0.001
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.002=0.000
min21.141-21.141=-0.000
max21.148-21.147=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.696=0.002
σ0.359-0.361=-0.002
min1752.126-1752.129=-0.003
max1753.290-1753.281=0.009
mean1653.550-1646.900=6.650
σ643.853-635.954=7.899
min631.000-632.000=-1.000
max2859.000-2839.000=20.000
mean2.788-2.786=0.002
σ0.214-0.211=0.003
min2.169-2.263=-0.094
max3.037-3.036=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.517-270.517=-0.000
σ0.005-0.007=-0.002
min270.509-270.505=0.004
max270.522-270.523=-0.001
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean0.381-0.382=-0.001
σ0.006-0.009=-0.002
min0.378-0.378=0.000
max0.392-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.949-1930.943=0.006
σ0.009-0.008=0.001
min1930.933-1930.933=0.000
max1930.956-1930.954=0.003
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean3.051-2.947=0.104
σ0.218-0.135=0.084
min2.716-2.760=-0.044
max3.283-3.120=0.163
iters=5
new-facts=6402
prior-facts=1
mean4751.721-4751.683=0.038
σ0.835-0.841=-0.006
min4751.141-4751.234=-0.093
max4753.193-4753.184=0.008
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean8.294-8.375=-0.082
σ0.524-0.372=0.152
min7.765-7.822=-0.057
max9.107-8.795=0.312
iters=5
new-facts=6402
prior-facts=6402
mean4942.144-4942.140=0.004
σ0.031-0.022=0.009
min4942.102-4942.113=-0.011
max4942.172-4942.161=0.011
mean3038.200-3025.000=13.200
σ249.866-199.167=50.699
min2859.000-2839.000=20.000
max3429.000-3319.000=110.000
mean8.551-8.565=-0.014
σ0.351-0.155=0.197
min8.267-8.416=-0.148
max9.141-8.822=0.319

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-0.997=0.038
σ0.136-0.141=-0.005
min0.938-0.925=0.012
max1.256-1.249=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.826-466.823=0.003
σ575.927-575.930=-0.003
min178.858-178.852=0.006
max1330.716-1330.717=-0.001
mean84.000
σ8.000
min80.000
max96.000
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean0.442-0.443=-0.001
σ0.299-0.303=-0.004
min0.291-0.290=0.001
max0.891-0.898=-0.007
policies=20
mean1788.834-1788.862=-0.028
σ0.354-0.373=-0.019
min1788.586-1788.613=-0.027
max1789.354-1789.414=-0.060
mean800.000
σ0.000
min800.000
max800.000
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean2.887-2.898=-0.011
σ0.045-0.056=-0.011
min2.863-2.842=0.021
max2.954-2.959=-0.005
policies=200
mean17894.756-17894.762=-0.006
σ0.484-0.460=0.025
min17894.433-17894.482=-0.049
max17895.477-17895.449=0.028
mean8000.000
σ0.000
min8000.000
max8000.000
mean2859.000-2839.000=20.000
σ0.000
min2859.000-2839.000=20.000
max2859.000-2839.000=20.000
mean28.493-28.370=0.123
σ0.484-0.348=0.136
min27.984-28.021=-0.037
max28.968-28.726=0.242