Compare commits

Home / Compare eacba756 .. ae2e89b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.783=-0.001
σ0.046-0.046=0.000
min70.755-70.752=0.003
max70.910-70.909=0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.163-0.160=0.003
σ0.003-0.003=0.000
min0.161-0.157=0.004
max0.168-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.003=-0.001
min21.490-21.489=0.001
max21.496-21.498=-0.002
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.067-0.066=0.000
σ0.003-0.003=-0.000
min0.064-0.064=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.092=0.002
σ0.361-0.361=0.000
min1753.525-1753.520=0.005
max1754.683-1754.679=0.003
mean1669.150-1630.050=39.100
σ632.366-596.962=35.404
min672.000-655.000=17.000
max2622.000-2425.000=197.000
mean2.846-2.802=0.044
σ0.111-0.125=-0.014
min2.662-2.539=0.123
max3.132-2.926=0.207

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.598=-0.001
σ0.007-0.008=-0.000
min271.587-271.589=-0.003
max271.607-271.607=-0.000
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean0.384-0.386=-0.002
σ0.003-0.008=-0.005
min0.381-0.380=0.002
max0.389-0.398=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.005-1932.002=0.003
σ0.006-0.005=0.001
min1931.996-1931.993=0.003
max1932.012-1932.007=0.005
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean2.511-2.517=-0.005
σ0.098-0.061=0.037
min2.381-2.470=-0.089
max2.628-2.605=0.023
iters=5
new-facts=6402
prior-facts=1
mean4752.699-4752.711=-0.012
σ0.925-0.922=0.004
min4752.221-4752.229=-0.007
max4754.352-4754.355=-0.003
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean8.939-8.816=0.123
σ0.061-0.329=-0.268
min8.864-8.335=0.529
max9.019-9.137=-0.118
iters=5
new-facts=6402
prior-facts=6402
mean4943.208-4943.206=0.002
σ0.019-0.017=0.001
min4943.183-4943.185=-0.002
max4943.227-4943.231=-0.004
mean2970.200-3018.000=-47.800
σ265.575-260.986=4.590
min2622.000-2624.000=-2.000
max3314.000-3315.000=-1.000
mean8.624-8.560=0.064
σ0.229-0.128=0.101
min8.488-8.434=0.054
max9.032-8.735=0.296

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.322-1.750=-0.428
σ0.387-0.067=0.320
min0.932-1.676=-0.744
max1.817-1.832=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.637-468.629=0.009
σ574.937-574.921=0.016
min181.164-181.163=0.001
max1331.042-1331.010=0.032
mean88.250
σ8.500
min84.000
max101.000
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean0.566-0.576=-0.011
σ0.552-0.577=-0.025
min0.287-0.286=0.001
max1.394-1.442=-0.048
policies=20
mean1811.940-1811.967=-0.027
σ0.378-0.393=-0.015
min1811.707-1811.696=0.010
max1812.502-1812.545=-0.043
mean840.000
σ0.000
min840.000
max840.000
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean2.875-2.851=0.024
σ0.022-0.018=0.004
min2.850-2.834=0.015
max2.900-2.875=0.025
policies=200
mean18126.660-18126.683=-0.023
σ0.570-0.222=0.347
min18126.282-18126.493=-0.211
max18127.487-18127.004=0.483
mean8400.000
σ0.000
min8400.000
max8400.000
mean2622.000-2425.000=197.000
σ0.000
min2622.000-2425.000=197.000
max2622.000-2425.000=197.000
mean28.754-28.836=-0.081
σ0.064-0.121=-0.058
min28.697-28.716=-0.018
max28.845-28.981=-0.136