Compare commits

Home / Compare d94caa9b .. ba9d5a3c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.732=-0.003
σ0.047-0.046=0.001
min70.702-70.705=-0.003
max70.862-70.862=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.160-0.158=0.002
σ0.003-0.006=-0.003
min0.157-0.150=0.007
max0.166-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=-0.000
σ0.003-0.003=0.001
min21.440-21.439=0.000
max21.450-21.448=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.005
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.527=0.002
σ0.361-0.360=0.001
min1753.960-1753.953=0.006
max1755.108-1755.109=-0.001
mean1654.300-1662.500=-8.200
σ639.885-642.211=-2.326
min639.000-640.000=-1.000
max2850.000-2840.000=10.000
mean2.869-2.847=0.022
σ0.129-0.136=-0.008
min2.608-2.596=0.012
max3.157-3.065=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.608-273.609=-0.001
σ0.006-0.006=0.000
min273.602-273.602=0.000
max273.617-273.616=0.002
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean0.382-0.385=-0.002
σ0.005-0.008=-0.003
min0.379-0.380=-0.001
max0.391-0.399=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1934.000=0.002
σ0.015-0.006=0.010
min1933.979-1933.993=-0.015
max1934.017-1934.009=0.008
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean3.051-3.055=-0.005
σ0.169-0.126=0.043
min2.849-2.931=-0.082
max3.299-3.193=0.106
iters=5
new-facts=6402
prior-facts=1
mean4754.799-4754.629=0.170
σ0.816-0.932=-0.116
min4754.320-4753.738=0.582
max4756.253-4756.211=0.042
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean8.285-8.508=-0.223
σ0.414-0.467=-0.053
min7.624-7.830=-0.207
max8.755-8.886=-0.131
iters=5
new-facts=6402
prior-facts=6402
mean4945.218-4945.156=0.062
σ0.014-0.165=-0.151
min4945.203-4944.862=0.341
max4945.239-4945.250=-0.011
mean3072.400-3054.600=17.800
σ222.667-223.987=-1.320
min2850.000-2840.000=10.000
max3370.000-3375.000=-5.000
mean8.794-8.530=0.263
σ0.272-0.152=0.120
min8.493-8.361=0.132
max9.079-8.736=0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.037=-0.002
σ0.155-0.233=-0.079
min0.926-0.928=-0.002
max1.287-1.454=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-472.848=-0.008
σ574.926-574.938=-0.012
min185.374-185.367=0.007
max1335.229-1335.255=-0.025
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean0.488-0.452=0.036
σ0.381-0.306=0.076
min0.293-0.295=-0.002
max1.059-0.910=0.150
policies=20
mean1854.014-1854.028=-0.014
σ0.380-0.374=0.006
min1853.726-1853.737=-0.011
max1854.564-1854.569=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean2.953-2.964=-0.011
σ0.009-0.016=-0.007
min2.944-2.952=-0.008
max2.966-2.988=-0.022
policies=200
mean18546.713-18546.607=0.106
σ0.421-0.557=-0.136
min18546.329-18546.151=0.178
max18547.307-18547.404=-0.096
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2840.000=10.000
σ0.000
min2850.000-2840.000=10.000
max2850.000-2840.000=10.000
mean29.183-29.295=-0.111
σ0.534-0.507=0.028
min28.723-28.824=-0.101
max29.922-29.958=-0.036