Compare commits

Home / Compare fd638b82 .. 5de0b943

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.566=-0.004
σ0.045-0.045=0.000
min70.534-70.535=-0.001
max70.689-70.689=-0.001
mean414.400-414.000=0.400
σ0.516-0.000=0.516
min414.000
max415.000-414.000=1.000
mean0.158-0.160=-0.002
σ0.004-0.004=-0.000
min0.154-0.157=-0.002
max0.167-0.170=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=-0.000
min21.285-21.283=0.002
max21.292-21.291=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.062=0.002
σ0.003-0.004=-0.001
min0.063-0.059=0.003
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=0.001
σ0.360-0.360=0.000
min1752.995-1753.000=-0.005
max1754.155-1754.146=0.009
mean1655.850-1648.300=7.550
σ631.695-640.211=-8.516
min644.000-627.000=17.000
max2843.000-2876.000=-33.000
mean2.805-2.832=-0.027
σ0.228-0.107=0.121
min2.184-2.540=-0.356
max3.140-3.022=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.017=-0.001
σ0.009-0.004=0.004
min272.001-272.011=-0.010
max272.024-272.021=0.003
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean0.387-0.388=-0.002
σ0.013-0.011=0.002
min0.371-0.377=-0.006
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.433=0.001
σ0.012-0.012=0.000
min1932.421-1932.414=0.007
max1932.450-1932.444=0.006
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean2.950-3.005=-0.054
σ0.144-0.103=0.041
min2.721-2.923=-0.202
max3.079-3.180=-0.101
iters=5
new-facts=6402
prior-facts=1
mean4753.166-4753.155=0.011
σ0.863-0.847=0.016
min4752.689-4752.667=0.021
max4754.702-4754.664=0.037
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean8.526-8.664=-0.138
σ0.552-0.245=0.306
min7.598-8.428=-0.831
max9.041-9.060=-0.020
iters=5
new-facts=6402
prior-facts=6402
mean4943.563-4943.418=0.144
σ0.144-0.201=-0.057
min4943.306-4943.261=0.045
max4943.644-4943.668=-0.025
mean3051.400-3073.400=-22.000
σ206.385-209.972=-3.587
min2843.000-2876.000=-33.000
max3321.000-3381.000=-60.000
mean8.514-8.594=-0.080
σ0.160-0.103=0.057
min8.334-8.482=-0.148
max8.735-8.747=-0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.046=-0.026
σ0.135-0.126=0.010
min0.932-0.930=0.001
max1.243-1.239=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.081=0.000
σ575.915-575.915=-0.000
min185.119-185.119=0.000
max1336.954-1336.954=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean0.487-0.483=0.004
σ0.373-0.371=0.002
min0.299-0.296=0.003
max1.047-1.039=0.008
policies=20
mean1851.461-1851.452=0.009
σ0.371-0.370=0.001
min1851.179-1851.185=-0.006
max1852.000-1851.990=0.010
mean840.000
σ0.000
min840.000
max840.000
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean2.934-2.958=-0.024
σ0.009-0.018=-0.009
min2.924-2.946=-0.022
max2.945-2.985=-0.040
policies=200
mean18521.070-18521.067=0.003
σ0.526-0.423=0.103
min18520.671-18520.708=-0.037
max18521.812-18521.663=0.148
mean8400.000
σ0.000
min8400.000
max8400.000
mean2843.000-2876.000=-33.000
σ0.000
min2843.000-2876.000=-33.000
max2843.000-2876.000=-33.000
mean29.245-29.211=0.033
σ0.525-0.404=0.121
min28.724-28.902=-0.178
max29.731-29.759=-0.028