Compare commits

Home / Compare 330a8b92 .. bd26debc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.775-70.730=0.045
σ0.051-0.046=0.004
min70.745-70.704=0.041
max70.915-70.859=0.056
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.162-0.159=0.002
σ0.003-0.003=0.000
min0.156-0.156=-0.000
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.491-21.447=0.044
σ0.002-0.003=-0.000
min21.487-21.443=0.044
max21.493-21.452=0.041
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.065=0.001
σ0.002-0.004=-0.001
min0.064-0.061=0.003
max0.072-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.287-1754.529=0.757
σ0.361-0.361=-0.001
min1754.718-1753.953=0.766
max1755.869-1755.113=0.755
mean1626.450-1658.500=-32.050
σ594.388-637.284=-42.896
min638.000-641.000=-3.000
max2420.000-2835.000=-415.000
mean2.810-2.832=-0.022
σ0.229-0.175=0.054
min2.149-2.311=-0.162
max3.139-3.092=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.769-273.610=-0.841
σ0.004-0.009=-0.005
min272.764-273.602=-0.838
max272.773-273.624=-0.851
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean0.384-0.384=-0.001
σ0.004-0.005=-0.001
min0.380-0.381=-0.001
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.151-1934.004=-0.854
σ0.020-0.009=0.011
min1933.123-1933.996=-0.874
max1933.174-1934.015=-0.841
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean3.080-2.941=0.140
σ0.174-0.213=-0.039
min2.954-2.703=0.251
max3.388-3.247=0.141
iters=5
new-facts=6402
prior-facts=1
mean4753.824-4754.541=-0.718
σ0.929-1.084=-0.155
min4752.889-4753.199=-0.310
max4755.385-4756.226=-0.841
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean8.410-8.469=-0.058
σ0.293-0.491=-0.198
min8.105-7.721=0.384
max8.846-8.938=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean4944.381-4945.081=-0.700
σ0.023-0.192=-0.169
min4944.354-4944.859=-0.505
max4944.406-4945.250=-0.844
mean2898.600-3077.000=-178.400
σ392.243-230.880=161.363
min2420.000-2835.000=-415.000
max3424.000-3414.000=10.000
mean8.404-8.679=-0.275
σ0.046-0.200=-0.155
min8.355-8.462=-0.107
max8.461-8.948=-0.488

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.764-1.043=0.720
σ0.127-0.187=-0.059
min1.586-0.928=0.658
max1.873-1.361=0.512

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.834-472.846=-0.012
σ574.921-574.928=-0.006
min185.369-185.377=-0.008
max1335.216-1335.238=-0.022
mean88.250
σ8.500
min84.000
max101.000
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean0.575-0.449=0.125
σ0.580-0.300=0.280
min0.275-0.295=-0.020
max1.444-0.899=0.545
policies=20
mean1853.942-1854.018=-0.076
σ0.376-0.371=0.006
min1853.689-1853.730=-0.041
max1854.499-1854.553=-0.055
mean840.000
σ0.000
min840.000
max840.000
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean2.867-2.964=-0.097
σ0.012-0.014=-0.003
min2.858-2.951=-0.093
max2.885-2.984=-0.100
policies=200
mean18546.621-18546.790=-0.168
σ0.546-0.463=0.083
min18546.233-18546.532=-0.299
max18547.410-18547.483=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2420.000-2835.000=-415.000
σ0.000
min2420.000-2835.000=-415.000
max2420.000-2835.000=-415.000
mean28.779-29.293=-0.513
σ0.093-0.485=-0.391
min28.655-28.874=-0.219
max28.864-29.824=-0.960