Compare commits

Home / Compare bfca22b7 .. e15ce9e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.703=-0.001
σ0.047-0.046=0.001
min70.666-70.675=-0.008
max70.831-70.831=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.161=-0.001
σ0.003-0.003=-0.001
min0.157-0.158=-0.001
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.000
σ0.003-0.003=0.000
min21.403-21.403=0.000
max21.412-21.411=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.064=0.002
σ0.003-0.003=-0.000
min0.061-0.058=0.002
max0.074-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.928=0.003
σ0.360-0.360=0.000
min1754.358-1754.364=-0.006
max1755.503-1755.511=-0.008
mean1627.000-1663.050=-36.050
σ593.618-617.230=-23.612
min624.000
max2413.000-2487.000=-74.000
mean2.782-2.808=-0.026
σ0.192-0.120=0.072
min2.286-2.551=-0.265
max3.024-3.039=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.756=0.001
σ0.003-0.006=-0.003
min272.752-272.749=0.003
max272.761-272.765=-0.004
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean0.385-0.382=0.003
σ0.006-0.008=-0.003
min0.380-0.377=0.003
max0.393-0.397=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.168=-0.012
σ0.018-0.021=-0.003
min1933.132-1933.140=-0.008
max1933.180-1933.194=-0.014
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean2.837-3.009=-0.172
σ0.244-0.135=0.109
min2.504-2.778=-0.275
max3.152-3.129=0.023
iters=5
new-facts=6402
prior-facts=1
mean4756.724-4756.907=-0.182
σ7.714-7.595=0.119
min4752.877-4753.473=-0.596
max4770.512-4770.493=0.020
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean8.636-8.604=0.032
σ0.385-0.369=0.016
min8.082-8.040=0.042
max9.026-8.974=0.052
iters=5
new-facts=6402
prior-facts=6402
mean4944.254-4944.386=-0.133
σ0.193-0.028=0.165
min4944.026-4944.345=-0.320
max4944.403-4944.414=-0.011
mean2894.800-2933.200=-38.400
σ388.802-381.955=6.847
min2413.000-2487.000=-74.000
max3400.000-3442.000=-42.000
mean8.422-8.477=-0.055
σ0.068-0.151=-0.082
min8.366-8.380=-0.014
max8.517-8.743=-0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.775-1.621=0.154
σ0.106-0.226=-0.119
min1.607-1.221=0.386
max1.887-1.767=0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.313-468.313=0.000
σ574.253-574.256=-0.003
min181.184-181.184=0.000
max1329.693-1329.697=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean0.546-0.566=-0.020
σ0.531-0.561=-0.031
min0.272-0.284=-0.012
max1.342-1.408=-0.066
policies=20
mean1812.169-1812.134=0.035
σ0.397-0.386=0.012
min1811.908-1811.888=0.020
max1812.756-1812.704=0.052
mean840.000
σ0.000
min840.000
max840.000
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean2.823-2.825=-0.002
σ0.009-0.032=-0.023
min2.814-2.779=0.035
max2.834-2.850=-0.016
policies=200
mean18128.879-18128.903=-0.024
σ0.395-0.502=-0.107
min18128.596-18128.617=-0.022
max18129.447-18129.655=-0.208
mean8400.000
σ0.000
min8400.000
max8400.000
mean2413.000-2487.000=-74.000
σ0.000
min2413.000-2487.000=-74.000
max2413.000-2487.000=-74.000
mean28.407-28.389=0.019
σ0.017-0.064=-0.047
min28.387-28.295=0.092
max28.426-28.436=-0.010