Compare commits

Home / Compare d1f5148a .. fa71a1b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799
σ0.108
min35.753
max36.105
mean413.000
σ0.000
min413.000
max413.000
mean0.073
σ0.004
min0.068
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.065
σ0.002
min26.062
max26.069
mean413.000
σ0.000
min413.000
max413.000
mean0.061
σ0.003
min0.059
max0.068

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1756.306=-0.385
σ0.370-0.367=0.003
min1755.352-1755.752=-0.400
max1756.518-1756.898=-0.379
mean1666.200-1652.850=13.350
σ630.062-636.462=-6.400
min665.000-615.000=50.000
max2621.000-2611.000=10.000
mean2.819-2.244=0.574
σ0.180-0.138=0.042
min2.290-2.087=0.203
max3.111-2.736=0.375

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-278.695=-1.501
σ0.004-0.014=-0.010
min277.190-278.677=-1.487
max277.197-278.709=-1.512
mean2621.000-2611.000=10.000
σ0.000
min2621.000-2611.000=10.000
max2621.000-2611.000=10.000
mean0.396-0.420=-0.024
σ0.004-0.001=0.003
min0.393-0.418=-0.026
max0.403-0.421=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2174.432-2268.840=-94.408
σ0.012-0.017=-0.005
min2174.415-2268.822=-94.407
max2174.449-2268.864=-94.416
mean2621.000-2611.000=10.000
σ0.000
min2621.000-2611.000=10.000
max2621.000-2611.000=10.000
mean3.050-3.303=-0.253
σ0.225-0.136=0.089
min2.830-3.144=-0.314
max3.333-3.491=-0.157
iters=5
new-facts=6402
prior-facts=1
mean5052.580-4955.921=96.659
σ0.970-1.046=-0.076
min5052.020-4955.025=96.995
max5054.305-4957.720=96.585
mean2621.000-2611.000=10.000
σ0.000
min2621.000-2611.000=10.000
max2621.000-2611.000=10.000
mean9.005-8.126=0.880
σ0.328-0.322=0.006
min8.538-7.745=0.794
max9.336-8.620=0.716
iters=5
new-facts=6402
prior-facts=6402
mean5188.422-5170.773=17.649
σ0.095-0.084=0.011
min5188.335-5170.678=17.657
max5188.525-5170.850=17.675
mean3269.800-3454.200=-184.400
σ386.731-474.506=-87.775
min2729.000-2839.000=-110.000
max3741.000-4118.000=-377.000
mean9.225-9.320=-0.094
σ0.531-0.153=0.378
min8.729-9.107=-0.378
max9.795-9.459=0.336

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.307-1.037=0.270
σ0.332-0.137=0.195
min0.940-0.947=-0.007
max1.783-1.262=0.521

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-460.252=4.604
σ572.660-572.608=0.052
min178.520-173.947=4.572
max1323.846-1319.164=4.682
mean79.500
σ7.000
min76.000
max90.000
mean2621.000-435.000=2186.000
σ0.000
min2621.000-435.000=2186.000
max2621.000-435.000=2186.000
mean0.549-0.554=-0.005
σ0.534-0.546=-0.012
min0.279-0.274=0.005
max1.350-1.372=-0.023
policies=20
mean1785.488-1739.984=45.504
σ0.347-0.332=0.015
min1785.259-1739.746=45.512
max1786.004-1740.473=45.531
mean760.000
σ0.000
min760.000
max760.000
mean2621.000-445.500=2175.500
σ0.000-9.950=-9.950
min2621.000-435.000=2186.000
max2621.000-454.000=2167.000
mean2.807-2.662=0.145
σ0.004-0.013=-0.009
min2.801-2.651=0.151
max2.811-2.679=0.132
policies=200
mean17861.430-17409.258=452.172
σ0.617-0.167=0.450
min17861.094-17409.060=452.034
max17862.355-17409.467=452.888
mean7600.000
σ0.000
min7600.000
max7600.000
mean2621.000-492.500=2128.500
σ0.000-3.416=-3.416
min2621.000-489.000=2132.000
max2621.000-497.000=2124.000
mean28.358-26.978=1.380
σ0.208-0.102=0.106
min28.147-26.894=1.253
max28.636-27.116=1.521