Compare commits

Home / Compare c7aa0064 .. 2087b877

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=0.000
σ0.048-0.048=-0.000
min70.747-70.749=-0.001
max70.914-70.915=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.156-0.159=-0.002
σ0.005-0.003=0.002
min0.150-0.155=-0.005
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.003-0.003=0.000
min21.486-21.488=-0.002
max21.496-21.496=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.065-0.066=-0.000
σ0.002-0.004=-0.002
min0.063-0.063=0.000
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1716.185-1754.095=-37.910
σ169.643-0.360=169.282
min995.455-1753.530=-758.075
max1754.689-1754.662=0.027
mean1613.550-1632.550=-19.000
σ625.227-598.058=27.169
min648.000-653.000=-5.000
max2474.000-2433.000=41.000
mean2.750-2.877=-0.128
σ0.339-0.119=0.220
min1.593-2.529=-0.937
max3.205-3.125=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-271.592=0.005
σ0.006-0.006=-0.000
min271.591-271.585=0.006
max271.607-271.603=0.004
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean0.383-0.381=0.001
σ0.004-0.005=-0.001
min0.381-0.378=0.002
max0.389-0.389=0.000
iters=5
new-facts=1
prior-facts=6402
mean1931.999-1932.000=-0.001
σ0.019-0.008=0.010
min1931.978-1931.994=-0.016
max1932.019-1932.011=0.009
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean2.495-2.509=-0.014
σ0.097-0.111=-0.014
min2.398-2.386=0.013
max2.632-2.685=-0.053
iters=5
new-facts=6402
prior-facts=1
mean4752.670-4752.672=-0.002
σ0.954-0.916=0.039
min4751.703-4751.917=-0.213
max4754.269-4754.265=0.003
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean8.374-8.296=0.079
σ0.485-0.249=0.236
min7.730-7.904=-0.174
max8.880-8.478=0.402
iters=5
new-facts=6402
prior-facts=6402
mean4943.202-4943.136=0.066
σ0.010-0.158=-0.148
min4943.188-4942.855=0.333
max4943.214-4943.217=-0.003
mean2999.000-2991.800=7.200
σ286.083-299.331=-13.248
min2608.000-2585.000=23.000
max3324.000-3360.000=-36.000
mean8.516-8.540=-0.024
σ0.097-0.085=0.012
min8.413-8.448=-0.035
max8.619-8.679=-0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.774-1.781=-0.007
σ0.231-0.194=0.037
min1.376-1.446=-0.070
max1.938-1.926=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.607-468.608=-0.001
σ574.883-574.884=-0.001
min181.159-181.166=-0.007
max1330.932-1330.934=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean0.558-0.535=0.023
σ0.537-0.491=0.046
min0.286-0.286=0.000
max1.363-1.271=0.092
policies=20
mean1811.965-1811.960=0.006
σ0.390-0.380=0.010
min1811.705-1811.697=0.007
max1812.539-1812.517=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean2.850-2.852=-0.002
σ0.006-0.020=-0.014
min2.845-2.832=0.014
max2.857-2.875=-0.018
policies=200
mean18126.614-18126.650=-0.036
σ0.553-0.593=-0.040
min18126.150-18126.249=-0.099
max18127.393-18127.506=-0.112
mean8400.000
σ0.000
min8400.000
max8400.000
mean2474.000-2433.000=41.000
σ0.000
min2474.000-2433.000=41.000
max2474.000-2433.000=41.000
mean28.580-28.696=-0.116
σ0.147-0.091=0.056
min28.480-28.562=-0.082
max28.798-28.767=0.032