Compare commits

Home / Compare 3c8c2fa7 .. 00224c2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-53.973=-0.267
σ0.365-0.365=0.000
min53.571-53.834=-0.262
max54.744-55.011=-0.267
mean416.000-414.600=1.400
σ0.000-0.516=-0.516
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.140-0.140=0.000
σ0.004-0.004=0.000
min0.136-0.135=0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-43.178=-0.199
σ0.005-0.005=0.001
min42.970-43.169=-0.199
max42.986-43.185=-0.198
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.122=-0.000
σ0.005-0.003=0.001
min0.117-0.119=-0.002
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.897-994.842=0.055
σ1.213-1.272=-0.058
min994.367-994.267=0.100
max999.982-1000.199=-0.217
mean1061.300-1064.900=-3.600
σ314.875-317.857=-2.982
min596.000-574.000=22.000
max1569.000-1611.000=-42.000
mean1.460-1.474=-0.014
σ0.074-0.108=-0.034
min1.388-1.404=-0.016
max1.725-1.877=-0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.312-297.264=0.048
σ0.005-0.019=-0.014
min297.306-297.235=0.071
max297.319-297.280=0.039
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean0.386-0.393=-0.006
σ0.006-0.008=-0.003
min0.380-0.386=-0.006
max0.393-0.407=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1298.674-1298.534=0.140
σ0.099-0.118=-0.019
min1298.502-1298.476=0.026
max1298.749-1298.745=0.005
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean2.039-1.956=0.083
σ0.261-0.050=0.212
min1.851-1.925=-0.074
max2.491-2.043=0.449
iters=5
new-facts=6402
prior-facts=1
mean1718.873-1820.772=-101.899
σ6.916-7.035=-0.119
min1715.693-1817.376=-101.683
max1731.242-1833.341=-102.099
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean2.925-4.201=-1.276
σ0.414-0.236=0.178
min2.520-3.904=-1.384
max3.623-4.442=-0.819
iters=5
new-facts=6402
prior-facts=6402
mean1981.576-2083.376=-101.800
σ0.056-0.010=0.045
min1981.482-2083.365=-101.883
max1981.612-2083.391=-101.779
mean1765.800-1811.600=-45.800
σ162.209-186.905=-24.696
min1569.000-1611.000=-42.000
max1974.000-2062.000=-88.000
mean3.105-4.522=-1.417
σ0.131-0.097=0.034
min2.943-4.388=-1.445
max3.306-4.647=-1.341

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.360-1.190=0.169
σ0.326-0.380=-0.054
min0.906-0.920=-0.014
max1.768-1.837=-0.069

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.375-440.380=-0.005
σ572.879-572.883=-0.004
min153.931-153.931=0.000
max1299.694-1299.705=-0.011
mean94.250
σ8.500
min90.000
max107.000
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean0.547-0.523=0.023
σ0.576-0.513=0.063
min0.258-0.266=-0.008
max1.411-1.293=0.119
policies=20
mean1539.512-1539.603=-0.092
σ0.303-0.304=-0.001
min1539.316-1539.418=-0.101
max1539.963-1540.057=-0.094
mean900.000
σ0.000
min900.000
max900.000
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean2.566-2.579=-0.013
σ0.019-0.017=0.002
min2.541-2.567=-0.026
max2.586-2.605=-0.019
policies=200
mean15403.077-15404.007=-0.930
σ0.128-0.074=0.054
min15402.981-15403.910=-0.928
max15403.257-15404.081=-0.824
mean9000.000
σ0.000
min9000.000
max9000.000
mean1569.000-1611.000=-42.000
σ0.000
min1569.000-1611.000=-42.000
max1569.000-1611.000=-42.000
mean25.976-25.990=-0.014
σ0.095-0.149=-0.054
min25.863-25.866=-0.003
max26.092-26.184=-0.092