Compare commits

Home / Compare 7b6416af .. a286e332

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.617=-1.639
σ0.049-0.056=-0.007
min33.945-35.591=-1.645
max34.115-35.776=-1.661
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.082-0.083=-0.001
σ0.004-0.005=-0.001
min0.075-0.076=-0.001
max0.087-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-24.046=-0.729
σ0.004-0.003=0.001
min23.311-24.042=-0.731
max23.322-24.051=-0.728
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.067=-0.003
σ0.004-0.005=-0.001
min0.059-0.060=-0.001
max0.072-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1718.563=38.740
σ0.364-169.703=-169.339
min1756.729-997.577=759.152
max1757.890-1757.080=0.810
mean1665.850-1593.350=72.500
σ626.958-603.188=23.770
min672.000-629.000=43.000
max2612.000-2429.000=183.000
mean2.345-2.263=0.081
σ0.137-0.218=-0.081
min2.127-1.397=0.730
max2.746-2.444=0.302

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-324.766=1.672
σ0.058-0.050=0.009
min326.335-324.678=1.658
max326.480-324.795=1.684
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean0.424-0.431=-0.007
σ0.006-0.012=-0.006
min0.420-0.421=-0.001
max0.435-0.448=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.597-1985.319=3.278
σ0.003-0.013=-0.010
min1988.594-1985.305=3.288
max1988.601-1985.334=3.268
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean2.735-2.624=0.111
σ0.121-0.096=0.025
min2.635-2.535=0.100
max2.931-2.739=0.192
iters=5
new-facts=6402
prior-facts=1
mean4813.332-4808.980=4.352
σ7.778-7.745=0.033
min4809.455-4805.008=4.447
max4827.240-4822.824=4.416
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean8.977-8.930=0.047
σ0.359-0.424=-0.065
min8.364-8.587=-0.222
max9.242-9.613=-0.371
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-4996.632=4.378
σ0.022-0.013=0.009
min5000.986-4996.614=4.372
max5001.029-4996.646=4.383
mean3015.800-2995.400=20.400
σ305.686-324.019=-18.333
min2612.000-2571.000=41.000
max3410.000-3408.000=2.000
mean9.781-8.612=1.169
σ0.156-0.108=0.048
min9.599-8.491=1.108
max9.992-8.716=1.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.255-1.629=-0.374
σ0.395-0.245=0.151
min0.924-1.198=-0.274
max1.769-1.791=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.440-463.203=1.237
σ574.793-574.763=0.030
min177.039-175.816=1.222
max1326.629-1325.346=1.282
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean0.544-0.542=0.003
σ0.535-0.545=-0.010
min0.272-0.266=0.007
max1.346-1.359=-0.013
policies=20
mean1770.765-1758.496=12.269
σ0.378-0.348=0.030
min1770.513-1758.258=12.255
max1771.326-1759.010=12.316
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean2.762-2.701=0.060
σ0.019-0.013=0.007
min2.744-2.685=0.059
max2.787-2.715=0.072
policies=200
mean17714.919-17592.001=122.918
σ0.473-0.615=-0.143
min17714.627-17591.648=122.979
max17715.624-17592.922=122.702
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2612.000-2429.000=183.000
σ0.000
min2612.000-2429.000=183.000
max2612.000-2429.000=183.000
mean27.404-27.299=0.106
σ0.098-0.133=-0.035
min27.287-27.158=0.128
max27.509-27.474=0.035