Compare commits

Home / Compare 9efa40bf .. 01c0f8b1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.048=0.000
min33.953-33.950=0.003
max34.112-34.111=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.002
min0.082-0.078=0.004
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.002=0.001
min23.314-23.312=0.002
max23.323-23.319=0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.064=0.002
σ0.003-0.004=-0.000
min0.064-0.060=0.004
max0.074-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.494=-0.002
σ0.364-0.363=0.001
min1756.919-1756.922=-0.003
max1758.080-1758.081=-0.001
mean1666.300-1661.450=4.850
σ623.379-623.100=0.279
min689.000-662.000=27.000
max2760.000-2597.000=163.000
mean2.375-2.419=-0.045
σ0.122-0.129=-0.007
min2.168-2.288=-0.121
max2.768-2.775=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.638=-0.006
σ0.061-0.047=0.014
min326.523-326.555=-0.033
max326.671-326.676=-0.006
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean0.429-0.423=0.006
σ0.006-0.001=0.005
min0.424-0.422=0.002
max0.439-0.424=0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.806=-0.007
σ0.015-0.010=0.005
min1988.782-1988.788=-0.006
max1988.820-1988.814=0.006
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean2.679-2.696=-0.017
σ0.143-0.074=0.069
min2.576-2.613=-0.037
max2.926-2.801=0.125
iters=5
new-facts=6402
prior-facts=1
mean4813.553-4813.669=-0.116
σ7.513-7.710=-0.197
min4810.142-4810.133=0.009
max4826.992-4827.460=-0.468
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean8.923-8.601=0.322
σ0.444-0.590=-0.146
min8.467-7.690=0.776
max9.539-9.136=0.403
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.000=0.131
σ0.156-0.310=-0.154
min5000.855-5000.519=0.336
max5001.231-5001.231=-0.000
mean2989.200-2994.000=-4.800
σ228.327-271.282=-42.955
min2760.000-2602.000=158.000
max3322.000-3324.000=-2.000
mean9.645-9.879=-0.234
σ0.182-0.251=-0.069
min9.460-9.614=-0.154
max9.901-10.292=-0.391

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.284=-0.282
σ0.141-0.381=-0.241
min0.912-0.944=-0.032
max1.234-1.822=-0.588

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.634=0.002
σ574.772-574.786=-0.013
min177.240-177.236=0.004
max1326.795-1326.813=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean0.433-0.570=-0.137
σ0.310-0.587=-0.277
min0.278-0.275=0.003
max0.898-1.450=-0.552
policies=20
mean1772.712-1772.682=0.030
σ0.407-0.356=0.051
min1772.443-1772.456=-0.013
max1773.317-1773.212=0.105
mean840.000
σ0.000
min840.000
max840.000
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean2.839-2.732=0.108
σ0.076-0.007=0.069
min2.799-2.724=0.075
max2.953-2.742=0.211
policies=200
mean17733.884-17734.072=-0.188
σ0.432-0.531=-0.099
min17733.480-17733.754=-0.273
max17734.496-17734.865=-0.369
mean8400.000
σ0.000
min8400.000
max8400.000
mean2760.000-2597.000=163.000
σ0.000
min2760.000-2597.000=163.000
max2760.000-2597.000=163.000
mean27.476-27.565=-0.089
σ0.129-0.148=-0.019
min27.321-27.418=-0.097
max27.616-27.759=-0.143