Compare commits

Home / Compare bfba0cf1 .. 6252d901

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.050=-0.002
min33.953-33.952=0.001
max34.112-34.119=-0.007
mean415.000-412.900=2.100
σ0.000-0.316=-0.316
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.001
min0.082-0.076=0.006
max0.090-0.088=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=0.000
min23.314-23.314=-0.000
max23.323-23.323=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.066=0.000
σ0.003-0.003=0.001
min0.064-0.064=-0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.430=0.062
σ0.364-0.365=-0.001
min1756.919-1756.853=0.066
max1758.080-1758.017=0.063
mean1666.300-1663.450=2.850
σ623.379-627.322=-3.943
min689.000-669.000=20.000
max2760.000-2611.000=149.000
mean2.375-2.349=0.026
σ0.122-0.129=-0.007
min2.168-2.154=0.013
max2.768-2.751=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.577=0.055
σ0.061-0.031=0.031
min326.523-326.523=-0.000
max326.671-326.597=0.074
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean0.429-0.422=0.007
σ0.006-0.001=0.005
min0.424-0.421=0.004
max0.439-0.423=0.016
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.742=0.057
σ0.015-0.009=0.006
min1988.782-1988.728=0.054
max1988.820-1988.752=0.068
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean2.679-2.716=-0.037
σ0.143-0.053=0.090
min2.576-2.657=-0.081
max2.926-2.798=0.128
iters=5
new-facts=6402
prior-facts=1
mean4813.553-4813.402=0.152
σ7.513-7.183=0.329
min4810.142-4810.043=0.100
max4826.992-4826.250=0.741
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean8.923-8.227=0.697
σ0.444-0.552=-0.108
min8.467-7.806=0.661
max9.539-9.112=0.427
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.138=-0.007
σ0.156-0.026=0.131
min5000.855-5001.105=-0.250
max5001.231-5001.160=0.071
mean2989.200-2980.400=8.800
σ228.327-406.012=-177.685
min2760.000-2611.000=149.000
max3322.000-3554.000=-232.000
mean9.645-9.807=-0.161
σ0.182-0.174=0.008
min9.460-9.574=-0.114
max9.901-10.000=-0.099

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.252=-0.250
σ0.141-0.409=-0.268
min0.912-0.919=-0.007
max1.234-1.824=-0.590

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.566=0.071
σ574.772-574.789=-0.017
min177.240-177.168=0.073
max1326.795-1326.749=0.045
mean88.250
σ8.500
min84.000
max101.000
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean0.433-0.546=-0.112
σ0.310-0.544=-0.234
min0.278-0.271=0.007
max0.898-1.361=-0.463
policies=20
mean1772.712-1772.028=0.684
σ0.407-0.343=0.064
min1772.443-1771.799=0.644
max1773.317-1772.538=0.779
mean840.000
σ0.000
min840.000
max840.000
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean2.839-2.711=0.129
σ0.076-0.017=0.059
min2.799-2.687=0.112
max2.953-2.725=0.229
policies=200
mean17733.884-17727.642=6.242
σ0.432-0.517=-0.085
min17733.480-17727.343=6.137
max17734.496-17728.416=6.080
mean8400.000
σ0.000
min8400.000
max8400.000
mean2760.000-2611.000=149.000
σ0.000
min2760.000-2611.000=149.000
max2760.000-2611.000=149.000
mean27.476-27.497=-0.020
σ0.129-0.128=0.001
min27.321-27.332=-0.011
max27.616-27.641=-0.024