Compare commits

Home / Compare 01cbbfc8 .. 5e06d1e0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.048=-0.000
min33.949-33.952=-0.003
max34.110-34.112=-0.002
mean415.900-416.000=-0.100
σ0.316-0.000=0.316
min415.000-416.000=-1.000
max416.000
mean0.082-0.081=0.001
σ0.005-0.004=0.001
min0.075-0.076=-0.001
max0.090-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.002=0.000
min23.313-23.314=-0.001
max23.323-23.322=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.063=0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.365=0.001
σ0.364-0.364=0.000
min1756.790-1756.789=0.001
max1757.952-1757.952=-0.000
mean1675.550-1660.350=15.200
σ622.027-620.646=1.382
min671.000
max2616.000-2589.000=27.000
mean2.385-2.371=0.014
σ0.153-0.107=0.047
min2.258-2.253=0.005
max2.969-2.742=0.227

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.504-326.500=0.003
σ0.068-0.059=0.009
min326.383-326.395=-0.011
max326.550-326.534=0.016
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean0.441-0.428=0.013
σ0.017-0.007=0.010
min0.423-0.423=0.001
max0.459-0.441=0.018
iters=5
new-facts=1
prior-facts=6402
mean1988.680-1988.679=0.001
σ0.007-0.006=0.001
min1988.671-1988.672=-0.002
max1988.688-1988.688=-0.000
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean2.686-2.723=-0.037
σ0.082-0.171=-0.089
min2.587-2.609=-0.021
max2.815-3.024=-0.209
iters=5
new-facts=6402
prior-facts=1
mean4813.572-4813.402=0.170
σ7.740-7.807=-0.067
min4810.002-4809.547=0.456
max4827.417-4827.363=0.054
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean8.822-8.527=0.295
σ0.745-0.582=0.164
min7.793-7.635=0.158
max9.650-9.268=0.382
iters=5
new-facts=6402
prior-facts=6402
mean5001.005-5001.068=-0.063
σ0.178-0.019=0.159
min5000.692-5001.044=-0.352
max5001.123-5001.090=0.033
mean2995.200-2969.400=25.800
σ259.723-402.295=-142.572
min2616.000-2589.000=27.000
max3309.000-3529.000=-220.000
mean9.662-9.713=-0.051
σ0.690-0.257=0.433
min8.452-9.328=-0.877
max10.099-10.049=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.298=-0.080
σ0.417-0.350=0.067
min0.913-0.911=0.002
max1.801-1.713=0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.502-464.494=0.008
σ574.782-574.777=0.005
min177.109-177.104=0.005
max1326.675-1326.659=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean0.568-0.559=0.009
σ0.587-0.557=0.030
min0.271-0.275=-0.004
max1.448-1.394=0.054
policies=20
mean1771.388-1771.367=0.021
σ0.355-0.365=-0.011
min1771.158-1771.131=0.027
max1771.915-1771.910=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean2.739-2.754=-0.015
σ0.032-0.029=0.002
min2.717-2.732=-0.015
max2.786-2.797=-0.011
policies=200
mean17721.119-17720.992=0.127
σ0.524-0.401=0.124
min17720.808-17720.623=0.185
max17721.903-17721.561=0.343
mean8400.000
σ0.000
min8400.000
max8400.000
mean2616.000-2589.000=27.000
σ0.000
min2616.000-2589.000=27.000
max2616.000-2589.000=27.000
mean27.558-27.591=-0.033
σ0.153-0.181=-0.029
min27.342-27.442=-0.100
max27.678-27.820=-0.142