Compare commits

Home / Compare 721947f0 .. c7586f30

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.000
σ0.050-0.048=0.002
min33.939-33.945=-0.006
max34.115-34.109=0.006
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.079-0.085=-0.006
σ0.004-0.003=0.001
min0.075-0.082=-0.006
max0.088-0.090=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.319-23.317=0.002
σ0.002-0.002=0.000
min23.315-23.313=0.003
max23.322-23.321=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.063=0.001
σ0.003-0.004=-0.001
min0.060-0.059=0.001
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.302=-0.001
σ0.364-0.364=0.000
min1756.727-1756.727=-0.000
max1757.894-1757.890=0.004
mean1647.350-1666.850=-19.500
σ623.751-620.755=2.996
min638.000-662.000=-24.000
max2825.000-2674.000=151.000
mean2.352-2.379=-0.027
σ0.068-0.105=-0.037
min2.227-2.257=-0.030
max2.495-2.708=-0.213

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.452-326.445=0.006
σ0.031-0.047=-0.015
min326.398-326.364=0.034
max326.472-326.481=-0.009
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean0.424-0.426=-0.002
σ0.003-0.003=0.001
min0.421-0.424=-0.003
max0.430-0.431=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1848.274-1988.616=-140.342
σ313.784-0.010=313.774
min1286.960-1988.609=-701.648
max1988.617-1988.632=-0.015
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean2.666-2.717=-0.051
σ0.500-0.127=0.373
min1.798-2.621=-0.822
max3.001-2.931=0.070
iters=5
new-facts=6402
prior-facts=1
mean4813.512-4813.439=0.072
σ7.694-7.718=-0.023
min4809.911-4809.942=-0.031
max4827.274-4827.245=0.029
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean8.194-8.810=-0.615
σ0.561-0.248=0.313
min7.744-8.559=-0.815
max9.114-9.115=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean5001.017-5001.010=0.008
σ0.035-0.021=0.013
min5000.975-5000.985=-0.010
max5001.065-5001.033=0.033
mean2986.800-3018.400=-31.600
σ232.556-240.235=-7.679
min2825.000-2674.000=151.000
max3351.000-3314.000=37.000
mean9.781-9.556=0.225
σ0.274-0.350=-0.076
min9.328-9.215=0.113
max10.012-9.926=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.205=-0.231
σ0.068-0.296=-0.228
min0.915-0.937=-0.023
max1.051-1.675=-0.624

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.438-464.436=0.002
σ574.771-574.778=-0.007
min177.042-177.041=0.001
max1326.594-1326.603=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean0.434-0.538=-0.104
σ0.299-0.533=-0.234
min0.281-0.270=0.011
max0.882-1.338=-0.456
policies=20
mean1770.751-1770.762=-0.011
σ0.363-0.358=0.006
min1770.488-1770.520=-0.032
max1771.286-1771.292=-0.006
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean2.784-2.729=0.055
σ0.003-0.003=-0.000
min2.780-2.726=0.054
max2.786-2.733=0.053
policies=200
mean17714.745-17714.862=-0.118
σ0.454-0.365=0.088
min17714.397-17714.669=-0.271
max17715.412-17715.410=0.002
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2674.000=151.000
σ0.000
min2825.000-2674.000=151.000
max2825.000-2674.000=151.000
mean27.844-27.481=0.364
σ0.444-0.123=0.322
min27.429-27.356=0.073
max28.286-27.606=0.680