Compare commits

Home / Compare dd18d300 .. 1e1fe85a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.048-0.049=-0.001
min33.947-33.945=0.002
max34.110-34.115=-0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.082-0.082=0.000
σ0.005-0.004=0.001
min0.076-0.075=0.001
max0.092-0.087=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.001-0.004=-0.003
min23.315-23.311=0.004
max23.319-23.322=-0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.064=-0.000
σ0.004-0.004=0.000
min0.059-0.059=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.364-0.364=-0.000
min1756.729-1756.729=0.000
max1757.891-1757.890=0.001
mean1660.950-1665.850=-4.900
σ621.691-626.958=-5.267
min669.000-672.000=-3.000
max2591.000-2612.000=-21.000
mean2.371-2.345=0.026
σ0.139-0.137=0.001
min2.212-2.127=0.085
max2.695-2.746=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.438-326.439=-0.001
σ0.059-0.058=0.001
min326.333-326.335=-0.002
max326.470-326.480=-0.010
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.426-0.424=0.001
σ0.002-0.006=-0.004
min0.425-0.420=0.005
max0.429-0.435=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.607-1988.597=0.010
σ0.016-0.003=0.013
min1988.582-1988.594=-0.011
max1988.621-1988.601=0.020
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.677-2.735=-0.059
σ0.071-0.121=-0.050
min2.578-2.635=-0.057
max2.774-2.931=-0.157
iters=5
new-facts=6402
prior-facts=1
mean4813.474-4813.332=0.142
σ7.754-7.778=-0.025
min4809.903-4809.455=0.449
max4827.343-4827.240=0.103
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean8.617-8.977=-0.360
σ0.606-0.359=0.247
min7.965-8.364=-0.400
max9.569-9.242=0.327
iters=5
new-facts=6402
prior-facts=6402
mean5001.008-5001.010=-0.002
σ0.019-0.022=-0.002
min5000.985-5000.986=-0.000
max5001.025-5001.029=-0.003
mean2978.600-3015.800=-37.200
σ288.348-305.686=-17.337
min2591.000-2612.000=-21.000
max3319.000-3410.000=-91.000
mean9.808-9.781=0.027
σ0.088-0.156=-0.068
min9.713-9.599=0.115
max9.928-9.992=-0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.255=-0.015
σ0.377-0.395=-0.018
min0.915-0.924=-0.009
max1.713-1.769=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.440=-0.004
σ574.790-574.793=-0.002
min177.035-177.039=-0.004
max1326.621-1326.629=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.556-0.544=0.012
σ0.561-0.535=0.027
min0.272-0.272=-0.001
max1.398-1.346=0.052
policies=20
mean1770.742-1770.765=-0.023
σ0.345-0.378=-0.033
min1770.519-1770.513=0.006
max1771.255-1771.326=-0.071
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.725-2.762=-0.037
σ0.011-0.019=-0.008
min2.714-2.744=-0.031
max2.737-2.787=-0.051
policies=200
mean17714.794-17714.919=-0.125
σ0.622-0.473=0.149
min17714.356-17714.627=-0.271
max17715.712-17715.624=0.088
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean27.583-27.404=0.179
σ0.188-0.098=0.090
min27.410-27.287=0.124
max27.782-27.509=0.273