Compare commits

Home / Compare cd5f5849 .. 0b3bd64a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.000
σ0.107-0.106=0.001
min35.927-35.926=0.001
max36.276-36.274=0.002
mean415.200-414.000=1.200
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.077-0.076=0.000
σ0.003-0.003=0.000
min0.075-0.074=0.000
max0.083-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.005-0.004=0.000
min26.201-26.203=-0.002
max26.214-26.217=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.366-1758.363=0.003
σ0.371-0.372=-0.001
min1757.789-1757.786=0.003
max1758.962-1758.962=0.000
mean1661.750-1657.650=4.100
σ631.805-624.186=7.618
min667.000-686.000=-19.000
max2695.000-2767.000=-72.000
mean2.354-2.378=-0.023
σ0.107-0.109=-0.002
min2.242-2.253=-0.011
max2.632-2.585=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.515-279.513=0.002
σ0.006-0.008=-0.002
min279.506-279.501=0.005
max279.520-279.522=-0.002
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean0.417-0.416=0.001
σ0.009-0.011=-0.002
min0.407-0.404=0.004
max0.428-0.427=0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.441-2178.443=-0.001
σ0.022-0.023=-0.001
min2178.417-2178.412=0.005
max2178.468-2178.474=-0.005
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean3.417-3.390=0.026
σ0.086-0.131=-0.044
min3.312-3.234=0.078
max3.548-3.527=0.022
iters=5
new-facts=6402
prior-facts=1
mean5056.404-5056.262=0.142
σ1.056-0.732=0.325
min5055.806-5055.795=0.011
max5058.286-5057.555=0.731
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean8.879-9.185=-0.306
σ0.855-0.461=0.394
min8.135-8.416=-0.281
max10.315-9.563=0.751
iters=5
new-facts=6402
prior-facts=6402
mean5193.759-5193.656=0.103
σ0.084-0.232=-0.148
min5193.695-5193.291=0.404
max5193.861-5193.858=0.004
mean3286.200-3236.000=50.200
σ417.674-439.644=-21.970
min2703.000-2767.000=-64.000
max3673.000-3858.000=-185.000
mean8.975-8.933=0.042
σ0.391-0.454=-0.063
min8.708-8.590=0.118
max9.656-9.691=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-0.978=0.206
σ0.400-0.060=0.340
min0.933-0.944=-0.011
max1.856-1.084=0.772

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.479-465.478=0.000
σ572.657-572.664=-0.007
min179.139-179.142=-0.003
max1324.464-1324.474=-0.010
mean79.500
σ7.000
min76.000
max90.000
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean0.564-0.482=0.082
σ0.573-0.403=0.170
min0.276-0.278=-0.003
max1.424-1.086=0.338
policies=20
mean1791.673-1791.705=-0.033
σ0.356-0.338=0.018
min1791.433-1791.515=-0.081
max1792.201-1792.210=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean2.790-2.800=-0.009
σ0.009-0.015=-0.006
min2.780-2.780=0.000
max2.800-2.815=-0.015
policies=200
mean17923.401-17923.509=-0.108
σ0.612-0.488=0.124
min17922.752-17923.234=-0.482
max17924.229-17924.241=-0.012
mean7600.000
σ0.000
min7600.000
max7600.000
mean2695.000-2767.000=-72.000
σ0.000
min2695.000-2767.000=-72.000
max2695.000-2767.000=-72.000
mean28.234-28.321=-0.087
σ0.126-0.128=-0.002
min28.087-28.206=-0.119
max28.358-28.483=-0.125