Compare commits

Home / Compare ffd913c1 .. 3f10820c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.108-0.106=0.002
min35.925-35.926=-0.001
max36.280-36.274=0.005
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.075-0.076=-0.001
σ0.004-0.004=-0.000
min0.071-0.071=0.000
max0.082-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.003=0.001
min26.203-26.202=0.000
max26.216-26.214=0.002
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.061-0.061=0.000
σ0.003-0.002=0.001
min0.059-0.059=-0.001
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.364=-0.001
σ0.374-0.370=0.004
min1757.788-1757.786=0.003
max1758.966-1758.955=0.011
mean1656.450-1654.250=2.200
σ623.756-622.176=1.579
min686.000-684.000=2.000
max2767.000-2752.000=15.000
mean2.360-2.329=0.031
σ0.087-0.115=-0.028
min2.275-2.194=0.081
max2.528-2.614=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-279.512=-0.002
σ0.007-0.007=-0.000
min279.500-279.503=-0.004
max279.517-279.519=-0.002
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean0.408-0.408=-0.000
σ0.001-0.006=-0.005
min0.406-0.404=0.001
max0.409-0.418=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2178.429-2178.398=0.031
σ0.040-0.083=-0.044
min2178.358-2178.251=0.108
max2178.455-2178.453=0.002
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean3.316-3.419=-0.104
σ0.185-0.199=-0.013
min2.996-3.231=-0.236
max3.469-3.722=-0.254
iters=5
new-facts=6402
prior-facts=1
mean5056.276-5056.128=0.148
σ0.744-1.147=-0.404
min5055.777-5055.234=0.543
max5057.593-5058.113=-0.521
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean8.789-9.004=-0.215
σ0.655-0.596=0.059
min8.279-8.052=0.227
max9.823-9.530=0.293
iters=5
new-facts=6402
prior-facts=6402
mean5193.761-5193.746=0.015
σ0.087-0.093=-0.006
min5193.695-5193.665=0.030
max5193.857-5193.856=0.001
mean3288.800-3185.000=103.800
σ395.904-429.580=-33.676
min2767.000-2752.000=15.000
max3670.000-3790.000=-120.000
mean8.858-8.717=0.140
σ0.086-0.110=-0.024
min8.740-8.629=0.111
max8.954-8.894=0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-0.972=0.049
σ0.061-0.057=0.004
min0.946-0.941=0.006
max1.067-1.073=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.484-465.479=0.005
σ572.664-572.660=0.004
min179.144-179.142=0.003
max1324.480-1324.470=0.010
mean79.500
σ7.000
min76.000
max90.000
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean0.477-0.470=0.007
σ0.396-0.381=0.015
min0.277-0.278=-0.002
max1.071-1.042=0.029
policies=20
mean1791.671-1791.699=-0.028
σ0.318-0.331=-0.013
min1791.469-1791.517=-0.048
max1792.144-1792.195=-0.051
mean760.000
σ0.000
min760.000
max760.000
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean2.793-2.768=0.025
σ0.013-0.012=0.001
min2.777-2.750=0.027
max2.808-2.779=0.029
policies=200
mean17923.392-17923.491=-0.100
σ0.588-0.458=0.130
min17923.005-17923.231=-0.225
max17924.261-17924.177=0.083
mean7600.000
σ0.000
min7600.000
max7600.000
mean2767.000-2752.000=15.000
σ0.000
min2767.000-2752.000=15.000
max2767.000-2752.000=15.000
mean28.192-28.176=0.016
σ0.101-0.164=-0.063
min28.065-27.994=0.071
max28.277-28.392=-0.115