Compare commits

Home / Compare 3020cd81 .. 8088da4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.108-0.107=0.001
min35.926-35.922=0.004
max36.280-36.276=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.078=-0.001
σ0.004-0.004=0.000
min0.072-0.075=-0.003
max0.085-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.003-0.002=0.001
min26.204-26.204=0.000
max26.212-26.211=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.060-0.061=-0.001
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.362=0.002
σ0.372-0.372=0.000
min1757.789-1757.786=0.003
max1758.962-1758.961=0.001
mean1651.800-1655.150=-3.350
σ644.585-620.424=24.161
min673.000-685.000=-12.000
max2739.000-2746.000=-7.000
mean2.376-2.368=0.008
σ0.092-0.114=-0.022
min2.269-2.178=0.092
max2.573-2.634=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-279.512=-0.003
σ0.005-0.007=-0.003
min279.503-279.503=-0.001
max279.515-279.517=-0.002
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean0.409-0.409=0.000
σ0.005-0.002=0.003
min0.406-0.405=0.000
max0.418-0.410=0.008
iters=5
new-facts=1
prior-facts=6402
mean2178.422-2178.418=0.005
σ0.019-0.034=-0.015
min2178.397-2178.359=0.038
max2178.445-2178.443=0.002
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean3.336-3.432=-0.096
σ0.219-0.172=0.048
min3.172-3.271=-0.098
max3.718-3.620=0.098
iters=5
new-facts=6402
prior-facts=1
mean5056.251-5056.392=-0.141
σ1.074-1.004=0.070
min5055.418-5055.790=-0.372
max5058.123-5058.177=-0.054
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean8.950-8.715=0.236
σ0.570-0.657=-0.087
min8.199-8.163=0.035
max9.526-9.736=-0.210
iters=5
new-facts=6402
prior-facts=6402
mean5193.675-5193.689=-0.014
σ0.119-0.212=-0.093
min5193.509-5193.338=0.171
max5193.844-5193.874=-0.031
mean3189.400-3285.800=-96.400
σ440.201-404.146=36.056
min2739.000-2746.000=-7.000
max3804.000-3673.000=131.000
mean8.854-8.832=0.022
σ0.187-0.095=0.092
min8.676-8.705=-0.029
max9.076-8.970=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.001=0.024
σ0.122-0.072=0.050
min0.941-0.937=0.004
max1.224-1.080=0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.479-465.476=0.003
σ572.659-572.661=-0.002
min179.139-179.137=0.001
max1324.468-1324.468=0.000
mean79.500
σ7.000
min76.000
max90.000
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean0.557-0.474=0.084
σ0.548-0.379=0.169
min0.281-0.282=-0.002
max1.379-1.042=0.338
policies=20
mean1791.679-1791.671=0.008
σ0.323-0.340=-0.017
min1791.474-1791.474=-0.000
max1792.161-1792.178=-0.017
mean760.000
σ0.000
min760.000
max760.000
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean2.800-2.818=-0.018
σ0.045-0.006=0.039
min2.738-2.811=-0.073
max2.841-2.824=0.017
policies=200
mean17923.395-17923.168=0.227
σ0.592-0.510=0.081
min17922.982-17922.880=0.102
max17924.273-17923.933=0.340
mean7600.000
σ0.000
min7600.000
max7600.000
mean2739.000-2746.000=-7.000
σ0.000
min2739.000-2746.000=-7.000
max2739.000-2746.000=-7.000
mean28.387-28.237=0.149
σ0.253-0.094=0.160
min28.231-28.152=0.079
max28.762-28.368=0.394