Compare commits

Home / Compare d8462947 .. 9cf246e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.107-0.106=0.001
min35.748-35.755=-0.007
max36.102-36.100=0.002
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.073-0.074=-0.001
σ0.004-0.005=-0.001
min0.068-0.069=-0.002
max0.081-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.066=-0.002
σ0.003-0.003=0.001
min26.058-26.062=-0.005
max26.070-26.070=-0.000
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.061-0.061=-0.001
σ0.001-0.003=-0.002
min0.059-0.059=-0.000
max0.063-0.069=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.923=-0.000
σ0.364-0.368=-0.004
min1755.350-1755.352=-0.001
max1756.508-1756.519=-0.010
mean1666.400-1662.550=3.850
σ635.575-631.246=4.329
min666.000-663.000=3.000
max2630.000-2613.000=17.000
mean2.818-2.779=0.039
σ0.151-0.207=-0.056
min2.396-2.269=0.126
max3.036-3.038=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.200=-0.005
σ0.006-0.008=-0.001
min277.187-277.192=-0.005
max277.203-277.209=-0.006
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean0.397-0.410=-0.013
σ0.007-0.015=-0.008
min0.391-0.399=-0.008
max0.409-0.430=-0.020
iters=5
new-facts=1
prior-facts=6402
mean2174.418-2174.426=-0.008
σ0.038-0.016=0.022
min2174.353-2174.399=-0.045
max2174.452-2174.436=0.015
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean3.095-2.825=0.270
σ0.313-0.115=0.198
min2.776-2.743=0.033
max3.585-3.027=0.558
iters=5
new-facts=6402
prior-facts=1
mean5052.635-5052.490=0.146
σ0.988-1.121=-0.132
min5052.041-5051.498=0.543
max5054.390-5054.424=-0.034
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean8.708-8.929=-0.221
σ0.590-0.697=-0.107
min8.260-8.062=0.198
max9.660-9.823=-0.163
iters=5
new-facts=6402
prior-facts=6402
mean5188.358-5188.417=-0.059
σ0.121-0.095=0.026
min5188.174-5188.329=-0.156
max5188.515-5188.521=-0.007
mean3288.600-3239.200=49.400
σ417.183-363.234=53.948
min2706.000-2830.000=-124.000
max3675.000-3779.000=-104.000
mean9.040-8.758=0.281
σ0.503-0.127=0.376
min8.711-8.572=0.138
max9.933-8.885=1.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.344=-0.029
σ0.340-0.423=-0.083
min0.944-0.944=0.000
max1.816-1.837=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.852-464.856=-0.004
σ572.660-572.661=-0.001
min178.515-178.522=-0.007
max1323.842-1323.848=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean0.568-0.566=0.003
σ0.570-0.556=0.014
min0.274-0.281=-0.007
max1.423-1.400=0.023
policies=20
mean1785.464-1785.487=-0.022
σ0.353-0.352=0.000
min1785.237-1785.257=-0.021
max1785.989-1786.010=-0.021
mean760.000
σ0.000
min760.000
max760.000
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean2.785-2.786=-0.001
σ0.025-0.023=0.002
min2.758-2.755=0.003
max2.816-2.807=0.009
policies=200
mean17861.568-17861.398=0.170
σ0.529-0.595=-0.066
min17861.299-17861.062=0.237
max17862.362-17862.289=0.072
mean7600.000
σ0.000
min7600.000
max7600.000
mean2630.000-2613.000=17.000
σ0.000
min2630.000-2613.000=17.000
max2630.000-2613.000=17.000
mean28.246-28.119=0.127
σ0.145-0.188=-0.043
min28.107-27.981=0.126
max28.418-28.387=0.032