Compare commits

Home / Compare 488133eb .. c4de0281

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.002
σ0.048-0.048=0.000
min70.749-70.748=0.001
max70.914-70.916=-0.002
mean412.200-413.000=-0.800
σ0.422-0.000=0.422
min412.000-413.000=-1.000
max413.000
mean0.160-0.160=-0.000
σ0.005-0.004=0.001
min0.151-0.152=-0.001
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.003-0.003=-0.000
min21.486-21.485=0.001
max21.497-21.497=-0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.063=0.001
σ0.003-0.004=-0.001
min0.061-0.059=0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.093=0.000
σ0.362-0.360=0.002
min1753.528-1753.529=-0.000
max1754.684-1754.678=0.006
mean1660.700-1632.750=27.950
σ626.430-611.448=14.982
min622.000-638.000=-16.000
max2724.000-2454.000=270.000
mean2.785-2.784=0.001
σ0.152-0.158=-0.006
min2.389-2.503=-0.114
max2.974-2.988=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.601=-0.003
σ0.008-0.007=0.001
min271.586-271.592=-0.007
max271.607-271.613=-0.006
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean0.384-0.386=-0.002
σ0.005-0.008=-0.003
min0.379-0.380=-0.001
max0.390-0.399=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.002-1932.002=-0.000
σ0.009-0.010=-0.001
min1931.987-1931.988=-0.001
max1932.010-1932.012=-0.002
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean2.554-2.535=0.019
σ0.087-0.153=-0.066
min2.493-2.384=0.108
max2.688-2.777=-0.089
iters=5
new-facts=6402
prior-facts=1
mean4752.621-4752.711=-0.090
σ1.029-0.886=0.143
min4751.698-4752.220=-0.523
max4754.382-4754.291=0.091
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean8.654-8.699=-0.045
σ0.571-0.317=0.254
min7.698-8.343=-0.645
max9.100-9.196=-0.096
iters=5
new-facts=6402
prior-facts=6402
mean4943.206-4943.138=0.068
σ0.023-0.149=-0.126
min4943.173-4942.873=0.300
max4943.233-4943.219=0.014
mean3034.200-3021.000=13.200
σ279.871-261.648=18.223
min2724.000-2626.000=98.000
max3415.000-3319.000=96.000
mean8.621-8.585=0.035
σ0.194-0.194=-0.000
min8.399-8.345=0.055
max8.902-8.797=0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.767=-0.737
σ0.138-0.155=-0.017
min0.942-1.538=-0.597
max1.257-1.924=-0.666

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.663-468.651=0.012
σ574.940-574.931=0.008
min181.182-181.183=-0.001
max1331.073-1331.048=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean0.564-0.574=-0.010
σ0.555-0.569=-0.014
min0.285-0.285=-0.000
max1.396-1.427=-0.031
policies=20
mean1812.182-1812.157=0.025
σ0.380-0.392=-0.012
min1811.922-1811.899=0.023
max1812.744-1812.737=0.007
mean840.000
σ0.000
min840.000
max840.000
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean2.835-2.833=0.002
σ0.021-0.007=0.014
min2.811-2.823=-0.012
max2.854-2.839=0.016
policies=200
mean18129.229-18129.124=0.105
σ0.488-0.563=-0.075
min18128.900-18128.719=0.181
max18129.954-18129.927=0.028
mean8400.000
σ0.000
min8400.000
max8400.000
mean2724.000-2454.000=270.000
σ0.000
min2724.000-2454.000=270.000
max2724.000-2454.000=270.000
mean28.622-28.661=-0.039
σ0.056-0.081=-0.025
min28.584-28.563=0.022
max28.705-28.758=-0.053