Compare commits

Home / Compare 80b15948 .. fb1554ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.608=-0.043
σ0.046-0.044=0.002
min70.542-70.583=-0.041
max70.695-70.732=-0.037
mean416.000-413.800=2.200
σ0.000-0.422=-0.422
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.160-0.160=0.000
σ0.004-0.003=0.000
min0.157-0.157=0.000
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.331=-0.044
σ0.004-0.002=0.002
min21.281-21.328=-0.048
max21.293-21.334=-0.041
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.060=0.003
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.362-0.361=0.000
min1752.801-1752.798=0.002
max1753.957-1753.974=-0.017
mean1664.550-1662.000=2.550
σ632.823-638.602=-5.779
min621.000-618.000=3.000
max2768.000-2814.000=-46.000
mean2.801-2.848=-0.047
σ0.117-0.115=0.002
min2.501-2.514=-0.013
max2.974-3.088=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.755=-0.003
σ0.006-0.006=0.000
min271.745-271.749=-0.004
max271.759-271.761=-0.001
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean0.386-0.380=0.005
σ0.015-0.004=0.011
min0.374-0.378=-0.004
max0.407-0.388=0.018
iters=5
new-facts=1
prior-facts=6402
mean1932.166-1932.172=-0.006
σ0.011-0.016=-0.005
min1932.152-1932.148=0.004
max1932.179-1932.186=-0.006
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean2.964-3.011=-0.047
σ0.123-0.049=0.073
min2.768-2.964=-0.196
max3.103-3.081=0.022
iters=5
new-facts=6402
prior-facts=1
mean4752.890-4752.880=0.009
σ0.938-0.924=0.013
min4752.408-4752.401=0.006
max4754.565-4754.532=0.033
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean8.742-8.771=-0.030
σ0.244-0.220=0.024
min8.395-8.523=-0.128
max9.043-9.040=0.003
iters=5
new-facts=6402
prior-facts=6402
mean4943.373-4943.304=0.070
σ0.021-0.165=-0.144
min4943.348-4943.009=0.339
max4943.395-4943.384=0.011
mean2986.400-3003.200=-16.800
σ269.152-203.801=65.351
min2768.000-2814.000=-46.000
max3398.000-3306.000=92.000
mean8.388-8.510=-0.121
σ0.076-0.088=-0.012
min8.291-8.445=-0.154
max8.492-8.656=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.079-1.084=-0.005
σ0.197-0.112=0.085
min0.935-0.939=-0.004
max1.335-1.254=0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.866-467.862=0.004
σ575.935-575.928=0.007
min179.888-179.887=0.002
max1331.769-1331.754=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean0.477-0.482=-0.005
σ0.382-0.401=-0.019
min0.284-0.278=0.006
max1.050-1.083=-0.033
policies=20
mean1799.161-1799.140=0.021
σ0.359-0.372=-0.012
min1798.951-1798.881=0.071
max1799.698-1799.692=0.006
mean820.000
σ0.000
min820.000
max820.000
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean2.793-2.809=-0.016
σ0.009-0.020=-0.010
min2.780-2.792=-0.011
max2.803-2.832=-0.029
policies=200
mean17998.553-17998.445=0.108
σ0.545-0.534=0.011
min17998.251-17998.042=0.210
max17999.368-17999.231=0.137
mean8200.000
σ0.000
min8200.000
max8200.000
mean2768.000-2814.000=-46.000
σ0.000
min2768.000-2814.000=-46.000
max2768.000-2814.000=-46.000
mean28.174-28.267=-0.093
σ0.265-0.113=0.152
min27.985-28.168=-0.183
max28.566-28.421=0.145