Compare commits

Home / Compare e4e387db .. a021eabc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.969-53.972=-0.003
σ0.369-0.367=0.002
min53.830-53.829=0.001
max55.020-55.017=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.135-0.139=-0.004
σ0.005-0.005=0.000
min0.129-0.135=-0.005
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.342-43.343=-0.001
σ0.006-0.006=0.001
min43.330-43.333=-0.003
max43.355-43.354=0.000
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.120=0.004
σ0.004-0.001=0.003
min0.120-0.118=0.001
max0.129-0.121=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.893-1016.899=-0.006
σ1.196-1.174=0.021
min1016.347-1016.321=0.026
max1021.911-1021.817=0.094
mean1060.300-1063.850=-3.550
σ316.908-318.342=-1.434
min554.000-604.000=-50.000
max1619.000-1635.000=-16.000
mean1.531-1.561=-0.030
σ0.106-0.080=0.026
min1.375-1.479=-0.104
max1.806-1.801=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.148-302.122=0.027
σ0.251-0.219=0.032
min301.956-301.929=0.027
max302.828-302.718=0.110
mean2044.000-2030.000=14.000
σ0.000
min2044.000-2030.000=14.000
max2044.000-2030.000=14.000
mean0.588-0.591=-0.003
σ0.031-0.016=0.015
min0.501-0.553=-0.051
max0.607-0.606=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.519-303.510=0.010
σ0.053-0.058=-0.006
min303.442-303.413=0.029
max303.567-303.561=0.006
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean0.391-0.398=-0.007
σ0.002-0.010=-0.008
min0.389-0.388=0.001
max0.393-0.408=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1326.066-1326.068=-0.002
σ0.111-0.118=-0.006
min1325.926-1325.924=0.002
max1326.206-1326.211=-0.006
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean1.909-1.910=-0.001
σ0.102-0.082=0.020
min1.816-1.835=-0.019
max2.070-2.038=0.031
iters=5
new-facts=6402
prior-facts=1
mean1564.109-1564.107=0.002
σ6.917-6.927=-0.010
min1560.759-1560.760=-0.002
max1576.476-1576.493=-0.017
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean2.344-2.249=0.094
σ0.280-0.233=0.047
min2.115-2.122=-0.008
max2.689-2.663=0.026
iters=5
new-facts=6402
prior-facts=6402
mean1894.001-1894.009=-0.008
σ0.062-0.070=-0.008
min1893.892-1893.887=0.006
max1894.046-1894.062=-0.015
mean1768.800-1763.600=5.200
σ177.856-170.481=7.375
min1619.000-1635.000=-16.000
max2044.000-2030.000=14.000
mean2.939-2.966=-0.027
σ0.092-0.111=-0.020
min2.856-2.866=-0.010
max3.056-3.113=-0.057

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.115=0.088
σ0.264-0.185=0.079
min0.912-0.906=0.005
max1.611-1.372=0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.710-444.704=0.006
σ575.146-575.150=-0.004
min157.125-157.126=-0.001
max1307.430-1307.429=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean0.550-0.554=-0.005
σ0.559-0.588=-0.029
min0.268-0.259=0.009
max1.388-1.437=-0.049
policies=20
mean1571.557-1571.548=0.009
σ0.331-0.333=-0.001
min1571.369-1571.352=0.017
max1572.054-1572.046=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean2.627-2.625=0.001
σ0.019-0.013=0.005
min2.605-2.609=-0.004
max2.645-2.641=0.004
policies=200
mean15723.262-15723.245=0.016
σ0.123-0.078=0.045
min15723.126-15723.150=-0.024
max15723.399-15723.338=0.061
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1635.000=-16.000
σ0.000
min1619.000-1635.000=-16.000
max1619.000-1635.000=-16.000
mean26.495-26.616=-0.121
σ0.156-0.059=0.097
min26.307-26.558=-0.251
max26.624-26.691=-0.067