Compare commits

Home / Compare 3bd6df10 .. d3042363

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.795=0.000
σ0.113-0.112=0.001
min35.740-35.742=-0.002
max36.114-36.111=0.004
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.073-0.074=-0.001
σ0.004-0.004=-0.000
min0.069-0.070=-0.001
max0.080-0.081=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.066-26.066=0.000
σ0.003-0.004=-0.001
min26.061-26.056=0.005
max26.071-26.070=0.001
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.061-0.059=0.002
σ0.003-0.003=-0.000
min0.060-0.056=0.004
max0.069-0.064=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.973-1756.998=-38.025
σ169.953-0.367=169.587
min996.922-1756.418=-759.496
max1757.588-1757.592=-0.004
mean1659.400-1654.250=5.150
σ637.385-612.565=24.820
min671.000-688.000=-17.000
max2710.000-2779.000=-69.000
mean2.789-2.760=0.029
σ0.343-0.205=0.138
min1.434-2.334=-0.900
max3.061-3.015=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.283-278.283=-0.001
σ0.007-0.008=-0.000
min278.271-278.275=-0.003
max278.292-278.293=-0.002
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean0.407-0.410=-0.003
σ0.005-0.008=-0.004
min0.403-0.403=0.001
max0.415-0.420=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2175.512-2175.524=-0.012
σ0.032-0.010=0.022
min2175.468-2175.510=-0.042
max2175.547-2175.534=0.013
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean2.998-2.900=0.098
σ0.129-0.136=-0.007
min2.821-2.788=0.033
max3.149-3.092=0.057
iters=5
new-facts=6402
prior-facts=1
mean5134.604-5134.537=0.066
σ1.006-1.007=-0.002
min5133.990-5133.795=0.195
max5136.389-5136.304=0.086
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean8.943-9.614=-0.671
σ0.548-0.437=0.112
min8.340-9.151=-0.811
max9.714-10.168=-0.454
iters=5
new-facts=6402
prior-facts=6402
mean5238.368-5238.373=-0.004
σ0.081-0.087=-0.006
min5238.292-5238.309=-0.016
max5238.466-5238.468=-0.002
mean3232.400-3271.800=-39.400
σ388.905-439.195=-50.290
min2710.000-2779.000=-69.000
max3602.000-3846.000=-244.000
mean9.187-8.915=0.272
σ0.275-0.192=0.083
min8.861-8.706=0.155
max9.551-9.128=0.423

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.008=0.060
σ0.130-0.127=0.003
min0.950-0.942=0.008
max1.268-1.236=0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.468-467.461=0.008
σ572.659-572.649=0.010
min181.129-181.125=0.003
max1326.457-1326.434=0.023
mean85.500
σ7.000
min82.000
max96.000
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean0.574-0.448=0.125
σ0.567-0.298=0.269
min0.279-0.298=-0.019
max1.424-0.896=0.528
policies=20
mean1811.639-1811.654=-0.015
σ0.387-0.374=0.013
min1811.372-1811.366=0.006
max1812.210-1812.183=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean2.869-2.956=-0.087
σ0.026-0.094=-0.068
min2.836-2.868=-0.032
max2.894-3.090=-0.196
policies=200
mean18123.290-18123.135=0.156
σ0.597-0.564=0.033
min18122.749-18122.717=0.032
max18124.143-18123.964=0.179
mean8200.000
σ0.000
min8200.000
max8200.000
mean2710.000-2779.000=-69.000
σ0.000
min2710.000-2779.000=-69.000
max2710.000-2779.000=-69.000
mean28.958-28.889=0.069
σ0.268-0.144=0.124
min28.703-28.719=-0.016
max29.304-29.013=0.291