Compare commits

Home / Compare 10fc80c4 .. c7f9bbc3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-36.720=-0.754
σ0.103-0.801=-0.698
min35.923-35.919=0.004
max36.259-38.437=-2.179
mean413.000-3992.000=-3579.000
σ0.000
min413.000-3992.000=-3579.000
max413.000-3992.000=-3579.000
mean0.078-0.075=0.003
σ0.005-0.001=0.004
min0.074-0.074=0.001
max0.085-0.076=0.009
cache=y
dps=1
iters=10
policies=100
mean26.209-26.712=-0.503
σ0.005-0.644=-0.639
min26.202-26.210=-0.008
max26.219-27.463=-1.244
mean413.000-3992.000=-3579.000
σ0.000
min413.000-3992.000=-3579.000
max413.000-3992.000=-3579.000
mean0.061-0.060=0.001
σ0.003-0.001=0.002
min0.059-0.060=-0.000
max0.070-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.366=-0.051
σ0.368-0.374=-0.007
min1755.741-1755.797=-0.056
max1756.909-1756.965=-0.056
mean1658.100-1656.750=1.350
σ632.614-630.043=2.571
min612.000-680.000=-68.000
max2731.000-2611.000=120.000
mean2.375-2.282=0.092
σ0.135-0.151=-0.016
min2.259-2.148=0.111
max2.823-2.788=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.844-278.696=0.148
σ0.010-0.014=-0.004
min278.832-278.684=0.147
max278.857-278.719=0.138
mean2731.000-2611.000=120.000
σ0.000
min2731.000-2611.000=120.000
max2731.000-2611.000=120.000
mean0.409-0.426=-0.017
σ0.001-0.013=-0.012
min0.407-0.416=-0.008
max0.410-0.442=-0.031
iters=5
new-facts=1
prior-facts=6402
mean2268.900-2268.873=0.027
σ0.019-0.005=0.014
min2268.873-2268.868=0.004
max2268.922-2268.881=0.041
mean2731.000-2611.000=120.000
σ0.000
min2731.000-2611.000=120.000
max2731.000-2611.000=120.000
mean3.207-2.948=0.260
σ0.168-0.117=0.051
min2.919-2.864=0.055
max3.352-3.151=0.201
iters=5
new-facts=6402
prior-facts=1
mean4954.042-4952.363=1.679
σ1.057-0.992=0.065
min4953.240-4951.723=1.518
max4955.826-4954.125=1.700
mean2731.000-2611.000=120.000
σ0.000
min2731.000-2611.000=120.000
max2731.000-2611.000=120.000
mean8.046-8.342=-0.297
σ0.392-0.677=-0.285
min7.794-7.810=-0.016
max8.739-9.527=-0.788
iters=5
new-facts=6402
prior-facts=6402
mean5168.748-5167.074=1.673
σ0.210-0.014=0.196
min5168.403-5167.066=1.337
max5168.935-5167.099=1.836
mean3365.400-3422.800=-57.400
σ410.562-454.531=-43.970
min2965.000-2809.000=156.000
max3785.000-3992.000=-207.000
mean9.201-9.234=-0.033
σ0.568-0.255=0.313
min8.540-8.985=-0.445
max9.813-9.615=0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.064=-0.064
σ0.067-0.122=-0.055
min0.943-0.951=-0.008
max1.073-1.252=-0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.258=0.100
σ572.652-572.607=0.044
min174.024-173.953=0.071
max1319.335-1319.169=0.166
mean79.500
σ7.000
min76.000
max90.000
mean2731.000-435.000=2296.000
σ0.000
min2731.000-435.000=2296.000
max2731.000-435.000=2296.000
mean0.552-0.552=-0.000
σ0.556-0.560=-0.004
min0.268-0.267=0.001
max1.386-1.392=-0.006
policies=20
mean1740.490-1740.033=0.458
σ0.322-0.331=-0.010
min1740.295-1739.793=0.502
max1740.971-1740.519=0.452
mean760.000
σ0.000
min760.000
max760.000
mean2731.000-445.000=2286.000
σ0.000-9.381=-9.381
min2731.000-435.000=2296.000
max2731.000-453.000=2278.000
mean2.691-2.664=0.026
σ0.011-0.012=-0.001
min2.676-2.647=0.029
max2.702-2.675=0.027
policies=200
mean17411.897-17409.816=2.082
σ0.536-0.105=0.431
min17411.546-17409.659=1.887
max17412.694-17409.878=2.815
mean7600.000
σ0.000
min7600.000
max7600.000
mean2731.000-489.750=2241.250
σ0.000-2.754=-2.754
min2731.000-487.000=2244.000
max2731.000-493.000=2238.000
mean27.063-26.978=0.084
σ0.075-0.173=-0.099
min26.997-26.776=0.221
max27.170-27.198=-0.028