Compare commits

Home / Compare 724ef584 .. 124e46f5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.966=0.000
σ0.103-0.103=0.001
min35.923-35.922=0.001
max36.259-36.256=0.002
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.078-0.075=0.003
σ0.005-0.005=-0.000
min0.074-0.071=0.004
max0.085-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=0.001
σ0.005-0.004=0.001
min26.202-26.204=-0.002
max26.219-26.216=0.003
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.312=0.003
σ0.368-0.367=0.001
min1755.741-1755.738=0.003
max1756.909-1756.909=0.000
mean1658.100-1661.400=-3.300
σ632.614-637.290=-4.676
min612.000-615.000=-3.000
max2731.000-2695.000=36.000
mean2.375-2.381=-0.007
σ0.135-0.168=-0.032
min2.259-2.212=0.047
max2.823-3.011=-0.187

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.844-278.841=0.003
σ0.010-0.010=-0.000
min278.832-278.826=0.006
max278.857-278.852=0.004
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean0.409-0.415=-0.006
σ0.001-0.014=-0.012
min0.407-0.406=0.001
max0.410-0.439=-0.028
iters=5
new-facts=1
prior-facts=6402
mean2268.900-2268.899=0.001
σ0.019-0.014=0.005
min2268.873-2268.876=-0.004
max2268.922-2268.913=0.009
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean3.207-2.911=0.297
σ0.168-0.141=0.027
min2.919-2.742=0.176
max3.352-3.132=0.220
iters=5
new-facts=6402
prior-facts=1
mean4954.042-4954.252=-0.210
σ1.057-0.919=0.138
min4953.240-4953.743=-0.502
max4955.826-4955.889=-0.063
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean8.046-8.157=-0.112
σ0.392-0.515=-0.122
min7.794-7.804=-0.010
max8.739-9.011=-0.272
iters=5
new-facts=6402
prior-facts=6402
mean5168.748-5168.747=0.000
σ0.210-0.124=0.087
min5168.403-5168.557=-0.154
max5168.935-5168.903=0.032
mean3365.400-3398.400=-33.000
σ410.562-491.711=-81.150
min2965.000-2807.000=158.000
max3785.000-4072.000=-287.000
mean9.201-9.297=-0.096
σ0.568-0.267=0.300
min8.540-9.028=-0.488
max9.813-9.616=0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.184=-0.184
σ0.067-0.375=-0.308
min0.943-0.952=-0.009
max1.073-1.847=-0.774

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.359=-0.001
σ572.652-572.651=0.000
min174.024-174.026=-0.002
max1319.335-1319.335=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean0.552-0.556=-0.005
σ0.556-0.577=-0.021
min0.268-0.262=0.006
max1.386-1.422=-0.037
policies=20
mean1740.490-1740.484=0.007
σ0.322-0.323=-0.001
min1740.295-1740.280=0.015
max1740.971-1740.965=0.006
mean760.000
σ0.000
min760.000
max760.000
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean2.691-2.689=0.002
σ0.011-0.011=0.001
min2.676-2.674=0.002
max2.702-2.701=0.001
policies=200
mean17411.897-17411.842=0.056
σ0.536-0.444=0.092
min17411.546-17411.474=0.072
max17412.694-17412.487=0.207
mean7600.000
σ0.000
min7600.000
max7600.000
mean2731.000-2695.000=36.000
σ0.000
min2731.000-2695.000=36.000
max2731.000-2695.000=36.000
mean27.063-27.015=0.048
σ0.075-0.088=-0.014
min26.997-26.938=0.060
max27.170-27.139=0.031