Compare commits

Home / Compare 48dc68fc .. d3760426

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-35.965=-4.925
σ0.049-0.103=-0.053
min30.998-35.923=-4.925
max31.176-36.256=-5.080
mean412.900-414.000=-1.100
σ0.316-0.000=0.316
min412.000-414.000=-2.000
max413.000-414.000=-1.000
mean0.079-0.076=0.003
σ0.003-0.005=-0.002
min0.077-0.071=0.006
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-26.208=-5.064
σ0.003-0.003=-0.000
min21.137-26.203=-5.065
max21.148-26.212=-5.064
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.058=0.006
σ0.003-0.002=0.000
min0.060-0.056=0.004
max0.071-0.064=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1756.307=-4.896
σ0.361-0.369=-0.008
min1750.846-1755.731=-4.886
max1751.977-1756.899=-4.923
mean1656.100-1675.600=-19.500
σ646.658-633.365=13.292
min633.000-682.000=-49.000
max2859.000-2683.000=176.000
mean2.763-2.320=0.443
σ0.177-0.067=0.110
min2.304-2.242=0.062
max3.028-2.440=0.588

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-278.829=-12.049
σ0.009-0.005=0.003
min266.771-278.824=-12.053
max266.793-278.838=-12.045
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean0.365-0.411=-0.046
σ0.001-0.005=-0.004
min0.364-0.408=-0.044
max0.367-0.419=-0.052
iters=5
new-facts=1
prior-facts=6402
mean1927.208-2268.884=-341.676
σ0.011-0.006=0.006
min1927.193-2268.874=-341.681
max1927.222-2268.891=-341.668
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean3.015-2.925=0.090
σ0.097-0.090=0.007
min2.924-2.856=0.068
max3.163-3.083=0.080
iters=5
new-facts=6402
prior-facts=1
mean4747.722-4954.246=-206.525
σ0.807-0.848=-0.042
min4747.295-4953.729=-206.434
max4749.161-4955.753=-206.592
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean8.363-8.012=0.351
σ0.663-0.333=0.330
min7.693-7.742=-0.049
max9.194-8.493=0.701
iters=5
new-facts=6402
prior-facts=6402
mean4938.162-5168.725=-230.563
σ0.081-0.203=-0.122
min4938.094-5168.386=-230.292
max4938.252-5168.885=-230.632
mean3088.600-3430.200=-341.600
σ308.840-463.168=-154.327
min2859.000-2803.000=56.000
max3570.000-4016.000=-446.000
mean8.366-9.463=-1.097
σ0.139-0.166=-0.027
min8.211-9.256=-1.044
max8.592-9.615=-1.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.064=-0.018
σ0.189-0.184=0.005
min0.931-0.945=-0.015
max1.369-1.380=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.120-460.351=4.769
σ575.753-572.654=3.100
min177.236-174.023=3.213
max1328.750-1319.331=9.419
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean0.438-0.555=-0.117
σ0.305-0.571=-0.266
min0.285-0.267=0.017
max0.896-1.411=-0.515
policies=20
mean1772.626-1740.450=32.176
σ0.328-0.309=0.019
min1772.399-1740.251=32.148
max1773.110-1740.912=32.198
mean760.000
σ0.000
min760.000
max760.000
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean2.831-2.679=0.152
σ0.011-0.011=0.000
min2.823-2.668=0.155
max2.845-2.692=0.153
policies=200
mean17732.535-17411.500=321.035
σ0.476-0.458=0.018
min17732.159-17411.224=320.935
max17733.227-17412.186=321.041
mean7600.000
σ0.000
min7600.000
max7600.000
mean2859.000-2683.000=176.000
σ0.000
min2859.000-2683.000=176.000
max2859.000-2683.000=176.000
mean28.156-26.936=1.220
σ0.410-0.036=0.374
min27.773-26.897=0.876
max28.665-26.982=1.683