Compare commits

Home / Compare c3a395f0 .. 7b296f8c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.002
σ0.046-0.046=-0.000
min70.671-70.668=0.003
max70.830-70.829=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.162-0.160=0.002
σ0.004-0.005=-0.001
min0.157-0.153=0.004
max0.169-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.004-0.002=0.002
min21.403-21.406=-0.003
max21.416-21.411=0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.065=0.001
σ0.002-0.003=-0.001
min0.064-0.061=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.930=0.000
σ0.361-0.361=-0.001
min1754.364-1754.365=-0.001
max1755.513-1755.512=0.000
mean1648.300
σ624.965-634.069=-9.103
min618.000-625.000=-7.000
max2770.000-2851.000=-81.000
mean2.848-2.870=-0.022
σ0.237-0.108=0.129
min2.199-2.495=-0.296
max3.424-3.017=0.407

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.815
σ0.000
min3.815
max3.815
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean1.095-1.164=-0.069
σ0.000
min1.095-1.164=-0.069
max1.095-1.164=-0.069
name=error_case.art
mean10.998
σ0.000
min10.998
max10.998
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean5.432-6.436=-1.004
σ0.000
min5.432-6.436=-1.004
max5.432-6.436=-1.004
name=heavy_item.art
mean7.436-7.432=0.004
σ0.000
min7.436-7.432=0.004
max7.436-7.432=0.004
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean3.265-3.548=-0.282
σ0.000
min3.265-3.548=-0.282
max3.265-3.548=-0.282
name=nested_use.art
mean11.073
σ0.000
min11.073
max11.073
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean5.404-6.210=-0.806
σ0.000
min5.404-6.210=-0.806
max5.404-6.210=-0.806

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4668.628-4668.658=-0.030
σ0.000
min4668.628-4668.658=-0.030
max4668.628-4668.658=-0.030
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean2.896-3.769=-0.873
σ0.000
min2.896-3.769=-0.873
max2.896-3.769=-0.873
name=cdr_enhanced_4k_loc.art
mean4303.827-4303.786=0.041
σ0.000
min4303.827-4303.786=0.041
max4303.827-4303.786=0.041
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean2.517-3.306=-0.789
σ0.000
min2.517-3.306=-0.789
max2.517-3.306=-0.789

Parser: Record Parsing wip

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean752.162
σ0.000
min752.162
max752.162
mean2770.000
σ0.000
min2770.000
max2770.000
mean440.279
σ0.000
min440.279
max440.279
name=record_render_large_syntax_err.art
mean747.273
σ0.000
min747.273
max747.273
mean2770.000
σ0.000
min2770.000
max2770.000
mean433.122
σ0.000
min433.122
max433.122
name=record_render_success.art
mean222.482
σ0.000
min222.482
max222.482
mean2770.000
σ0.000
min2770.000
max2770.000
mean120.252
σ0.000
min120.252
max120.252
name=record_render_syntax_err.art
mean210.255
σ0.000
min210.255
max210.255
mean2770.000
σ0.000
min2770.000
max2770.000
mean114.008
σ0.000
min114.008
max114.008
name=record_sets_success.art
mean60.846
σ0.000
min60.846
max60.846
mean2770.000
σ0.000
min2770.000
max2770.000
mean34.277
σ0.000
min34.277
max34.277
name=record_sets_syntax_err.art
mean60.779
σ0.000
min60.779
max60.779
mean2770.000
σ0.000
min2770.000
max2770.000
mean34.155
σ0.000
min34.155
max34.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.759=-0.002
σ0.006-0.006=-0.000
min272.750-272.751=-0.001
max272.763-272.767=-0.004
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean0.382-0.377=0.005
σ0.001-0.001=0.000
min0.381-0.376=0.005
max0.383-0.378=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.173-1933.165=0.008
σ0.009-0.010=-0.001
min1933.162-1933.155=0.007
max1933.186-1933.179=0.007
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean3.045-3.079=-0.035
σ0.173-0.041=0.132
min2.740-3.039=-0.299
max3.170-3.127=0.043
iters=5
new-facts=6402
prior-facts=1
mean4756.916-4756.925=-0.009
σ7.593-7.630=-0.036
min4753.470-4753.425=0.045
max4770.499-4770.573=-0.073
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean8.555-8.591=-0.036
σ0.364-0.373=-0.009
min7.936-8.031=-0.096
max8.891-8.968=-0.078
iters=5
new-facts=6402
prior-facts=6402
mean4944.393-4944.316=0.077
σ0.018-0.169=-0.151
min4944.369-4944.015=0.355
max4944.416-4944.406=0.010
mean3018.600-3054.000=-35.400
σ288.205-259.846=28.359
min2770.000-2851.000=-81.000
max3429.000-3451.000=-22.000
mean8.577-8.493=0.084
σ0.123-0.139=-0.017
min8.452-8.367=0.085
max8.707-8.688=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.991-1.109=-0.118
σ0.140-0.208=-0.068
min0.925-0.916=0.010
max1.241-1.338=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.318=0.003
σ574.264-574.259=0.005
min181.186-181.184=0.002
max1329.718-1329.706=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean0.575-0.441=0.134
σ0.576-0.294=0.282
min0.282-0.292=-0.010
max1.439-0.881=0.558
policies=20
mean1812.177-1812.182=-0.005
σ0.400-0.411=-0.011
min1811.906-1811.893=0.013
max1812.767-1812.785=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean2.831-2.882=-0.051
σ0.013-0.011=0.002
min2.815-2.870=-0.055
max2.848-2.896=-0.048
policies=200
mean18128.894-18129.054=-0.160
σ0.592-0.472=0.120
min18128.454-18128.698=-0.244
max18129.764-18129.749=0.015
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean28.441-28.493=-0.053
σ0.164-0.341=-0.177
min28.221-28.252=-0.030
max28.617-28.986=-0.369