Compare commits

Home / Compare 910249c9 .. a66f3780

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.001
σ0.046-0.045=0.002
min70.669-70.674=-0.005
max70.831-70.827=0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.160-0.159=0.001
σ0.004-0.003=0.001
min0.152-0.155=-0.003
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.001
σ0.003-0.002=0.001
min21.403-21.404=-0.001
max21.412-21.411=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.064-0.065=-0.002
σ0.003-0.002=0.001
min0.058-0.063=-0.005
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.000
σ0.360-0.361=-0.001
min1754.366-1754.357=0.009
max1755.524-1755.513=0.011
mean1659.800-1648.500=11.300
σ616.289-632.479=-16.190
min624.000-625.000=-1.000
max2495.000-2774.000=-279.000
mean2.777-2.814=-0.037
σ0.230-0.208=0.022
min2.187-2.136=0.051
max2.988-3.124=-0.137

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean4.112
σ0.000
min4.112
max4.112
mean2495.000
σ0.000
min2495.000
max2495.000
mean2.933
σ0.000
min2.933
max2.933
name=error_case.art
mean11.569
σ0.000
min11.569
max11.569
mean2495.000
σ0.000
min2495.000
max2495.000
mean6.587
σ0.000
min6.587
max6.587
name=heavy_item.art
mean7.531
σ0.000
min7.531
max7.531
mean2495.000
σ0.000
min2495.000
max2495.000
mean3.969
σ0.000
min3.969
max3.969
name=nested_use.art
mean11.692
σ0.000
min11.692
max11.692
mean2495.000
σ0.000
min2495.000
max2495.000
mean6.826
σ0.000
min6.826
max6.826

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4762.697
σ0.000
min4762.697
max4762.697
mean2495.000
σ0.000
min2495.000
max2495.000
mean4.162
σ0.000
min4.162
max4.162
name=cdr_enhanced_4k_loc.art
mean4383.234
σ0.000
min4383.234
max4383.234
mean2495.000
σ0.000
min2495.000
max2495.000
mean3.433
σ0.000
min3.433
max3.433

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean764.885
σ0.000
min764.885
max764.885
mean2495.000
σ0.000
min2495.000
max2495.000
mean575.125
σ0.000
min575.125
max575.125
name=record_render_large_syntax_err.art
mean759.827
σ0.000
min759.827
max759.827
mean2495.000
σ0.000
min2495.000
max2495.000
mean575.965
σ0.000
min575.965
max575.965
name=record_render_success.art
mean225.699
σ0.000
min225.699
max225.699
mean2495.000
σ0.000
min2495.000
max2495.000
mean134.879
σ0.000
min134.879
max134.879
name=record_render_syntax_err.art
mean213.252
σ0.000
min213.252
max213.252
mean2495.000
σ0.000
min2495.000
max2495.000
mean137.356
σ0.000
min137.356
max137.356

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.788-272.794=-0.006
σ0.008-0.006=0.002
min272.774-272.786=-0.012
max272.796-272.802=-0.006
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean0.379-0.377=0.001
σ0.001-0.003=-0.001
min0.376-0.374=0.003
max0.380-0.381=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.220-1933.226=-0.006
σ0.006-0.006=0.000
min1933.209-1933.218=-0.009
max1933.226-1933.234=-0.008
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean3.003-3.099=-0.097
σ0.121-0.102=0.020
min2.849-3.017=-0.168
max3.186-3.238=-0.052
iters=5
new-facts=6402
prior-facts=1
mean4756.970-4756.938=0.033
σ7.594-7.601=-0.007
min4753.497-4753.507=-0.010
max4770.554-4770.535=0.019
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean8.499-8.502=-0.003
σ0.423-0.246=0.177
min7.870-8.095=-0.225
max8.876-8.739=0.136
iters=5
new-facts=6402
prior-facts=6402
mean4944.308-4944.456=-0.148
σ0.312-0.009=0.303
min4943.750-4944.443=-0.693
max4944.462-4944.468=-0.006
mean2930.200-3049.000=-118.800
σ383.960-266.364=117.595
min2495.000-2774.000=-279.000
max3419.000
mean8.445-8.729=-0.284
σ0.102-0.352=-0.250
min8.333-8.404=-0.071
max8.602-9.226=-0.624

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.539-1.031=0.508
σ0.218-0.126=0.092
min1.201-0.916=0.285
max1.766-1.222=0.544

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.301-468.314=-0.013
σ574.224-574.227=-0.003
min181.187-181.192=-0.005
max1329.636-1329.655=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean0.552-0.442=0.111
σ0.540-0.302=0.237
min0.280-0.288=-0.008
max1.362-0.895=0.467
policies=20
mean1812.168-1812.220=-0.052
σ0.394-0.385=0.009
min1811.901-1811.952=-0.051
max1812.749-1812.785=-0.036
mean840.000
σ0.000
min840.000
max840.000
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean2.822-2.875=-0.053
σ0.048-0.019=0.029
min2.784-2.852=-0.068
max2.891-2.897=-0.006
policies=200
mean18128.916-18129.025=-0.109
σ0.352-0.501=-0.149
min18128.704-18128.720=-0.016
max18129.443-18129.775=-0.332
mean8400.000
σ0.000
min8400.000
max8400.000
mean2495.000-2774.000=-279.000
σ0.000
min2495.000-2774.000=-279.000
max2495.000-2774.000=-279.000
mean28.342-28.356=-0.014
σ0.126-0.287=-0.161
min28.212-28.147=0.065
max28.487-28.755=-0.268