Compare commits

Home / Compare 3f1cff30 .. 8175cff7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-54.039=-0.075
σ0.369-0.369=-0.001
min53.825-53.897=-0.072
max55.013-55.089=-0.076
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.139-0.137=0.002
σ0.004-0.005=-0.001
min0.135-0.130=0.005
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.342=-0.020
σ0.006-0.007=-0.000
min43.311-43.330=-0.019
max43.335-43.353=-0.018
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.123-0.122=0.001
σ0.004-0.004=0.001
min0.119-0.119=0.000
max0.130-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1017.203=-10.686
σ1.153-1.177=-0.024
min1005.950-1016.628=-10.678
max1011.333-1022.138=-10.805
mean1049.600-1058.550=-8.950
σ310.503-313.580=-3.077
min555.000-563.000=-8.000
max1520.000-1519.000=1.000
mean1.529-1.547=-0.017
σ0.061-0.061=-0.001
min1.394-1.472=-0.078
max1.666-1.652=0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.424
σ0.138
min0.334
max0.667
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.881
σ0.092
min0.821
max1.042
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.535
σ0.050
min0.493
max0.621
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.849
σ0.047
min0.820
max0.931

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831
σ0.039
min964.807
max964.900
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.838
σ0.034
min0.791
max0.874
name=cdr_enhanced_4k_loc.art
mean885.510
σ0.005
min885.504
max885.517
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.677
σ0.043
min0.629
max0.726

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.721
mean1520.000
σ0.000
min1520.000
max1520.000
mean3.566
σ0.083
min3.408
max3.972
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1520.000
σ0.000
min1520.000
max1520.000
mean3.564
σ0.079
min3.384
max3.819
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.739
σ0.018
min0.704
max0.839
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1520.000
σ0.000
min1520.000
max1520.000
mean0.696
σ0.015
min0.664
max0.773

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.383-301.940=-5.557
σ0.177-0.197=-0.020
min296.168-301.796=-5.627
max296.727-302.484=-5.756
mean1915.000-2035.000=-120.000
σ0.000
min1915.000-2035.000=-120.000
max1915.000-2035.000=-120.000
mean0.584-0.599=-0.015
σ0.054-0.008=0.046
min0.510-0.580=-0.069
max0.708-0.607=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-303.797=-18.765
σ0.037-0.043=-0.006
min284.981-303.739=-18.758
max285.070-303.848=-18.778
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean0.397-0.390=0.008
σ0.006-0.002=0.005
min0.388-0.387=0.001
max0.404-0.391=0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.415-1326.327=-30.912
σ0.105-0.104=0.001
min1295.287-1326.202=-30.915
max1295.550-1326.449=-30.899
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean1.961-1.960=0.000
σ0.142-0.138=0.003
min1.834-1.823=0.011
max2.159-2.134=0.025
iters=5
new-facts=6402
prior-facts=1
mean1539.505-1564.407=-24.901
σ6.838-6.897=-0.060
min1536.248-1561.101=-24.853
max1551.733-1576.741=-25.008
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean2.223-2.382=-0.159
σ0.131-0.319=-0.187
min2.088-2.029=0.059
max2.375-2.702=-0.327
iters=5
new-facts=6402
prior-facts=6402
mean1857.311-1894.279=-36.968
σ0.062-0.076=-0.014
min1857.263-1894.146=-36.882
max1857.404-1894.320=-36.917
mean1749.600-1734.600=15.000
σ172.034-212.581=-40.547
min1520.000-1519.000=1.000
max1915.000-2035.000=-120.000
mean3.044-2.933=0.110
σ0.266-0.112=0.154
min2.838-2.873=-0.035
max3.507-3.132=0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.558-1.615=-0.057
σ0.388-0.138=0.250
min1.038-1.400=-0.363
max1.948-1.754=0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.195-448.047=0.149
σ581.341-581.224=0.117
min157.524-157.431=0.093
max1320.206-1319.882=0.324
mean96.250
σ8.500
min92.000
max109.000
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean0.541-0.562=-0.020
σ0.556-0.585=-0.029
min0.262-0.267=-0.005
max1.375-1.439=-0.064
policies=20
mean1575.575-1574.588=0.987
σ0.365-0.337=0.028
min1575.329-1574.362=0.967
max1576.118-1575.090=1.028
mean920.000
σ0.000
min920.000
max920.000
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean2.648-2.614=0.034
σ0.016-0.023=-0.007
min2.632-2.583=0.049
max2.669-2.639=0.030
policies=200
mean15763.680-15753.965=9.715
σ0.023-0.169=-0.147
min15763.658-15753.807=9.851
max15763.712-15754.204=9.508
mean9200.000
σ0.000
min9200.000
max9200.000
mean1520.000-1519.000=1.000
σ0.000
min1520.000-1519.000=1.000
max1520.000-1519.000=1.000
mean26.572-26.565=0.007
σ0.013-0.115=-0.103
min26.560-26.437=0.122
max26.586-26.679=-0.093