Compare commits

Home / Compare 5c4d09b1 .. a5c405e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-53.823=0.193
σ0.369-0.368=0.001
min53.876-53.678=0.198
max55.065-54.868=0.197
mean416.900-419.000=-2.100
σ0.316-0.000=0.316
min416.000-419.000=-3.000
max417.000-419.000=-2.000
mean0.140-0.140=-0.000
σ0.004-0.004=0.000
min0.133-0.137=-0.004
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.209=0.113
σ0.006-0.006=0.001
min43.314-43.200=0.114
max43.337-43.218=0.119
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.120-0.122=-0.003
σ0.003-0.004=-0.001
min0.115-0.119=-0.003
max0.124-0.130=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1016.175=-9.865
σ1.162-1.177=-0.014
min1005.741-1015.633=-9.892
max1011.177-1021.102=-9.925
mean1044.400-1049.250=-4.850
σ312.550-297.244=15.307
min577.000-590.000=-13.000
max1634.000-1467.000=167.000
mean1.564-1.566=-0.003
σ0.094-0.059=0.036
min1.473-1.494=-0.022
max1.833-1.678=0.155

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.408
σ0.136
min0.327
max0.649
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.890
σ0.088
min0.838
max1.047
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.544
σ0.054
min0.512
max0.639
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.850
σ0.039
min0.825
max0.919

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115
σ0.035
min964.086
max964.173
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.832
σ0.043
min0.765
max0.867
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.008
min884.703
max884.723
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.683
σ0.073
min0.595
max0.742

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1634.000
σ0.000
min1634.000
max1634.000
mean4.261
σ0.102
min4.103
max4.732
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1634.000
σ0.000
min1634.000
max1634.000
mean4.211
σ0.086
min4.065
max4.467
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.742
σ0.020
min0.719
max0.895
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.705
σ0.016
min0.671
max0.791

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-301.172=-4.848
σ0.165-0.174=-0.009
min296.191-301.011=-4.820
max296.751-301.624=-4.872
mean1899.000-2022.000=-123.000
σ0.000
min1899.000-2022.000=-123.000
max1899.000-2022.000=-123.000
mean0.603-0.547=0.056
σ0.016-0.032=-0.016
min0.574-0.498=0.076
max0.635-0.580=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-300.695=-16.001
σ0.038-0.032=0.006
min284.640-300.645=-16.005
max284.732-300.726=-15.995
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean0.398-0.399=-0.002
σ0.009-0.007=0.002
min0.389-0.391=-0.002
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1322.874=-27.803
σ0.107-0.095=0.013
min1294.946-1322.817=-27.871
max1295.213-1323.038=-27.825
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean2.008-1.927=0.081
σ0.122-0.115=0.007
min1.833-1.832=0.001
max2.168-2.061=0.106
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1561.392=-22.186
σ6.839-6.824=0.014
min1535.958-1558.158=-22.200
max1551.437-1573.597=-22.161
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean2.155-2.431=-0.277
σ0.139-0.366=-0.227
min2.043-1.921=0.123
max2.391-2.840=-0.450
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1890.781=-33.801
σ0.052-0.020=0.033
min1856.936-1890.756=-33.820
max1857.058-1890.806=-33.748
mean1779.600-1718.800=60.800
σ125.532-222.985=-97.453
min1634.000-1467.000=167.000
max1899.000-2022.000=-123.000
mean2.987-2.894=0.092
σ0.099-0.111=-0.012
min2.832-2.745=0.088
max3.107-3.057=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.551=-0.327
σ0.212-0.217=-0.005
min0.954-1.198=-0.244
max1.511-1.734=-0.223

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-443.040=4.746
σ581.213-573.403=7.809
min157.179-156.336=0.842
max1319.604-1303.145=16.460
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean0.543-0.545=-0.002
σ0.566-0.569=-0.002
min0.254-0.258=-0.004
max1.393-1.398=-0.006
policies=20
mean1572.103-1563.643=8.461
σ0.355-0.337=0.017
min1571.863-1563.427=8.436
max1572.630-1564.146=8.484
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean2.631-2.627=0.004
σ0.009-0.015=-0.006
min2.622-2.615=0.008
max2.639-2.649=-0.010
policies=200
mean15729.033-15644.310=84.724
σ0.047-0.070=-0.023
min15728.976-15644.207=84.769
max15729.077-15644.360=84.716
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1467.000=167.000
σ0.000
min1634.000-1467.000=167.000
max1634.000-1467.000=167.000
mean26.501-26.544=-0.043
σ0.032-0.155=-0.124
min26.459-26.362=0.096
max26.535-26.740=-0.206