Compare commits

Home / Compare 7d6f831b .. b54453eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-53.972=0.042
σ0.371-0.370=0.001
min53.876-53.833=0.043
max55.070-55.024=0.045
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.137-0.136=0.001
σ0.005-0.005=0.000
min0.130-0.129=0.000
max0.144-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.339=-0.017
σ0.005-0.006=-0.000
min43.315-43.332=-0.017
max43.331-43.350=-0.019
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.122-0.118=0.004
σ0.004-0.004=-0.000
min0.119-0.114=0.005
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.303-1016.892=-10.590
σ1.216-1.165=0.051
min1005.776-1016.325=-10.549
max1011.406-1021.776=-10.370
mean1045.400-1062.150=-16.750
σ313.961-311.622=2.339
min595.000-598.000=-3.000
max1644.000-1634.000=10.000
mean1.575-1.528=0.047
σ0.117-0.054=0.063
min1.472-1.450=0.023
max1.957-1.661=0.296

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.405
σ0.136
min0.317
max0.645
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.890
σ0.091
min0.828
max1.048
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.555
σ0.045
min0.518
max0.632
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.851
σ0.044
min0.810
max0.924

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.027
min964.093
max964.159
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.806
σ0.037
min0.778
max0.859
name=cdr_enhanced_4k_loc.art
mean884.712
σ0.006
min884.705
max884.721
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.726
σ0.024
min0.684
max0.743

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.293
σ0.105
min4.104
max4.708
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.667
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.277
σ0.096
min4.130
max4.555
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.713
σ0.025
min0.673
max0.850
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.701
σ0.016
min0.670
max0.784

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.337-301.907=-5.570
σ0.208-0.252=-0.043
min296.169-301.738=-5.569
max296.884-302.596=-5.712
mean1916.000-2041.000=-125.000
σ0.000
min1916.000-2041.000=-125.000
max1916.000-2041.000=-125.000
mean0.576-0.591=-0.015
σ0.055-0.014=0.041
min0.507-0.558=-0.050
max0.702-0.603=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.641-303.498=-18.856
σ0.064-0.038=0.026
min284.571-303.459=-18.888
max284.719-303.554=-18.835
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.398-0.394=0.004
σ0.009-0.008=0.001
min0.388-0.389=-0.001
max0.406-0.407=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1326.063=-30.986
σ0.110-0.098=0.012
min1294.971-1325.987=-31.016
max1295.265-1326.226=-30.962
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean1.919-1.903=0.016
σ0.125-0.112=0.013
min1.804-1.813=-0.008
max2.105-2.092=0.013
iters=5
new-facts=6402
prior-facts=1
mean1539.279-1564.189=-24.910
σ6.803-6.906=-0.103
min1536.054-1560.851=-24.797
max1551.445-1576.538=-25.093
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean2.335-2.358=-0.023
σ0.211-0.293=-0.082
min2.147-2.053=0.094
max2.585-2.683=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1894.005=-37.026
σ0.066-0.061=0.005
min1856.920-1893.945=-37.025
max1857.079-1894.081=-37.002
mean1774.600-1774.800=-0.200
σ136.535-172.261=-35.726
min1644.000-1634.000=10.000
max1916.000-2041.000=-125.000
mean3.069-3.023=0.046
σ0.410-0.201=0.209
min2.733-2.871=-0.137
max3.768-3.317=0.451

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.243=-0.063
σ0.234-0.314=-0.080
min0.950-1.044=-0.094
max1.548-1.787=-0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.241-445.164=3.077
σ581.217-575.153=6.064
min157.627-157.583=0.044
max1320.067-1307.894=12.173
mean98.250
σ8.500
min94.000
max111.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean0.547-0.563=-0.016
σ0.559-0.594=-0.035
min0.266-0.263=0.003
max1.385-1.454=-0.069
policies=20
mean1576.639-1576.132=0.506
σ0.360-0.348=0.012
min1576.394-1575.904=0.490
max1577.173-1576.650=0.523
mean940.000
σ0.000
min940.000
max940.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean2.647-2.638=0.009
σ0.019-0.015=0.003
min2.626-2.622=0.004
max2.670-2.656=0.014
policies=200
mean15774.681-15769.303=5.379
σ0.079-0.048=0.031
min15774.573-15769.252=5.321
max15774.757-15769.369=5.389
mean9400.000
σ0.000
min9400.000
max9400.000
mean1644.000-1634.000=10.000
σ0.000
min1644.000-1634.000=10.000
max1644.000-1634.000=10.000
mean26.695-26.610=0.085
σ0.048-0.133=-0.086
min26.631-26.472=0.159
max26.732-26.744=-0.012