Compare commits

Home / Compare 9b2d658c .. 9afbaa5b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.038=-0.024
σ0.368-0.368=0.000
min53.871-53.902=-0.031
max55.062-55.085=-0.023
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.138-0.138=-0.000
σ0.006-0.005=0.000
min0.130-0.132=-0.002
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.321-43.342=-0.020
σ0.008-0.007=0.001
min43.315-43.333=-0.018
max43.341-43.358=-0.017
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.118-0.120=-0.002
σ0.002-0.004=-0.002
min0.115-0.115=0.000
max0.121-0.129=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1017.204=-10.897
σ1.179-1.165=0.014
min1005.768-1016.628=-10.860
max1011.248-1022.086=-10.838
mean1051.400-1052.850=-1.450
σ306.992-318.942=-11.950
min584.000-578.000=6.000
max1642.000-1620.000=22.000
mean1.566-1.553=0.013
σ0.087-0.086=0.001
min1.484-1.418=0.066
max1.787-1.762=0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.419
σ0.152
min0.323
max0.688
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.933
σ0.154
min0.831
max1.202
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.548
σ0.046
min0.514
max0.624
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.837
σ0.037
min0.809
max0.897

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.035
min964.086
max964.171
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.795
σ0.065
min0.684
max0.845
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.001
min884.712
max884.715
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.733
σ0.021
min0.695
max0.747

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.500
σ0.087
min3.369
max3.833
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.667
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.465
σ0.066
min3.344
max3.668
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.719
σ0.054
min0.524
max0.847
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.499
σ0.013
min0.475
max0.546

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.401-301.962=-5.561
σ0.192-0.251=-0.059
min296.274-301.807=-5.533
max296.933-302.652=-5.719
mean1904.000-2044.000=-140.000
σ0.000
min1904.000-2044.000=-140.000
max1904.000-2044.000=-140.000
mean0.568-0.595=-0.026
σ0.064-0.034=0.031
min0.504-0.501=0.003
max0.706-0.613=0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-303.780=-19.090
σ0.035-0.076=-0.041
min284.643-303.648=-19.006
max284.727-303.840=-19.114
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.399-0.399=0.000
σ0.013-0.007=0.006
min0.385-0.392=-0.008
max0.418-0.410=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1326.338=-31.261
σ0.109-0.106=0.003
min1294.951-1326.204=-31.253
max1295.204-1326.462=-31.258
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean1.934-1.885=0.049
σ0.108-0.082=0.026
min1.809-1.769=0.040
max2.037-1.965=0.072
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1564.391=-25.199
σ6.883-6.931=-0.048
min1535.918-1561.103=-25.186
max1551.500-1576.785=-25.285
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean2.244-2.324=-0.080
σ0.248-0.294=-0.045
min2.041-2.060=-0.019
max2.621-2.664=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1894.279=-37.294
σ0.052-0.076=-0.025
min1856.937-1894.144=-37.207
max1857.061-1894.323=-37.262
mean1772.600-1770.000=2.600
σ128.926-179.308=-50.383
min1642.000-1620.000=22.000
max1904.000-2044.000=-140.000
mean3.044-2.916=0.128
σ0.283-0.129=0.154
min2.858-2.789=0.069
max3.546-3.133=0.413

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.253=-0.064
σ0.296-0.316=-0.020
min0.941-0.941=0.001
max1.571-1.650=-0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-448.060=-0.273
σ581.212-581.237=-0.024
min157.179-157.435=-0.256
max1319.605-1319.914=-0.310
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.545-0.554=-0.009
σ0.564-0.573=-0.009
min0.261-0.266=-0.004
max1.391-1.413=-0.022
policies=20
mean1572.102-1574.632=-2.530
σ0.353-0.351=0.002
min1571.862-1574.415=-2.553
max1572.626-1575.156=-2.531
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean2.628-2.655=-0.028
σ0.010-0.019=-0.009
min2.619-2.638=-0.019
max2.638-2.681=-0.043
policies=200
mean15728.953-15754.319=-25.367
σ0.182-0.103=0.079
min15728.808-15754.169=-25.361
max15729.219-15754.403=-25.184
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean26.634-26.941=-0.307
σ0.072-0.357=-0.285
min26.556-26.693=-0.137
max26.726-27.451=-0.725