Compare commits

Home / Compare 50fce130 .. a80b3817

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.004
σ0.369-0.369=0.000
min53.879-53.876=0.003
max55.063-55.065=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.135-0.138=-0.003
σ0.005-0.004=0.001
min0.129-0.130=-0.002
max0.142-0.145=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.002
σ0.007-0.007=-0.000
min43.312-43.308=0.004
max43.337-43.333=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.117-0.122=-0.006
σ0.003-0.003=-0.001
min0.115-0.119=-0.004
max0.122-0.130=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1011.002=-4.696
σ1.165-1.159=0.006
min1005.774-1010.436=-4.662
max1011.178-1015.854=-4.676
mean1048.400-1047.950=0.450
σ313.630-298.844=14.786
min598.000-592.000=6.000
max1646.000-1445.000=201.000
mean1.561-1.516=0.044
σ0.079-0.047=0.033
min1.478-1.452=0.026
max1.786-1.630=0.156

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.416
σ0.136
min0.329
max0.657
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.895
σ0.114
min0.828
max1.097
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.575
σ0.074
min0.497
max0.673
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.861
σ0.045
min0.822
max0.930

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.023
min964.092
max964.151
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.826
σ0.031
min0.795
max0.864
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.006
min884.705
max884.722
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.720
σ0.014
min0.704
max0.738

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1646.000
σ0.000
min1646.000
max1646.000
mean3.504
σ0.086
min3.368
max3.850
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1646.000
σ0.000
min1646.000
max1646.000
mean3.660
σ0.332
min3.364
max4.666
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.739
σ0.029
min0.587
max0.880
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.696
σ0.029
min0.516
max0.785

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.284-300.886=-4.602
σ0.257-0.217=0.040
min296.071-300.739=-4.667
max296.967-301.489=-4.522
mean1905.000-1941.000=-36.000
σ0.000
min1905.000-1941.000=-36.000
max1905.000-1941.000=-36.000
mean0.564-0.551=0.013
σ0.043-0.020=0.023
min0.502-0.531=-0.030
max0.610-0.581=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.676-299.458=-14.781
σ0.040-0.032=0.008
min284.639-299.418=-14.779
max284.735-299.499=-14.764
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean0.404-0.392=0.012
σ0.002-0.010=-0.008
min0.402-0.385=0.018
max0.408-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1309.889=-14.814
σ0.102-0.102=0.001
min1294.961-1309.761=-14.800
max1295.198-1310.026=-14.828
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean1.926-1.923=0.002
σ0.094-0.106=-0.012
min1.818-1.799=0.019
max2.034-2.073=-0.039
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1553.968=-14.781
σ6.857-6.868=-0.011
min1535.917-1550.625=-14.708
max1551.450-1566.248=-14.799
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean2.267-2.244=0.024
σ0.261-0.184=0.077
min2.060-2.067=-0.007
max2.683-2.549=0.135
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1871.764=-14.773
σ0.054-0.048=0.006
min1856.938-1871.699=-14.760
max1857.068-1871.808=-14.740
mean1775.800-1735.800=40.000
σ128.280-162.454=-34.174
min1646.000-1510.000=136.000
max1905.000-1941.000=-36.000
mean3.003-2.875=0.128
σ0.301-0.043=0.258
min2.683-2.824=-0.141
max3.486-2.926=0.560

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.747=-0.588
σ0.304-0.110=0.193
min0.925-1.627=-0.702
max1.644-1.890=-0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.794=-0.011
σ581.213-581.213=-0.000
min157.174-157.186=-0.012
max1319.603-1319.614=-0.011
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean0.542-0.553=-0.012
σ0.564-0.584=-0.020
min0.259-0.260=-0.001
max1.388-1.429=-0.042
policies=20
mean1572.086-1572.115=-0.029
σ0.355-0.340=0.014
min1571.850-1571.895=-0.046
max1572.614-1572.623=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean2.624-2.623=0.001
σ0.013-0.016=-0.004
min2.606-2.610=-0.004
max2.634-2.647=-0.013
policies=200
mean15729.025-15729.023=0.002
σ0.074-0.037=0.037
min15728.930-15728.968=-0.038
max15729.106-15729.050=0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1445.000=201.000
σ0.000
min1646.000-1445.000=201.000
max1646.000-1445.000=201.000
mean26.612-26.517=0.095
σ0.176-0.131=0.045
min26.474-26.414=0.060
max26.855-26.707=0.148