Compare commits

Home / Compare 48a110d7 .. 9a15ae20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.013=0.002
σ0.369-0.369=0.000
min53.870-53.876=-0.005
max55.066-55.063=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.140-0.138=0.002
σ0.005-0.004=0.001
min0.136-0.133=0.003
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.324-43.322=0.002
σ0.005-0.007=-0.002
min43.313-43.313=-0.000
max43.331-43.334=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.001
min0.116-0.114=0.002
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1011.002=-4.695
σ1.180-1.166=0.014
min1005.771-1010.436=-4.665
max1011.225-1015.886=-4.662
mean1047.250-1048.950=-1.700
σ313.828-311.625=2.203
min595.000-585.000=10.000
max1643.000-1649.000=-6.000
mean1.582-1.530=0.052
σ0.120-0.069=0.050
min1.474-1.465=0.009
max1.961-1.696=0.265

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.413
σ0.152
min0.328
max0.683
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.875
σ0.101
min0.804
max1.050
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.532
σ0.053
min0.490
max0.620
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.839
σ0.027
min0.820
max0.885

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115
σ0.034
min964.086
max964.171
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.831
σ0.024
min0.810
max0.866
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.705
max884.722
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.709
σ0.044
min0.659
max0.747

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.212
σ0.075
min4.081
max4.559
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.667
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.193
σ0.059
min4.057
max4.382
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.732
σ0.020
min0.698
max0.854
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.700
σ0.018
min0.627
max0.775

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.114-300.974=-4.860
σ0.202-0.232=-0.029
min295.949-300.822=-4.873
max296.636-301.605=-4.969
mean1918.000-1947.000=-29.000
σ0.000
min1918.000-1947.000=-29.000
max1918.000-1947.000=-29.000
mean0.584-0.560=0.024
σ0.050-0.027=0.024
min0.520-0.502=0.018
max0.702-0.584=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-299.453=-14.756
σ0.035-0.045=-0.010
min284.646-299.381=-14.734
max284.731-299.499=-14.768
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean0.403-0.388=0.015
σ0.009-0.008=0.001
min0.388-0.383=0.004
max0.411-0.402=0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1309.869=-14.789
σ0.111-0.089=0.023
min1294.960-1309.757=-14.798
max1295.225-1309.997=-14.772
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean1.905-1.892=0.013
σ0.063-0.060=0.004
min1.825-1.801=0.023
max1.969-1.954=0.015
iters=5
new-facts=6402
prior-facts=1
mean1539.189-1553.984=-14.795
σ6.868-6.868=0.000
min1535.881-1550.695=-14.813
max1551.470-1566.264=-14.794
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean2.302-2.264=0.039
σ0.233-0.219=0.014
min2.049-2.014=0.035
max2.522-2.569=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1871.759=-14.777
σ0.056-0.048=0.008
min1856.935-1871.706=-14.771
max1857.070-1871.813=-14.743
mean1776.400-1754.200=22.200
σ136.983-121.923=15.060
min1643.000-1649.000=-6.000
max1918.000-1947.000=-29.000
mean3.027-2.789=0.238
σ0.312-0.097=0.216
min2.686-2.725=-0.038
max3.538-2.951=0.586

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.171-1.186=-0.015
σ0.228-0.290=-0.062
min0.943-0.934=0.009
max1.531-1.662=-0.131

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.808=-0.021
σ581.212-581.232=-0.020
min157.179-157.187=-0.008
max1319.605-1319.657=-0.052
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean0.538-0.557=-0.019
σ0.556-0.596=-0.040
min0.257-0.257=-0.000
max1.373-1.451=-0.078
policies=20
mean1572.102-1572.130=-0.028
σ0.348-0.335=0.013
min1571.865-1571.939=-0.074
max1572.618-1572.632=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean2.621-2.628=-0.007
σ0.012-0.026=-0.014
min2.604-2.599=0.005
max2.629-2.659=-0.029
policies=200
mean15729.068-15728.979=0.089
σ0.127-0.103=0.024
min15728.954-15728.866=0.087
max15729.242-15729.097=0.145
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1649.000=-6.000
σ0.000
min1643.000-1649.000=-6.000
max1643.000-1649.000=-6.000
mean26.499-26.591=-0.092
σ0.061-0.187=-0.126
min26.407-26.422=-0.014
max26.531-26.765=-0.234