Compare commits

Home / Compare 8e211588 .. 542e109c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.826=0.228
σ0.371-0.367=0.003
min53.908-53.680=0.228
max55.108-54.871=0.237
mean414.000
σ0.000
min414.000
max414.000
mean0.139-0.153=-0.014
σ0.006-0.008=-0.002
min0.130-0.138=-0.008
max0.147-0.167=-0.020
cache=y
dps=1
iters=10
policies=100
mean43.393-43.208=0.185
σ0.006-0.006=-0.000
min43.386-43.202=0.184
max43.401-43.219=0.182
mean414.000
σ0.000
min414.000
max414.000
mean0.123-0.120=0.003
σ0.004-0.004=-0.001
min0.119-0.114=0.005
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1016.181=-9.175
σ1.189-1.164=0.024
min1006.434-1015.605=-9.170
max1011.987-1021.050=-9.063
mean1055.100-1039.850=15.250
σ314.791-311.491=3.300
min585.000
max1618.000-1632.000=-14.000
mean1.530-1.512=0.018
σ0.053-0.086=-0.034
min1.459-1.428=0.031
max1.631-1.809=-0.178

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.447
σ0.147
min0.362
max0.705
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.940
σ0.214
min0.827
max1.322
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.554
σ0.057
min0.487
max0.615
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.868
σ0.039
min0.843
max0.936

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840
σ0.035
min964.810
max964.898
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.810
σ0.060
min0.727
max0.861
name=cdr_enhanced_4k_loc.art
mean885.513
σ0.008
min885.506
max885.525
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.696
σ0.039
min0.648
max0.751

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.720
mean1618.000
σ0.000
min1618.000
max1618.000
mean4.281
σ0.080
min4.132
max4.671
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1618.000
σ0.000
min1618.000
max1618.000
mean4.262
σ0.117
min4.096
max5.012
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.750
σ0.017
min0.711
max0.863
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000
σ0.000
min1618.000
max1618.000
mean0.703
σ0.015
min0.674
max0.780

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.935-301.128=-4.193
σ0.246-0.220=0.026
min296.719-300.969=-4.249
max297.559-301.737=-4.178
mean2032.000-1954.000=78.000
σ0.000
min2032.000-1954.000=78.000
max2032.000-1954.000=78.000
mean0.577-0.553=0.024
σ0.020-0.025=-0.005
min0.537-0.508=0.030
max0.595-0.588=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-300.695=-13.877
σ0.039-0.028=0.011
min286.767-300.652=-13.885
max286.858-300.724=-13.866
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean0.396-0.395=0.000
σ0.005-0.009=-0.003
min0.388-0.389=-0.001
max0.400-0.410=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.211-1322.876=-25.666
σ0.121-0.095=0.026
min1297.088-1322.797=-25.709
max1297.363-1323.028=-25.664
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean1.879-1.922=-0.043
σ0.094-0.077=0.017
min1.804-1.828=-0.023
max2.017-2.028=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1561.314=-19.978
σ6.843-6.879=-0.037
min1538.054-1557.964=-19.911
max1553.573-1573.612=-20.040
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean2.230-2.316=-0.085
σ0.156-0.293=-0.137
min2.119-2.037=0.082
max2.489-2.643=-0.154
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1890.797=-31.674
σ0.065-0.014=0.051
min1859.032-1890.784=-31.751
max1859.199-1890.819=-31.620
mean1763.000-1782.800=-19.800
σ178.827-117.946=60.881
min1618.000-1632.000=-14.000
max2032.000-1954.000=78.000
mean2.891-2.974=-0.083
σ0.145-0.113=0.032
min2.777-2.849=-0.072
max3.143-3.127=0.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.197=0.031
σ0.363-0.348=0.015
min0.932-0.919=0.013
max1.843-1.788=0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-443.047=5.774
σ581.372-573.413=7.960
min158.131-156.339=1.791
max1320.880-1303.166=17.714
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean0.533-0.536=-0.004
σ0.538-0.542=-0.004
min0.260-0.261=-0.001
max1.339-1.349=-0.010
policies=20
mean1581.621-1563.633=17.988
σ0.340-0.322=0.017
min1581.390-1563.457=17.933
max1582.126-1564.116=18.009
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean2.608-2.618=-0.010
σ0.014-0.019=-0.005
min2.591-2.598=-0.007
max2.623-2.643=-0.019
policies=200
mean15824.268-15644.079=180.190
σ0.067-0.130=-0.063
min15824.218-15643.964=180.254
max15824.366-15644.242=180.123
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1632.000=-14.000
σ0.000
min1618.000-1632.000=-14.000
max1618.000-1632.000=-14.000
mean26.573-26.466=0.106
σ0.048-0.151=-0.102
min26.517-26.271=0.246
max26.630-26.625=0.005