Compare commits

Home / Compare ba87e630 .. 12f88666

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.966=0.088
σ0.371-0.369=0.001
min53.908-53.822=0.086
max55.108-55.016=0.092
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.139-0.147=-0.008
σ0.006-0.012=-0.005
min0.130-0.135=-0.005
max0.147-0.167=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.393-43.323=0.070
σ0.006-0.009=-0.003
min43.386-43.313=0.072
max43.401-43.343=0.058
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.123-0.125=-0.002
σ0.004-0.011=-0.007
min0.119-0.115=0.004
max0.128-0.141=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.517=0.489
σ1.189-1.185=0.004
min1006.434-1005.960=0.474
max1011.987-1011.481=0.505
mean1055.100-1049.000=6.100
σ314.791-313.051=1.740
min585.000-600.000=-15.000
max1618.000-1646.000=-28.000
mean1.530-1.565=-0.035
σ0.053-0.066=-0.014
min1.459-1.479=-0.020
max1.631-1.731=-0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.447-0.414=0.033
σ0.147-0.136=0.011
min0.362-0.333=0.029
max0.705-0.653=0.051
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.940-0.911=0.029
σ0.214-0.108=0.106
min0.827-0.843=-0.015
max1.322-1.102=0.220
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.554-0.547=0.007
σ0.057-0.043=0.014
min0.487-0.517=-0.030
max0.615-0.619=-0.004
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.001=0.000
min2.360-2.360=-0.000
max2.364
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.868-0.890=-0.021
σ0.039-0.032=0.006
min0.843-0.866=-0.023
max0.936-0.945=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.837=0.002
σ0.035-0.028=0.007
min964.810-964.819=-0.009
max964.898-964.887=0.011
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.810-0.797=0.013
σ0.060-0.065=-0.004
min0.727-0.727=0.001
max0.861-0.861=-0.000
name=cdr_enhanced_4k_loc.art
mean885.513-885.510=0.003
σ0.008-0.006=0.002
min885.506-885.504=0.001
max885.525-885.519=0.006
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.696-0.475=0.222
σ0.039-0.060=-0.022
min0.648-0.387=0.261
max0.751-0.538=0.213

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean4.281-1.981=2.299
σ0.080-0.068=0.012
min4.132-1.867=2.265
max4.671-2.250=2.421
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.002
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean4.262-1.957=2.305
σ0.117-0.080=0.038
min4.096-1.849=2.248
max5.012-2.529=2.482
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.750-0.303=0.446
σ0.017-0.009=0.009
min0.711-0.290=0.422
max0.863-0.349=0.514
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.703-0.288=0.415
σ0.015-0.011=0.004
min0.674-0.273=0.401
max0.780-0.360=0.420

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.935-296.482=0.454
σ0.246-0.241=0.005
min296.719-296.241=0.478
max297.559-297.107=0.452
mean2032.000-1914.000=118.000
σ0.000
min2032.000-1914.000=118.000
max2032.000-1914.000=118.000
mean0.577-0.580=-0.003
σ0.020-0.033=-0.013
min0.537-0.507=0.030
max0.595-0.611=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-285.026=1.792
σ0.039-0.038=0.001
min286.767-284.975=1.792
max286.858-285.064=1.793
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.396-0.395=0.001
σ0.005-0.009=-0.004
min0.388-0.387=0.001
max0.400-0.409=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1297.211-1295.409=1.802
σ0.121-0.109=0.012
min1297.088-1295.282=1.806
max1297.363-1295.540=1.823
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean1.879-1.981=-0.103
σ0.094-0.129=-0.035
min1.804-1.825=-0.020
max2.017-2.165=-0.148
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1539.525=1.810
σ6.843-6.852=-0.009
min1538.054-1536.236=1.817
max1553.573-1551.777=1.796
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean2.230-2.227=0.004
σ0.156-0.191=-0.035
min2.119-2.049=0.070
max2.489-2.516=-0.028
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1857.317=1.806
σ0.065-0.054=0.011
min1859.032-1857.272=1.760
max1859.199-1857.400=1.799
mean1763.000-1774.200=-11.200
σ178.827-134.057=44.770
min1618.000-1646.000=-28.000
max2032.000-1914.000=118.000
mean2.891-3.079=-0.188
σ0.145-0.275=-0.130
min2.777-2.859=-0.081
max3.143-3.556=-0.413

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.267=-0.039
σ0.363-0.276=0.087
min0.932-1.065=-0.133
max1.843-1.737=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.192=0.629
σ581.372-581.333=0.039
min158.131-157.524=0.607
max1320.880-1320.193=0.687
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean0.533-0.560=-0.028
σ0.538-0.597=-0.059
min0.260-0.260=0.000
max1.339-1.456=-0.117
policies=20
mean1581.621-1575.574=6.047
σ0.340-0.360=-0.020
min1581.390-1575.330=6.060
max1582.126-1576.109=6.017
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean2.608-2.643=-0.035
σ0.014-0.009=0.005
min2.591-2.632=-0.041
max2.623-2.654=-0.031
policies=200
mean15824.268-15763.651=60.617
σ0.067-0.110=-0.043
min15824.218-15763.519=60.699
max15824.366-15763.781=60.585
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1646.000=-28.000
σ0.000
min1618.000-1646.000=-28.000
max1618.000-1646.000=-28.000
mean26.573-26.676=-0.103
σ0.048-0.107=-0.059
min26.517-26.595=-0.078
max26.630-26.833=-0.203