Compare commits

Home / Compare 06e55700 .. a3fd3ecc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.963=0.091
σ0.371-0.369=0.002
min53.913-53.825=0.088
max55.109-55.012=0.096
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.140-0.138=0.002
σ0.006-0.003=0.002
min0.132-0.133=-0.001
max0.149-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.006=-0.000
min43.384-43.315=0.069
max43.403-43.335=0.068
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.121=0.001
σ0.003-0.001=0.002
min0.119-0.119=0.000
max0.127-0.123=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1006.514=0.490
σ1.193-1.164=0.029
min1006.433-1005.949=0.484
max1012.003-1011.388=0.616
mean1045.700-1048.200=-2.500
σ315.334-314.278=1.056
min569.000-579.000=-10.000
max1649.000-1646.000=3.000
mean1.532-1.548=-0.016
σ0.085-0.069=0.016
min1.361-1.463=-0.103
max1.777-1.705=0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.415-0.421=-0.006
σ0.133-0.117=0.016
min0.335-0.345=-0.009
max0.649-0.627=0.022
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.943-0.891=0.052
σ0.209-0.102=0.107
min0.811-0.826=-0.015
max1.314-1.072=0.242
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.538-0.540=-0.002
σ0.046-0.045=0.002
min0.498-0.498=-0.000
max0.616-0.615=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.857-0.854=0.003
σ0.039-0.047=-0.008
min0.816-0.815=0.001
max0.917-0.930=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.839=-0.002
σ0.021-0.035=-0.014
min964.815-964.810=0.004
max964.863-964.898=-0.035
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.831-0.816=0.015
σ0.016-0.050=-0.034
min0.814-0.753=0.061
max0.857-0.860=-0.004
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.004-0.007=-0.003
min885.505-885.504=0.001
max885.516-885.522=-0.006
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.732-0.685=0.047
σ0.032-0.115=-0.083
min0.676-0.480=0.195
max0.752-0.749=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean4.256-3.500=0.756
σ0.091-0.069=0.022
min4.129-3.355=0.775
max4.857-3.799=1.058
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean4.249-3.508=0.741
σ0.074-0.092=-0.019
min4.142-3.382=0.760
max4.502-3.887=0.615
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.732-0.747=-0.015
σ0.018-0.020=-0.002
min0.701-0.662=0.039
max0.850-0.834=0.016
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.696-0.710=-0.014
σ0.014-0.019=-0.005
min0.668-0.671=-0.002
max0.761-0.796=-0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.976-296.325=0.651
σ0.213-0.249=-0.036
min296.766-296.117=0.648
max297.549-296.988=0.561
mean1921.000-2030.000=-109.000
σ0.000
min1921.000-2030.000=-109.000
max1921.000-2030.000=-109.000
mean0.526-0.559=-0.033
σ0.033-0.030=0.003
min0.477-0.513=-0.036
max0.568-0.582=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-285.025=1.795
σ0.036-0.038=-0.002
min286.778-284.977=1.801
max286.865-285.066=1.800
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.410-0.396=0.014
σ0.009-0.008=0.002
min0.398-0.386=0.012
max0.424-0.405=0.019
iters=5
new-facts=1
prior-facts=6402
mean1297.232-1295.381=1.851
σ0.074-0.084=-0.010
min1297.143-1295.287=1.857
max1297.302-1295.504=1.799
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean2.056-1.925=0.131
σ0.070-0.200=-0.130
min1.973-1.787=0.187
max2.129-2.246=-0.116
iters=5
new-facts=6402
prior-facts=1
mean1541.327-1539.632=1.695
σ6.851-6.750=0.101
min1538.005-1536.490=1.515
max1553.578-1551.705=1.873
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean2.269-2.394=-0.126
σ0.237-0.292=-0.055
min2.100-2.144=-0.044
max2.626-2.898=-0.272
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1857.326=1.787
σ0.075-0.050=0.026
min1859.007-1857.268=1.739
max1859.187-1857.394=1.793
mean1778.400-1779.000=-0.600
σ136.798-168.935=-32.137
min1649.000-1646.000=3.000
max1921.000-2030.000=-109.000
mean3.074-2.842=0.232
σ0.174-0.056=0.117
min2.846-2.775=0.071
max3.255-2.927=0.328

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.100-1.185=-0.085
σ0.197-0.264=-0.067
min0.932-0.931=0.002
max1.359-1.606=-0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.192=0.628
σ581.372-581.334=0.038
min158.133-157.523=0.610
max1320.878-1320.193=0.685
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean0.541-0.547=-0.006
σ0.558-0.558=0.000
min0.260-0.264=-0.004
max1.378-1.384=-0.005
policies=20
mean1581.607-1575.571=6.035
σ0.355-0.360=-0.005
min1581.370-1575.330=6.040
max1582.135-1576.107=6.028
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean2.633-2.657=-0.024
σ0.014-0.009=0.005
min2.615-2.648=-0.032
max2.650-2.670=-0.021
policies=200
mean15824.174-15763.662=60.513
σ0.104-0.205=-0.100
min15824.027-15763.497=60.531
max15824.272-15763.957=60.315
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1646.000=3.000
σ0.000
min1649.000-1646.000=3.000
max1649.000-1646.000=3.000
mean26.572-26.671=-0.099
σ0.087-0.097=-0.010
min26.478-26.588=-0.110
max26.657-26.803=-0.145