Compare commits

Home / Compare 7f957aa0 .. 18486c1f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.032=0.000
σ0.370-0.369=0.002
min53.886-53.885=0.000
max55.085-55.080=0.005
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.141-0.138=0.003
σ0.004-0.005=-0.001
min0.137-0.133=0.004
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.007-0.005=0.002
min43.372-43.376=-0.004
max43.398-43.391=0.007
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.123=0.000
σ0.004-0.004=-0.000
min0.120-0.119=0.001
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.329-1006.329=-0.001
σ0.891-0.896=-0.005
min1005.833-1005.858=-0.026
max1010.033-1010.054=-0.021
mean1051.700-1049.550=2.150
σ307.726-317.712=-9.986
min576.000-546.000=30.000
max1651.000-1650.000=1.000
mean1.540-1.572=-0.032
σ0.074-0.117=-0.043
min1.375-1.363=0.012
max1.646-1.817=-0.171

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.416-0.414=0.002
σ0.126-0.129=-0.003
min0.339-0.331=0.007
max0.639-0.641=-0.002
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.882-0.878=0.004
σ0.088-0.067=0.021
min0.822-0.821=0.001
max1.035-0.990=0.045
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.573-0.543=0.030
σ0.054-0.043=0.011
min0.523-0.502=0.021
max0.640-0.611=0.029
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.880-0.843=0.037
σ0.053-0.031=0.023
min0.832-0.813=0.019
max0.940-0.890=0.050

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.558-963.551=0.007
σ0.034-0.027=0.008
min963.523-963.527=-0.004
max963.611-963.594=0.016
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.826-0.774=0.051
σ0.020-0.039=-0.020
min0.797-0.704=0.093
max0.849-0.794=0.055
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=-0.000
σ0.005-0.005=-0.000
min884.847
max884.860-884.860=-0.000
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.724-0.693=0.031
σ0.031-0.040=-0.009
min0.669-0.654=0.015
max0.740-0.738=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.709=0.001
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean4.179-4.208=-0.028
σ0.090-0.078=0.013
min4.045-4.075=-0.030
max4.667-4.595=0.071
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.660=-0.002
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean4.194-4.210=-0.016
σ0.071-0.104=-0.033
min4.056-4.087=-0.032
max4.430-4.848=-0.418
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.737-0.748=-0.011
σ0.054-0.018=0.037
min0.530-0.716=-0.186
max0.857-0.841=0.016
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.718-0.714=0.004
σ0.024-0.026=-0.002
min0.681-0.525=0.157
max0.844-0.795=0.049

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.588-295.463=0.126
σ0.209-0.180=0.029
min295.432-295.294=0.138
max296.150-295.938=0.212
mean1914.000-1907.000=7.000
σ0.000
min1914.000-1907.000=7.000
max1914.000-1907.000=7.000
mean0.606-0.579=0.027
σ0.027-0.041=-0.014
min0.576-0.499=0.078
max0.677-0.649=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.249-285.248=0.000
σ0.034-0.043=-0.009
min285.203-285.187=0.017
max285.286-285.289=-0.003
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.391-0.403=-0.012
σ0.007-0.009=-0.002
min0.384-0.392=-0.008
max0.401-0.411=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.198=0.000
σ0.109-0.112=-0.003
min1295.074-1295.080=-0.005
max1295.326-1295.338=-0.012
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean1.900-1.914=-0.014
σ0.090-0.090=-0.000
min1.803-1.816=-0.013
max2.022-2.015=0.007
iters=5
new-facts=6402
prior-facts=1
mean1538.081-1538.078=0.002
σ4.036-4.047=-0.011
min1536.028-1536.047=-0.019
max1545.290-1545.309=-0.019
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean2.308-2.257=0.051
σ0.236-0.208=0.028
min2.038-2.022=0.015
max2.551-2.448=0.103
iters=5
new-facts=6402
prior-facts=6402
mean1857.111-1857.100=0.011
σ0.051-0.056=-0.005
min1857.060-1857.040=0.020
max1857.188-1857.163=0.025
mean1783.000-1775.200=7.800
σ130.037-128.712=1.325
min1651.000-1650.000=1.000
max1914.000-1907.000=7.000
mean3.082-3.016=0.066
σ0.397-0.122=0.275
min2.780-2.877=-0.098
max3.767-3.200=0.567

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.355-1.436=-0.081
σ0.260-0.185=0.076
min1.108-1.118=-0.010
max1.796-1.577=0.219

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.610=-0.000
σ577.065-577.065=-0.000
min155.076-155.074=0.002
max1309.207-1309.208=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean0.560-0.545=0.015
σ0.594-0.564=0.030
min0.257-0.258=-0.002
max1.451-1.391=0.060
policies=20
mean1551.046-1551.045=0.001
σ0.350-0.331=0.019
min1550.813-1550.819=-0.006
max1551.567-1551.537=0.030
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean2.624-2.599=0.025
σ0.034-0.017=0.017
min2.600-2.575=0.024
max2.673-2.615=0.058
policies=200
mean15518.455-15518.538=-0.083
σ0.071-0.092=-0.021
min15518.368-15518.468=-0.100
max15518.533-15518.664=-0.130
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1650.000=1.000
σ0.000
min1651.000-1650.000=1.000
max1651.000-1650.000=1.000
mean26.317-26.243=0.074
σ0.206-0.077=0.129
min26.190-26.178=0.012
max26.624-26.354=0.270