Compare commits

Home / Compare 39e7ecec .. 9d474a20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.966=-0.003
σ0.370-0.369=0.001
min53.826-53.822=0.004
max55.015-55.016=-0.001
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.137-0.147=-0.010
σ0.005-0.012=-0.007
min0.129-0.135=-0.005
max0.147-0.167=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.009=-0.003
min43.312-43.313=-0.001
max43.334-43.343=-0.009
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.121-0.125=-0.004
σ0.004-0.011=-0.007
min0.116-0.115=0.001
max0.126-0.141=-0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.512-1006.517=-0.005
σ1.215-1.185=0.030
min1005.976-1005.960=0.016
max1011.608-1011.481=0.127
mean1054.450-1049.000=5.450
σ316.235-313.051=3.184
min584.000-600.000=-16.000
max1629.000-1646.000=-17.000
mean1.566-1.565=0.001
σ0.085-0.066=0.019
min1.479-1.479=-0.000
max1.856-1.731=0.125

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.413-0.414=-0.000
σ0.137-0.136=0.001
min0.335-0.333=0.002
max0.657-0.653=0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.882-0.911=-0.029
σ0.100-0.108=-0.009
min0.811-0.843=-0.032
max1.056-1.102=-0.047
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.529-0.547=-0.017
σ0.051-0.043=0.008
min0.488-0.517=-0.029
max0.606-0.619=-0.013
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.001=0.000
min2.360-2.360=-0.000
max2.364
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.855-0.890=-0.035
σ0.042-0.032=0.010
min0.829-0.866=-0.037
max0.928-0.945=-0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.837=-0.002
σ0.031-0.028=0.003
min964.810-964.819=-0.008
max964.889-964.887=0.002
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.834-0.797=0.037
σ0.027-0.065=-0.037
min0.793-0.727=0.067
max0.858-0.861=-0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.005-0.006=-0.001
min885.504
max885.516-885.519=-0.003
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.717-0.475=0.242
σ0.034-0.060=-0.026
min0.664-0.387=0.277
max0.752-0.538=0.214

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean4.240-1.981=2.258
σ0.093-0.068=0.025
min4.063-1.867=2.196
max4.565-2.250=2.315
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.002
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean4.202-1.957=2.245
σ0.067-0.080=-0.013
min4.089-1.849=2.241
max4.455-2.529=1.926
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.737-0.303=0.433
σ0.018-0.009=0.010
min0.708-0.290=0.418
max0.859-0.349=0.510
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.699-0.288=0.411
σ0.016-0.011=0.004
min0.672-0.273=0.399
max0.788-0.360=0.428

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.449-296.482=-0.033
σ0.256-0.241=0.015
min296.228-296.241=-0.013
max297.144-297.107=0.037
mean2029.000-1914.000=115.000
σ0.000
min2029.000-1914.000=115.000
max2029.000-1914.000=115.000
mean0.560-0.580=-0.020
σ0.035-0.033=0.002
min0.507-0.507=-0.001
max0.602-0.611=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.016-285.026=-0.010
σ0.035-0.038=-0.003
min284.979-284.975=0.003
max285.061-285.064=-0.003
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.394-0.395=-0.001
σ0.006-0.009=-0.003
min0.387-0.387=0.000
max0.401-0.409=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.441-1295.409=0.031
σ0.062-0.109=-0.047
min1295.377-1295.282=0.095
max1295.522-1295.540=-0.019
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean2.105-1.981=0.124
σ0.089-0.129=-0.040
min2.012-1.825=0.188
max2.203-2.165=0.037
iters=5
new-facts=6402
prior-facts=1
mean1539.553-1539.525=0.028
σ6.815-6.852=-0.037
min1536.350-1536.236=0.114
max1551.741-1551.777=-0.036
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean2.313-2.227=0.086
σ0.263-0.191=0.073
min2.066-2.049=0.017
max2.727-2.516=0.211
iters=5
new-facts=6402
prior-facts=6402
mean1857.313-1857.317=-0.004
σ0.081-0.054=0.027
min1857.198-1857.272=-0.074
max1857.393-1857.400=-0.006
mean1774.800-1774.200=0.600
σ172.651-134.057=38.594
min1629.000-1646.000=-17.000
max2029.000-1914.000=115.000
mean3.135-3.079=0.057
σ0.302-0.275=0.026
min2.836-2.859=-0.023
max3.567-3.556=0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.314-1.267=0.047
σ0.354-0.276=0.078
min0.935-1.065=-0.130
max1.798-1.737=0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.192=-0.001
σ581.331-581.333=-0.002
min157.524-157.524=0.000
max1320.188-1320.193=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean0.578-0.560=0.018
σ0.612-0.597=0.015
min0.272-0.260=0.012
max1.496-1.456=0.040
policies=20
mean1575.576-1575.574=0.002
σ0.364-0.360=0.005
min1575.328-1575.330=-0.002
max1576.117-1576.109=0.008
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean2.649-2.643=0.006
σ0.032-0.009=0.023
min2.613-2.632=-0.018
max2.691-2.654=0.037
policies=200
mean15763.749-15763.651=0.099
σ0.092-0.110=-0.017
min15763.674-15763.519=0.155
max15763.883-15763.781=0.102
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1646.000=-17.000
σ0.000
min1629.000-1646.000=-17.000
max1629.000-1646.000=-17.000
mean26.598-26.676=-0.077
σ0.052-0.107=-0.055
min26.543-26.595=-0.052
max26.656-26.833=-0.177