Compare commits

Home / Compare 980e2580 .. 6babab3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.369-0.369=0.000
min53.870-53.872=-0.002
max55.065-55.064=0.001
mean416.700-415.000=1.700
σ0.483-0.000=0.483
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.136-0.136=-0.000
σ0.003-0.005=-0.002
min0.132-0.130=0.002
max0.143-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.005-0.008=-0.003
min43.316-43.309=0.008
max43.329-43.336=-0.006
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.119-0.121=-0.002
σ0.002-0.002=0.000
min0.116-0.119=-0.003
max0.121-0.126=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.316-1006.309=0.007
σ1.155-1.167=-0.011
min1005.743-1005.768=-0.025
max1011.140-1011.194=-0.054
mean1055.350-1045.850=9.500
σ316.296-313.898=2.397
min568.000-595.000=-27.000
max1620.000-1641.000=-21.000
mean1.526-1.547=-0.022
σ0.071-0.098=-0.027
min1.417-1.459=-0.042
max1.742-1.781=-0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.420-0.409=0.011
σ0.130-0.144=-0.015
min0.329-0.320=0.009
max0.638-0.663=-0.025
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.871-0.887=-0.016
σ0.092-0.097=-0.005
min0.813-0.820=-0.007
max1.032-1.056=-0.024
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.534-0.555=-0.021
σ0.055-0.054=0.001
min0.486-0.510=-0.024
max0.626-0.646=-0.020
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.843-0.852=-0.009
σ0.034-0.036=-0.002
min0.805-0.826=-0.021
max0.897-0.913=-0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.033-0.029=0.003
min964.086-964.094=-0.008
max964.169-964.163=0.005
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.842-0.852=-0.010
σ0.017-0.004=0.012
min0.814-0.845=-0.031
max0.854-0.856=-0.002
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.008=-0.001
min884.703
max884.721-884.723=-0.001
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.723-0.710=0.013
σ0.017-0.029=-0.012
min0.706-0.681=0.025
max0.742-0.740=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean4.228-4.214=0.014
σ0.111-0.081=0.030
min4.065-4.030=0.035
max4.649-4.518=0.131
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean4.239-3.533=0.705
σ0.081-0.198=-0.117
min4.035-3.354=0.681
max4.539-4.276=0.263
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.737-0.737=0.001
σ0.021-0.018=0.003
min0.706-0.707=-0.000
max0.872-0.842=0.030
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.700-0.690=0.010
σ0.014-0.014=-0.001
min0.676-0.655=0.020
max0.755-0.753=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.360-296.453=-0.094
σ0.216-0.242=-0.026
min296.176-296.208=-0.032
max296.918-297.100=-0.182
mean1919.000-1953.000=-34.000
σ0.000
min1919.000-1953.000=-34.000
max1919.000-1953.000=-34.000
mean0.586-0.589=-0.003
σ0.049-0.035=0.015
min0.495-0.539=-0.044
max0.696-0.665=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.694=-0.000
σ0.032-0.037=-0.005
min284.653-284.642=0.011
max284.731-284.734=-0.003
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.395-0.398=-0.003
σ0.010-0.007=0.002
min0.386-0.385=0.000
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.075=0.003
σ0.114-0.103=0.011
min1294.959-1294.960=-0.001
max1295.217-1295.206=0.011
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean1.917-1.920=-0.003
σ0.094-0.117=-0.023
min1.807-1.791=0.016
max2.001-2.048=-0.048
iters=5
new-facts=6402
prior-facts=1
mean1539.189-1539.211=-0.022
σ6.869-6.828=0.041
min1535.901-1535.919=-0.018
max1551.470-1551.420=0.051
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean2.284-2.362=-0.078
σ0.240-0.244=-0.004
min2.032-2.052=-0.020
max2.565-2.692=-0.127
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1856.983=0.000
σ0.063-0.061=0.001
min1856.901-1856.930=-0.029
max1857.069-1857.069=-0.000
mean1772.800-1791.200=-18.400
σ142.705-156.538=-13.833
min1620.000-1641.000=-21.000
max1919.000-1953.000=-34.000
mean3.003-2.937=0.066
σ0.227-0.153=0.074
min2.794-2.822=-0.028
max3.367-3.185=0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.181=0.035
σ0.319-0.208=0.111
min0.920-0.927=-0.007
max1.746-1.459=0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.002
σ581.213-581.212=0.000
min157.174-157.179=-0.004
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean0.513-0.538=-0.025
σ0.505-0.558=-0.053
min0.255-0.255=0.000
max1.271-1.374=-0.104
policies=20
mean1572.086-1572.099=-0.012
σ0.356-0.344=0.012
min1571.845-1571.864=-0.019
max1572.615-1572.610=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean2.623-2.621=0.002
σ0.019-0.023=-0.004
min2.604-2.595=0.009
max2.649-2.651=-0.002
policies=200
mean15729.013-15729.091=-0.078
σ0.038-0.120=-0.081
min15728.968-15728.986=-0.018
max15729.061-15729.262=-0.201
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1641.000=-21.000
σ0.000
min1620.000-1641.000=-21.000
max1620.000-1641.000=-21.000
mean26.484-26.528=-0.044
σ0.130-0.212=-0.082
min26.363-26.349=0.014
max26.660-26.776=-0.116