Compare commits

Home / Compare 64913096 .. 8aa46310

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.971=-0.000
σ0.367-0.366=0.001
min53.834-53.835=-0.001
max55.016-55.012=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.000
min0.131-0.137=-0.006
max0.143-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.341-43.345=-0.004
σ0.007-0.006=0.001
min43.326-43.337=-0.011
max43.352-43.353=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.133=-0.011
σ0.004-0.011=-0.007
min0.117-0.120=-0.003
max0.129-0.150=-0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.897-1016.893=0.003
σ1.151-1.220=-0.069
min1016.322-1016.347=-0.026
max1021.708-1022.008=-0.300
mean1056.050-1050.800=5.250
σ308.489-307.328=1.161
min598.000-599.000=-1.000
max1631.000-1623.000=8.000
mean1.525-1.554=-0.029
σ0.053-0.134=-0.081
min1.465-1.408=0.057
max1.658-2.009=-0.351

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean4.314
σ0.000
min4.314
max4.314
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean3.279-3.090=0.189
σ0.000
min3.279-3.090=0.189
max3.279-3.090=0.189
name=error_case.art
mean11.663
σ0.000
min11.663
max11.663
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean6.780-6.744=0.036
σ0.000
min6.780-6.744=0.036
max6.780-6.744=0.036
name=heavy_item.art
mean7.599
σ0.000
min7.599
max7.599
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean4.136-3.954=0.182
σ0.000
min4.136-3.954=0.182
max4.136-3.954=0.182
name=nested_use.art
mean11.778
σ0.000
min11.778
max11.778
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean6.852-6.892=-0.040
σ0.000
min6.852-6.892=-0.040
max6.852-6.892=-0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4805.812-4805.812=-0.000
σ0.000
min4805.812-4805.812=-0.000
max4805.812-4805.812=-0.000
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean4.042-4.093=-0.051
σ0.000
min4.042-4.093=-0.051
max4.042-4.093=-0.051
name=cdr_enhanced_4k_loc.art
mean4412.645-4412.643=0.001
σ0.000
min4412.645-4412.643=0.001
max4412.645-4412.643=0.001
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean3.457-3.601=-0.144
σ0.000
min3.457-3.601=-0.144
max3.457-3.601=-0.144

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean768.227-768.218=0.009
σ0.000
min768.227-768.218=0.009
max768.227-768.218=0.009
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean566.995-595.447=-28.452
σ0.000
min566.995-595.447=-28.452
max566.995-595.447=-28.452
name=record_render_large_syntax_err.art
mean763.174-763.180=-0.006
σ0.000
min763.174-763.180=-0.006
max763.174-763.180=-0.006
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean489.014-562.437=-73.424
σ0.000
min489.014-562.437=-73.424
max489.014-562.437=-73.424
name=record_render_success.art
mean227.839-227.844=-0.005
σ0.000
min227.839-227.844=-0.005
max227.839-227.844=-0.005
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean137.621-154.104=-16.483
σ0.000
min137.621-154.104=-16.483
max137.621-154.104=-16.483
name=record_render_syntax_err.art
mean215.359
σ0.000
min215.359
max215.359
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean142.901-142.685=0.216
σ0.000
min142.901-142.685=0.216
max142.901-142.685=0.216

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.966-301.993=-0.027
σ0.203-0.232=-0.029
min301.829-301.840=-0.011
max302.522-302.634=-0.112
mean2032.000-2079.000=-47.000
σ0.000
min2032.000-2079.000=-47.000
max2032.000-2079.000=-47.000
mean0.605-0.561=0.044
σ0.008-0.046=-0.037
min0.585-0.500=0.084
max0.612-0.608=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.531-303.503=0.028
σ0.034-0.069=-0.035
min303.494-303.391=0.104
max303.578-303.564=0.014
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean0.394-0.391=0.003
σ0.005-0.002=0.003
min0.388-0.389=-0.002
max0.400-0.393=0.007
iters=5
new-facts=1
prior-facts=6402
mean1326.066-1326.063=0.003
σ0.116-0.112=0.004
min1325.926-1325.926=-0.001
max1326.206-1326.205=0.001
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean1.911-1.925=-0.014
σ0.086-0.084=0.002
min1.845-1.833=0.012
max2.055-2.040=0.015
iters=5
new-facts=6402
prior-facts=1
mean1564.127-1564.096=0.031
σ6.913-6.902=0.011
min1560.767-1560.776=-0.009
max1576.487-1576.436=0.050
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean2.352-2.248=0.104
σ0.268-0.174=0.094
min2.110-2.083=0.027
max2.672-2.521=0.151
iters=5
new-facts=6402
prior-facts=6402
mean1894.003-1894.007=-0.004
σ0.067-0.081=-0.014
min1893.884-1893.868=0.016
max1894.042-1894.072=-0.031
mean1768.400-1801.400=-33.000
σ168.506-198.935=-30.429
min1631.000-1623.000=8.000
max2032.000-2079.000=-47.000
mean2.996-3.057=-0.061
σ0.145-0.149=-0.004
min2.889-2.896=-0.007
max3.221-3.253=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.164-1.167=-0.003
σ0.269-0.265=0.003
min0.914-0.909=0.006
max1.594-1.596=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.685-444.686=-0.001
σ575.126-575.125=0.001
min157.120-157.120=-0.001
max1307.373-1307.373=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean0.515-0.530=-0.016
σ0.511-0.536=-0.026
min0.259-0.260=-0.001
max1.281-1.335=-0.054
policies=20
mean1571.532-1571.535=-0.003
σ0.350-0.358=-0.008
min1571.296-1571.296=-0.000
max1572.053-1572.067=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean2.615-2.628=-0.013
σ0.020-0.006=0.013
min2.593-2.620=-0.027
max2.636-2.634=0.002
policies=200
mean15723.248-15723.371=-0.123
σ0.133-0.084=0.049
min15723.126-15723.292=-0.166
max15723.432-15723.489=-0.057
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1623.000=8.000
σ0.000
min1631.000-1623.000=8.000
max1631.000-1623.000=8.000
mean26.393-26.420=-0.027
σ0.125-0.028=0.098
min26.289-26.384=-0.095
max26.557-26.452=0.105