Compare commits

Home / Compare a683c67a .. 09cc348b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.368=0.000
min53.922-53.910=0.013
max55.106-55.103=0.003
mean418.000-413.500=4.500
σ0.000-0.527=-0.527
min418.000-413.000=5.000
max418.000-414.000=4.000
mean0.141-0.137=0.004
σ0.007-0.004=0.003
min0.133-0.131=0.001
max0.156-0.142=0.014
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.006=0.000
min43.385-43.388=-0.003
max43.401-43.402=-0.001
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.122-0.123=-0.001
σ0.003-0.003=0.000
min0.119-0.120=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.978=0.002
σ0.870-0.871=-0.000
min1006.481-1006.482=-0.001
max1010.582-1010.581=0.002
mean1048.250-1047.650=0.600
σ311.486-307.736=3.750
min577.000-553.000=24.000
max1650.000-1642.000=8.000
mean1.542-1.546=-0.004
σ0.096-0.072=0.024
min1.460-1.481=-0.021
max1.791-1.753=0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.445-0.421=0.024
σ0.181-0.138=0.043
min0.346-0.336=0.010
max0.767-0.666=0.101
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.921-0.882=0.039
σ0.155-0.089=0.066
min0.830-0.814=0.016
max1.197-1.034=0.163
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.529-0.544=-0.015
σ0.046-0.043=0.003
min0.494-0.508=-0.013
max0.607-0.615=-0.008
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.839-0.837=0.003
σ0.038-0.038=-0.000
min0.802-0.800=0.003
max0.902-0.895=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.835=-0.001
σ0.030-0.031=-0.001
min964.811-964.807=0.004
max964.886-964.888=-0.002
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.785-0.832=-0.047
σ0.058-0.048=0.010
min0.708-0.750=-0.042
max0.864-0.872=-0.008
name=cdr_enhanced_4k_loc.art
mean885.514-885.515=-0.001
σ0.009-0.005=0.004
min885.504-885.508=-0.004
max885.525-885.519=0.007
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.710-0.698=0.012
σ0.064-0.042=0.023
min0.598-0.643=-0.045
max0.755-0.734=0.021

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean4.224-3.498=0.726
σ0.070-0.090=-0.020
min4.093-3.326=0.767
max4.591-4.069=0.522
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean4.231-3.477=0.754
σ0.069-0.080=-0.011
min4.106-3.365=0.741
max4.511-3.762=0.749
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.742-0.744=-0.002
σ0.025-0.027=-0.002
min0.575-0.570=0.006
max0.859-0.856=0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.704-0.581=0.123
σ0.015-0.099=-0.084
min0.676-0.487=0.189
max0.802-0.788=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.572-295.380=0.192
σ0.240-0.165=0.075
min295.411-295.277=0.134
max296.235-295.832=0.402
mean2031.000-1906.000=125.000
σ0.000
min2031.000-1906.000=125.000
max2031.000-1906.000=125.000
mean0.545-0.574=-0.029
σ0.029-0.041=-0.012
min0.505-0.493=0.012
max0.574-0.627=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.413=-0.004
σ0.031-0.037=-0.006
min285.375-285.368=0.007
max285.442-285.453=-0.011
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.386-0.387=-0.000
σ0.007-0.007=-0.000
min0.380-0.380=0.001
max0.398-0.396=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1295.794=0.012
σ0.111-0.114=-0.002
min1295.682-1295.663=0.019
max1295.951-1295.936=0.015
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean1.893-1.988=-0.094
σ0.089-0.276=-0.187
min1.805-1.797=0.009
max2.023-2.467=-0.444
iters=5
new-facts=6402
prior-facts=1
mean1539.915-1539.974=-0.058
σ6.882-6.833=0.049
min1536.608-1536.707=-0.099
max1552.221-1552.192=0.029
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean2.297-2.403=-0.105
σ0.235-0.238=-0.002
min2.037-2.052=-0.015
max2.587-2.635=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.706=0.004
σ0.048-0.056=-0.007
min1857.660-1857.654=0.006
max1857.768-1857.784=-0.017
mean1789.200-1774.200=15.000
σ165.069-130.550=34.519
min1650.000-1642.000=8.000
max2031.000-1906.000=125.000
mean3.037-3.056=-0.019
σ0.252-0.272=-0.021
min2.839-2.842=-0.003
max3.461-3.525=-0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.305-1.306=-0.001
σ0.216-0.279=-0.062
min1.107-1.098=0.009
max1.628-1.779=-0.151

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.742=-0.002
σ580.934-580.937=-0.002
min155.270-155.270=-0.000
max1317.142-1317.147=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean0.524-0.544=-0.020
σ0.537-0.561=-0.024
min0.254-0.262=-0.007
max1.330-1.385=-0.055
policies=20
mean1552.987-1552.990=-0.003
σ0.328-0.325=0.003
min1552.761-1552.768=-0.006
max1553.474-1553.472=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean2.587-2.586=0.001
σ0.015-0.009=0.006
min2.572-2.575=-0.003
max2.606-2.594=0.012
policies=200
mean15537.993-15537.740=0.253
σ0.070-0.469=-0.399
min15537.897-15537.052=0.845
max15538.064-15538.071=-0.007
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1642.000=8.000
σ0.000
min1650.000-1642.000=8.000
max1650.000-1642.000=8.000
mean26.155-26.183=-0.028
σ0.190-0.213=-0.022
min26.021-26.024=-0.003
max26.433-26.497=-0.064