Compare commits

Home / Compare 9b4ac967 .. 8b618000

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.001
σ0.369-0.367=0.001
min53.909-53.917=-0.008
max55.105-55.102=0.003
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.140-0.139=0.001
σ0.003-0.003=-0.000
min0.137-0.136=0.001
max0.145-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.006-0.006=0.000
min43.384-43.385=-0.001
max43.407-43.404=0.004
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.119-0.123=-0.003
σ0.005-0.004=0.001
min0.114-0.117=-0.003
max0.127-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.985-1006.979=0.006
σ0.851-0.866=-0.014
min1006.483-1006.505=-0.022
max1010.486-1010.558=-0.072
mean1045.950-1053.650=-7.700
σ312.758-319.689=-6.931
min577.000
max1635.000-1621.000=14.000
mean1.538-1.542=-0.004
σ0.094-0.124=-0.030
min1.459-1.454=0.005
max1.811-2.044=-0.234

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.412-0.409=0.003
σ0.121-0.098=0.023
min0.328-0.341=-0.013
max0.626-0.581=0.045
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.916-0.886=0.030
σ0.087-0.092=-0.005
min0.826-0.807=0.019
max1.018-1.044=-0.026
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.534-0.536=-0.002
σ0.056-0.057=-0.001
min0.492-0.479=0.014
max0.630-0.625=0.005
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.859-0.841=0.018
σ0.040-0.043=-0.003
min0.825-0.809=0.016
max0.927-0.914=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.834-964.831=0.003
σ0.030-0.025=0.005
min964.802-964.803=-0.001
max964.881-964.859=0.022
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.848-0.814=0.034
σ0.022-0.051=-0.029
min0.808-0.734=0.075
max0.859-0.859=0.000
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.004-0.008=-0.004
min885.508-885.504=0.004
max885.519-885.523=-0.005
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.714-0.734=-0.020
σ0.056-0.022=0.034
min0.615-0.695=-0.081
max0.747-0.749=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.002
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean4.154-4.240=-0.086
σ0.174-0.087=0.087
min3.503-4.105=-0.602
max4.381-4.522=-0.142
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean4.211-4.215=-0.003
σ0.075-0.085=-0.010
min4.073-4.067=0.006
max4.472-4.495=-0.023
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.747-0.742=0.005
σ0.016-0.016=-0.001
min0.720-0.708=0.013
max0.853-0.844=0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.710-0.704=0.005
σ0.015-0.013=0.002
min0.676-0.680=-0.004
max0.788-0.773=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.622-295.515=0.107
σ0.213-0.247=-0.034
min295.469-295.327=0.142
max296.176-296.137=0.039
mean1912.000-1941.000=-29.000
σ0.000
min1912.000-1941.000=-29.000
max1912.000-1941.000=-29.000
mean0.576-0.587=-0.011
σ0.061-0.034=0.027
min0.497-0.541=-0.045
max0.691-0.657=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.404=0.006
σ0.038-0.039=-0.000
min285.358-285.361=-0.003
max285.449-285.446=0.003
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.392-0.393=-0.001
σ0.009-0.005=0.003
min0.382-0.384=-0.001
max0.403-0.397=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.799-1295.793=0.006
σ0.114-0.104=0.010
min1295.665-1295.673=-0.008
max1295.945-1295.932=0.013
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean1.984-1.890=0.094
σ0.265-0.084=0.180
min1.795-1.795=0.000
max2.444-1.969=0.475
iters=5
new-facts=6402
prior-facts=1
mean1539.934-1539.941=-0.007
σ6.868-6.859=0.009
min1536.619-1536.686=-0.067
max1552.214-1552.209=0.006
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean2.333-2.132=0.201
σ0.182-0.178=0.004
min2.038-1.952=0.086
max2.488-2.421=0.067
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.707=0.003
σ0.054-0.061=-0.007
min1857.653-1857.645=0.008
max1857.783-1857.779=0.003
mean1773.400-1784.400=-11.000
σ135.129-154.343=-19.214
min1635.000-1621.000=14.000
max1912.000-1941.000=-29.000
mean3.082-2.971=0.111
σ0.300-0.075=0.225
min2.851-2.882=-0.031
max3.584-3.074=0.510

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.325-1.405=-0.080
σ0.210-0.272=-0.062
min1.110-1.105=0.006
max1.676-1.769=-0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=-0.001
σ580.934-580.934=-0.000
min155.271-155.270=0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean0.544-0.538=0.006
σ0.571-0.554=0.017
min0.257-0.259=-0.002
max1.401-1.369=0.032
policies=20
mean1552.974-1552.991=-0.017
σ0.329-0.330=-0.000
min1552.751-1552.762=-0.011
max1553.463-1553.480=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean2.590-2.593=-0.004
σ0.012-0.019=-0.006
min2.578-2.574=0.003
max2.602-2.615=-0.013
policies=200
mean15537.883-15538.048=-0.165
σ0.088-0.086=0.003
min15537.811-15537.935=-0.124
max15537.999-15538.140=-0.141
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1621.000=14.000
σ0.000
min1635.000-1621.000=14.000
max1635.000-1621.000=14.000
mean26.132-26.226=-0.093
σ0.121-0.234=-0.113
min26.012-26.093=-0.081
max26.301-26.574=-0.274