Compare commits

Home / Compare e36d0309 .. 00c3c1d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.000
σ0.368-0.367=0.001
min53.918-53.917=0.001
max55.105-55.102=0.002
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.146-0.139=0.007
σ0.011-0.003=0.008
min0.134-0.136=-0.002
max0.168-0.144=0.023
cache=y
dps=1
iters=10
policies=100
mean43.396-43.395=0.001
σ0.009-0.006=0.003
min43.387-43.385=0.002
max43.410-43.404=0.006
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.130-0.123=0.007
σ0.011-0.004=0.007
min0.116-0.117=-0.001
max0.148-0.130=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.975-1006.979=-0.003
σ0.943-0.866=0.077
min1006.508-1006.505=0.003
max1010.905-1010.558=0.347
mean1050.800-1053.650=-2.850
σ307.841-319.689=-11.848
min575.000-577.000=-2.000
max1643.000-1621.000=22.000
mean1.568-1.542=0.025
σ0.156-0.124=0.032
min1.460-1.454=0.006
max2.094-2.044=0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.414-0.409=0.006
σ0.130-0.098=0.032
min0.337-0.341=-0.005
max0.645-0.581=0.064
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.886-0.886=-0.000
σ0.076-0.092=-0.016
min0.845-0.807=0.037
max1.020-1.044=-0.024
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.001
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.538-0.536=0.003
σ0.047-0.057=-0.010
min0.511-0.479=0.033
max0.622-0.625=-0.003
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.844-0.841=0.004
σ0.039-0.043=-0.004
min0.813-0.809=0.004
max0.913-0.914=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.831=-0.000
σ0.025-0.025=0.001
min964.802-964.803=-0.001
max964.864-964.859=0.004
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.814-0.814=0.000
σ0.029-0.051=-0.022
min0.771-0.734=0.037
max0.852-0.859=-0.007
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.004-0.008=-0.004
min885.508-885.504=0.004
max885.518-885.523=-0.005
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.719-0.734=-0.015
σ0.041-0.022=0.018
min0.649-0.695=-0.046
max0.752-0.749=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean3.512-4.240=-0.728
σ0.099-0.087=0.011
min3.401-4.105=-0.704
max4.129-4.522=-0.393
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean4.157-4.215=-0.058
σ0.244-0.085=0.159
min3.453-4.067=-0.614
max4.580-4.495=0.085
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.743-0.742=0.001
σ0.027-0.016=0.010
min0.544-0.708=-0.164
max0.852-0.844=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.707-0.704=0.003
σ0.018-0.013=0.005
min0.677-0.680=-0.003
max0.801-0.773=0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.456-295.515=-0.059
σ0.232-0.247=-0.015
min295.275-295.327=-0.053
max296.068-296.137=-0.069
mean1907.000-1941.000=-34.000
σ0.000
min1907.000-1941.000=-34.000
max1907.000-1941.000=-34.000
mean0.582-0.587=-0.006
σ0.033-0.034=-0.001
min0.531-0.541=-0.010
max0.613-0.657=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.404=0.007
σ0.037-0.039=-0.002
min285.356-285.361=-0.005
max285.445-285.446=-0.001
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.399-0.393=0.007
σ0.009-0.005=0.004
min0.391-0.384=0.008
max0.411-0.397=0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.793=0.001
σ0.106-0.104=0.002
min1295.668-1295.673=-0.005
max1295.924-1295.932=-0.009
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean1.885-1.890=-0.006
σ0.070-0.084=-0.015
min1.816-1.795=0.021
max1.978-1.969=0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.941=-0.000
σ6.907-6.859=0.048
min1536.623-1536.686=-0.063
max1552.291-1552.209=0.082
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean2.366-2.132=0.234
σ0.300-0.178=0.121
min2.067-1.952=0.115
max2.678-2.421=0.257
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.707=-0.000
σ0.052-0.061=-0.009
min1857.654-1857.645=0.009
max1857.777-1857.779=-0.002
mean1776.000-1784.400=-8.400
σ130.050-154.343=-24.293
min1643.000-1621.000=22.000
max1907.000-1941.000=-34.000
mean3.021-2.971=0.051
σ0.212-0.075=0.137
min2.832-2.882=-0.050
max3.365-3.074=0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.362-1.405=-0.043
σ0.278-0.272=0.006
min1.114-1.105=0.009
max1.840-1.769=0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.740=-0.001
σ580.933-580.934=-0.001
min155.272-155.270=0.002
max1317.139-1317.142=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.552-0.538=0.014
σ0.582-0.554=0.028
min0.260-0.259=0.001
max1.425-1.369=0.056
policies=20
mean1552.988-1552.991=-0.003
σ0.324-0.330=-0.006
min1552.767-1552.762=0.005
max1553.469-1553.480=-0.011
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean2.583-2.593=-0.011
σ0.016-0.019=-0.002
min2.571-2.574=-0.004
max2.607-2.615=-0.008
policies=200
mean15537.963-15538.048=-0.085
σ0.167-0.086=0.082
min15537.833-15537.935=-0.102
max15538.203-15538.140=0.064
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean26.113-26.226=-0.113
σ0.049-0.234=-0.184
min26.064-26.093=-0.029
max26.176-26.574=-0.398