Compare commits

Home / Compare 7ebd057c .. bcc28777

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.963=0.092
σ0.370-0.369=0.001
min53.913-53.819=0.094
max55.109-55.013=0.096
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.140-0.138=0.003
σ0.003-0.005=-0.001
min0.136-0.131=0.005
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.005-0.004=0.001
min43.386-43.317=0.069
max43.403-43.328=0.075
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.122-0.121=0.001
σ0.004-0.004=0.000
min0.118-0.113=0.005
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1006.514=0.490
σ1.188-1.198=-0.010
min1006.432-1005.961=0.471
max1011.983-1011.533=0.450
mean1055.550-1052.250=3.300
σ307.773-312.363=-4.590
min581.000-555.000=26.000
max1647.000-1516.000=131.000
mean1.550-1.530=0.019
σ0.075-0.071=0.004
min1.469-1.470=-0.000
max1.782-1.764=0.017

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.413-0.433=-0.020
σ0.145-0.176=-0.031
min0.333-0.328=0.005
max0.671-0.746=-0.075
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.873-0.911=-0.038
σ0.096-0.166=-0.071
min0.814-0.815=-0.001
max1.043-1.206=-0.163
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.534-0.535=-0.001
σ0.049-0.051=-0.002
min0.501-0.490=0.011
max0.619-0.620=-0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.843-0.835=0.009
σ0.044-0.043=0.001
min0.803-0.798=0.005
max0.916-0.908=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.831=0.009
σ0.032-0.024=0.009
min964.812-964.813=-0.001
max964.892-964.869=0.024
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.835-0.809=0.025
σ0.025-0.038=-0.013
min0.811-0.752=0.059
max0.862-0.858=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.005=0.002
min885.504
max885.522-885.514=0.008
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.728-0.697=0.030
σ0.031-0.020=0.011
min0.674-0.676=-0.002
max0.754-0.720=0.034

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean3.558-4.207=-0.649
σ0.123-0.081=0.042
min3.400-4.088=-0.689
max4.593-4.507=0.086
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean3.511-4.024=-0.513
σ0.071-0.334=-0.263
min3.391-3.403=-0.012
max3.812-4.693=-0.881
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.740-0.735=0.005
σ0.018-0.026=-0.008
min0.708-0.597=0.111
max0.862-0.837=0.025
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.704-0.697=0.007
σ0.016-0.013=0.002
min0.677-0.670=0.007
max0.778-0.748=0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.029-296.337=0.692
σ0.253-0.282=-0.029
min296.866-296.096=0.770
max297.729-297.094=0.635
mean1958.000-1911.000=47.000
σ0.000
min1958.000-1911.000=47.000
max1958.000-1911.000=47.000
mean0.561-0.594=-0.033
σ0.032-0.034=-0.002
min0.510-0.552=-0.042
max0.612-0.680=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.807-285.031=1.776
σ0.036-0.037=-0.001
min286.764-284.981=1.783
max286.854-285.075=1.780
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.396-0.394=0.002
σ0.006-0.010=-0.004
min0.392-0.385=0.006
max0.403-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.259-1295.409=1.849
σ0.125-0.108=0.017
min1297.074-1295.299=1.775
max1297.411-1295.561=1.850
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean2.195-1.926=0.268
σ0.097-0.098=-0.001
min2.053-1.819=0.233
max2.318-2.042=0.276
iters=5
new-facts=6402
prior-facts=1
mean1541.381-1539.545=1.836
σ6.806-6.825=-0.019
min1538.238-1536.303=1.935
max1553.555-1551.752=1.803
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean2.348-2.137=0.211
σ0.271-0.141=0.130
min2.143-2.014=0.130
max2.800-2.377=0.424
iters=5
new-facts=6402
prior-facts=6402
mean1859.110-1857.321=1.789
σ0.067-0.065=0.002
min1859.030-1857.236=1.794
max1859.191-1857.396=1.795
mean1796.400-1756.200=40.200
σ156.097-171.530=-15.433
min1647.000-1516.000=131.000
max1958.000-1911.000=47.000
mean2.990-3.090=-0.100
σ0.157-0.255=-0.098
min2.830-2.879=-0.049
max3.221-3.519=-0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.496=-0.260
σ0.360-0.328=0.032
min0.931-1.066=-0.135
max1.843-1.840=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.191=0.631
σ581.373-581.331=0.042
min158.134-157.524=0.610
max1320.882-1320.187=0.694
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean0.569-0.536=0.032
σ0.599-0.547=0.052
min0.263-0.261=0.002
max1.468-1.356=0.111
policies=20
mean1581.629-1575.570=6.058
σ0.363-0.355=0.009
min1581.387-1575.329=6.058
max1582.169-1576.098=6.072
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean2.643-2.631=0.011
σ0.018-0.021=-0.003
min2.627-2.607=0.020
max2.665-2.655=0.010
policies=200
mean15824.163-15763.769=60.394
σ0.094-0.081=0.013
min15824.056-15763.690=60.366
max15824.248-15763.876=60.372
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1516.000=131.000
σ0.000
min1647.000-1516.000=131.000
max1647.000-1516.000=131.000
mean26.646-26.522=0.124
σ0.064-0.025=0.039
min26.571-26.485=0.085
max26.719-26.543=0.176