Compare commits

Home / Compare 305b462f .. 1bd4a5cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.001
σ0.368-0.371=-0.003
min53.866-53.869=-0.003
max55.063-55.070=-0.007
mean417.000-417.700=-0.700
σ0.000-0.483=-0.483
min417.000
max417.000-418.000=-1.000
mean0.139-0.139=0.000
σ0.004-0.004=-0.000
min0.135-0.136=-0.000
max0.146-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.006=-0.000
min43.315-43.312=0.003
max43.331-43.336=-0.005
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.121-0.122=-0.001
σ0.004-0.004=0.000
min0.115-0.119=-0.004
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.307=0.003
σ1.192-1.179=0.013
min1005.771-1005.768=0.004
max1011.302-1011.242=0.060
mean1047.850-1048.350=-0.500
σ315.273-313.433=1.839
min549.000-598.000=-49.000
max1529.000-1645.000=-116.000
mean1.573-1.548=0.025
σ0.089-0.082=0.008
min1.482-1.435=0.047
max1.813-1.776=0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.409-0.411=-0.003
σ0.131-0.137=-0.006
min0.328-0.335=-0.007
max0.640-0.655=-0.016
name=error_case.art
mean2.339-2.337=0.001
σ0.003-0.003=0.001
min2.336
max2.343-2.341=0.002
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.881-0.892=-0.011
σ0.092-0.095=-0.003
min0.818-0.829=-0.011
max1.042-1.059=-0.017
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.542-0.542=-0.001
σ0.056-0.054=0.002
min0.497-0.505=-0.008
max0.635-0.634=0.001
name=nested_use.art
mean2.361-2.360=0.001
σ0.002-0.002=0.001
min2.359
max2.365-2.363=0.002
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.847-0.840=0.008
σ0.033-0.027=0.006
min0.823-0.823=0.001
max0.901-0.887=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.115=-0.013
σ0.034-0.032=0.002
min964.077-964.087=-0.010
max964.162-964.167=-0.005
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.838-0.803=0.035
σ0.024-0.044=-0.021
min0.811-0.749=0.062
max0.859-0.851=0.008
name=cdr_enhanced_4k_loc.art
mean884.710-884.711=-0.002
σ0.006-0.008=-0.002
min884.703
max884.717-884.722=-0.005
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.706-0.722=-0.016
σ0.032-0.027=0.005
min0.666-0.683=-0.017
max0.740-0.754=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean4.238-4.212=0.026
σ0.081-0.075=0.005
min4.036-4.057=-0.020
max4.462-4.461=0.002
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean3.580-4.216=-0.636
σ0.159-0.074=0.085
min3.345-4.085=-0.740
max4.289-4.461=-0.173
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.734-0.736=-0.001
σ0.016-0.019=-0.003
min0.701-0.704=-0.004
max0.835-0.858=-0.024
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.698-0.694=0.004
σ0.016-0.013=0.003
min0.669-0.665=0.004
max0.771-0.763=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.238-296.142=0.096
σ0.225-0.222=0.003
min296.059-295.964=0.094
max296.822-296.742=0.079
mean1922.000-1903.000=19.000
σ0.000
min1922.000-1903.000=19.000
max1922.000-1903.000=19.000
mean0.572-0.583=-0.012
σ0.056-0.049=0.008
min0.500-0.513=-0.013
max0.688-0.692=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.701-284.692=0.009
σ0.025-0.039=-0.015
min284.671-284.642=0.029
max284.727-284.741=-0.013
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.396-0.398=-0.002
σ0.010-0.012=-0.002
min0.385-0.383=0.002
max0.405-0.409=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.092-1295.077=0.016
σ0.121-0.107=0.015
min1294.963-1294.962=0.001
max1295.258-1295.210=0.048
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean1.893-1.923=-0.030
σ0.081-0.101=-0.020
min1.810-1.806=0.004
max1.993-2.025=-0.032
iters=5
new-facts=6402
prior-facts=1
mean1539.183-1539.185=-0.002
σ6.837-6.857=-0.020
min1535.863-1535.944=-0.081
max1551.407-1551.447=-0.039
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean2.270-2.253=0.017
σ0.209-0.225=-0.016
min2.030-2.042=-0.013
max2.515-2.509=0.007
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.990=-0.005
σ0.059-0.052=0.007
min1856.929-1856.940=-0.011
max1857.069-1857.063=0.005
mean1756.800-1772.000=-15.200
σ171.522-128.183=43.338
min1529.000-1645.000=-116.000
max1922.000-1903.000=19.000
mean3.059-3.075=-0.016
σ0.306-0.274=0.032
min2.834-2.871=-0.036
max3.594-3.549=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.629-1.205=0.424
σ0.265-0.288=-0.024
min1.261-0.947=0.313
max1.911-1.680=0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.001
σ581.213-581.212=0.001
min157.175-157.176=-0.001
max1319.604-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean0.529-0.519=0.011
σ0.538-0.509=0.029
min0.258-0.263=-0.005
max1.337-1.282=0.054
policies=20
mean1572.107-1572.104=0.003
σ0.364-0.360=0.004
min1571.859-1571.858=0.000
max1572.648-1572.639=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean2.641-2.630=0.011
σ0.036-0.009=0.028
min2.610-2.622=-0.012
max2.680-2.641=0.038
policies=200
mean15729.022-15729.098=-0.076
σ0.070-0.115=-0.045
min15728.960-15729.011=-0.051
max15729.122-15729.264=-0.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1529.000-1645.000=-116.000
σ0.000
min1529.000-1645.000=-116.000
max1529.000-1645.000=-116.000
mean26.444-26.462=-0.018
σ0.076-0.051=0.025
min26.334-26.422=-0.089
max26.505-26.529=-0.024