Compare commits

Home / Compare 1edd910e .. e6974982

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.369-0.370=-0.001
min53.910-53.915=-0.005
max55.104-55.106=-0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.140-0.141=-0.001
σ0.004-0.004=-0.000
min0.137-0.138=-0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.392=0.001
σ0.006-0.007=-0.002
min43.388-43.380=0.008
max43.406-43.403=0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.120-0.120=0.001
σ0.005-0.005=-0.000
min0.114-0.115=-0.001
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.002
σ1.218-1.225=-0.007
min1006.466-1006.465=0.002
max1012.115-1012.147=-0.032
mean1050.050-1051.050=-1.000
σ319.967-308.909=11.058
min586.000-576.000=10.000
max1617.000-1648.000=-31.000
mean1.578-1.567=0.010
σ0.104-0.085=0.019
min1.485-1.486=-0.002
max1.864-1.820=0.044

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.411-0.406=0.005
σ0.127-0.109=0.018
min0.341-0.329=0.012
max0.636-0.595=0.041
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.879-0.882=-0.003
σ0.102-0.072=0.029
min0.811-0.824=-0.013
max1.057-1.003=0.054
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.554-0.567=-0.013
σ0.070-0.066=0.004
min0.483-0.513=-0.029
max0.643-0.651=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.843-0.869=-0.027
σ0.055-0.047=0.008
min0.807-0.830=-0.023
max0.938-0.940=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.033-0.035=-0.001
min964.810-964.811=-0.000
max964.894-964.896=-0.003
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.851-0.839=0.012
σ0.007-0.023=-0.016
min0.844-0.812=0.032
max0.862-0.860=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.006-0.007=-0.001
min885.506-885.505=0.000
max885.522-885.523=-0.001
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.681-0.718=-0.038
σ0.059-0.022=0.037
min0.601-0.689=-0.088
max0.741-0.740=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.723=-0.003
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean4.203-4.238=-0.035
σ0.101-0.075=0.027
min4.052-4.129=-0.077
max4.649-4.501=0.147
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean4.184-4.227=-0.042
σ0.077-0.080=-0.004
min4.061-4.079=-0.017
max4.499-4.655=-0.156
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.732-0.734=-0.002
σ0.025-0.027=-0.002
min0.552-0.703=-0.151
max0.845-0.920=-0.074
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.697-0.511=0.186
σ0.013-0.039=-0.026
min0.669-0.480=0.189
max0.761-0.804=-0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.867-297.091=-0.224
σ0.193-0.230=-0.037
min296.686-296.884=-0.198
max297.276-297.689=-0.413
mean2029.000-1902.000=127.000
σ0.000
min2029.000-1902.000=127.000
max2029.000-1902.000=127.000
mean0.573-0.577=-0.004
σ0.030-0.046=-0.016
min0.511-0.508=0.003
max0.600-0.663=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.824=-0.003
σ0.037-0.039=-0.003
min286.768-286.773=-0.005
max286.859-286.866=-0.007
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.396-0.396=0.000
σ0.008-0.008=0.000
min0.387-0.387=-0.000
max0.403-0.404=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.264-1297.269=-0.005
σ0.085-0.079=0.006
min1297.143-1297.159=-0.016
max1297.366-1297.364=0.003
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean2.157-2.168=-0.011
σ0.067-0.093=-0.026
min2.083-2.020=0.063
max2.260-2.271=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1541.360-1541.352=0.008
σ6.807-6.805=0.002
min1538.179-1538.136=0.044
max1553.534-1553.523=0.012
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean2.274-2.270=0.004
σ0.177-0.117=0.060
min2.111-2.168=-0.056
max2.547-2.458=0.089
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.115=0.001
σ0.057-0.068=-0.011
min1859.034-1859.026=0.008
max1859.184-1859.197=-0.012
mean1767.800-1775.200=-7.400
σ177.112-125.784=51.328
min1617.000-1648.000=-31.000
max2029.000-1902.000=127.000
mean2.920-3.110=-0.191
σ0.085-0.420=-0.335
min2.833-2.661=0.172
max3.032-3.761=-0.729

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.206=-0.011
σ0.301-0.336=-0.035
min0.920-0.931=-0.011
max1.550-1.768=-0.218

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.001
σ581.372-581.372=0.000
min158.134-158.135=-0.001
max1320.880-1320.880=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean0.578-0.533=0.045
σ0.621-0.535=0.086
min0.264-0.262=0.002
max1.509-1.336=0.174
policies=20
mean1581.603-1581.629=-0.026
σ0.363-0.363=0.000
min1581.361-1581.383=-0.021
max1582.144-1582.169=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean2.643-2.651=-0.008
σ0.032-0.006=0.026
min2.614-2.647=-0.033
max2.688-2.659=0.029
policies=200
mean15824.204-15824.181=0.023
σ0.156-0.110=0.046
min15824.039-15824.025=0.015
max15824.406-15824.264=0.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1617.000-1648.000=-31.000
σ0.000
min1617.000-1648.000=-31.000
max1617.000-1648.000=-31.000
mean26.767-26.775=-0.008
σ0.064-0.098=-0.034
min26.704-26.706=-0.002
max26.857-26.919=-0.062