Compare commits

Home / Compare 87be220f .. 518b2200

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.369-0.369=0.000
min53.908-53.922=-0.014
max55.106-55.106=0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.141-0.141=-0.001
σ0.005-0.007=-0.002
min0.134-0.133=0.001
max0.148-0.156=-0.008
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.006-0.006=-0.000
min43.384-43.385=-0.001
max43.404-43.401=0.003
mean418.000
σ0.000
min418.000
max418.000
mean0.122-0.122=0.000
σ0.004-0.003=0.000
min0.119-0.119=0.000
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.980=-0.000
σ0.882-0.870=0.012
min1006.483-1006.481=0.002
max1010.638-1010.582=0.056
mean1052.450-1048.250=4.200
σ307.788-311.486=-3.698
min578.000-577.000=1.000
max1652.000-1650.000=2.000
mean1.513-1.542=-0.029
σ0.079-0.096=-0.018
min1.348-1.460=-0.112
max1.685-1.791=-0.106

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.430-0.445=-0.015
σ0.133-0.181=-0.048
min0.344-0.346=-0.003
max0.666-0.767=-0.101
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.889-0.921=-0.032
σ0.079-0.155=-0.076
min0.840-0.830=0.010
max1.028-1.197=-0.168
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.533-0.529=0.004
σ0.048-0.046=0.003
min0.487-0.494=-0.007
max0.612-0.607=0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.850-0.839=0.011
σ0.037-0.038=-0.001
min0.816-0.802=0.013
max0.914-0.902=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.835=-0.002
σ0.022-0.030=-0.008
min964.811-964.811=0.000
max964.861-964.886=-0.025
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.837-0.785=0.052
σ0.020-0.058=-0.039
min0.818-0.708=0.110
max0.860-0.864=-0.004
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.005-0.009=-0.004
min885.504
max885.516-885.525=-0.010
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.668-0.710=-0.042
σ0.027-0.064=-0.037
min0.641-0.598=0.043
max0.708-0.755=-0.047

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean4.255-4.224=0.031
σ0.072-0.070=0.002
min4.129-4.093=0.036
max4.506-4.591=-0.085
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean4.260-4.231=0.029
σ0.097-0.069=0.028
min4.106-4.106=0.000
max4.688-4.511=0.176
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.753-0.742=0.011
σ0.017-0.025=-0.008
min0.731-0.575=0.155
max0.863-0.859=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.714-0.704=0.011
σ0.015-0.015=0.000
min0.688-0.676=0.012
max0.786-0.802=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.592-295.572=0.020
σ0.225-0.240=-0.016
min295.450-295.411=0.040
max296.211-296.235=-0.023
mean1900.000-2031.000=-131.000
σ0.000
min1900.000-2031.000=-131.000
max1900.000-2031.000=-131.000
mean0.575-0.545=0.029
σ0.046-0.029=0.017
min0.519-0.505=0.013
max0.691-0.574=0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.409=0.002
σ0.038-0.031=0.007
min285.359-285.375=-0.017
max285.448-285.442=0.006
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.387-0.386=0.001
σ0.005-0.007=-0.003
min0.382-0.380=0.002
max0.395-0.398=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.790-1295.807=-0.017
σ0.101-0.111=-0.010
min1295.674-1295.682=-0.007
max1295.904-1295.951=-0.046
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean1.951-1.893=0.057
σ0.165-0.089=0.076
min1.831-1.805=0.026
max2.226-2.023=0.203
iters=5
new-facts=6402
prior-facts=1
mean1539.935-1539.915=0.020
σ6.839-6.882=-0.043
min1536.652-1536.608=0.044
max1552.165-1552.221=-0.056
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean2.323-2.297=0.026
σ0.222-0.235=-0.013
min2.029-2.037=-0.008
max2.608-2.587=0.021
iters=5
new-facts=6402
prior-facts=6402
mean1857.701-1857.710=-0.009
σ0.053-0.048=0.004
min1857.653-1857.660=-0.006
max1857.781-1857.768=0.013
mean1777.800-1789.200=-11.400
σ122.034-165.069=-43.035
min1652.000-1650.000=2.000
max1900.000-2031.000=-131.000
mean3.100-3.037=0.063
σ0.297-0.252=0.045
min2.867-2.839=0.028
max3.615-3.461=0.153

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.412-1.305=0.108
σ0.247-0.216=0.030
min1.264-1.107=0.157
max1.848-1.628=0.220

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.934=-0.000
min155.273-155.270=0.003
max1317.143-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean0.556-0.524=0.032
σ0.594-0.537=0.057
min0.257-0.254=0.003
max1.448-1.330=0.118
policies=20
mean1552.991-1552.987=0.005
σ0.325-0.328=-0.002
min1552.767-1552.761=0.006
max1553.475-1553.474=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean2.584-2.587=-0.003
σ0.014-0.015=-0.001
min2.569-2.572=-0.003
max2.597-2.606=-0.009
policies=200
mean15538.061-15537.993=0.069
σ0.040-0.070=-0.030
min15538.018-15537.897=0.121
max15538.112-15538.064=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1650.000=2.000
σ0.000
min1652.000-1650.000=2.000
max1652.000-1650.000=2.000
mean26.146-26.155=-0.009
σ0.120-0.190=-0.071
min26.063-26.021=0.042
max26.318-26.433=-0.115