Compare commits

Home / Compare 352bcc4b .. 44de26dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.056=-0.011
σ0.370-0.369=0.001
min53.900-53.922=-0.022
max55.097-55.106=-0.009
mean414.700-418.000=-3.300
σ0.483-0.000=0.483
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.140-0.141=-0.001
σ0.003-0.007=-0.004
min0.137-0.133=0.004
max0.146-0.156=-0.010
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.010
σ0.007-0.006=0.001
min43.371-43.385=-0.014
max43.396-43.401=-0.005
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.122=-0.001
σ0.004-0.003=0.001
min0.116-0.119=-0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.980=-0.001
σ0.864-0.870=-0.006
min1006.508-1006.481=0.027
max1010.554-1010.582=-0.029
mean1052.700-1048.250=4.450
σ319.840-311.486=8.354
min576.000-577.000=-1.000
max1620.000-1650.000=-30.000
mean1.563-1.542=0.021
σ0.129-0.096=0.033
min1.479-1.460=0.019
max2.084-1.791=0.294

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.438-0.445=-0.007
σ0.182-0.181=0.001
min0.337-0.346=-0.010
max0.762-0.767=-0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.913-0.921=-0.009
σ0.145-0.155=-0.010
min0.825-0.830=-0.004
max1.169-1.197=-0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.544-0.529=0.014
σ0.042-0.046=-0.004
min0.512-0.494=0.018
max0.615-0.607=0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.850-0.839=0.011
σ0.029-0.038=-0.009
min0.822-0.802=0.020
max0.895-0.902=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.003
σ0.025-0.030=-0.005
min964.802-964.811=-0.009
max964.862-964.886=-0.024
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.803-0.785=0.018
σ0.019-0.058=-0.039
min0.772-0.708=0.064
max0.821-0.864=-0.043
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=-0.000
σ0.005-0.009=-0.004
min885.505-885.504=0.001
max885.518-885.525=-0.007
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.707-0.710=-0.003
σ0.044-0.064=-0.020
min0.646-0.598=0.048
max0.746-0.755=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean4.251-4.224=0.027
σ0.088-0.070=0.018
min4.086-4.093=-0.007
max4.524-4.591=-0.067
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean4.256-4.231=0.025
σ0.088-0.069=0.019
min4.096-4.106=-0.009
max4.660-4.511=0.149
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.653-0.742=-0.088
σ0.105-0.025=0.080
min0.519-0.575=-0.057
max0.887-0.859=0.027
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.511-0.704=-0.193
σ0.028-0.015=0.013
min0.481-0.676=-0.195
max0.752-0.802=-0.050

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.651-295.572=0.080
σ0.231-0.240=-0.010
min295.496-295.411=0.085
max296.283-296.235=0.048
mean1924.000-2031.000=-107.000
σ0.000
min1924.000-2031.000=-107.000
max1924.000-2031.000=-107.000
mean0.586-0.545=0.041
σ0.025-0.029=-0.004
min0.538-0.505=0.033
max0.636-0.574=0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.409=0.004
σ0.036-0.031=0.005
min285.371-285.375=-0.004
max285.455-285.442=0.013
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.395-0.386=0.009
σ0.007-0.007=-0.001
min0.388-0.380=0.008
max0.404-0.398=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.807=-0.010
σ0.114-0.111=0.003
min1295.667-1295.682=-0.015
max1295.931-1295.951=-0.019
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean1.882-1.893=-0.011
σ0.064-0.089=-0.025
min1.824-1.805=0.018
max1.978-2.023=-0.045
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.915=0.009
σ6.875-6.882=-0.008
min1536.635-1536.608=0.027
max1552.218-1552.221=-0.003
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean2.267-2.297=-0.030
σ0.255-0.235=0.019
min2.050-2.037=0.013
max2.666-2.587=0.079
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.710=-0.001
σ0.053-0.048=0.005
min1857.645-1857.660=-0.014
max1857.775-1857.768=0.007
mean1779.800-1789.200=-9.400
σ145.819-165.069=-19.250
min1620.000-1650.000=-30.000
max1924.000-2031.000=-107.000
mean3.128-3.037=0.091
σ0.310-0.252=0.058
min2.857-2.839=0.018
max3.656-3.461=0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.385-1.305=0.081
σ0.200-0.216=-0.016
min1.257-1.107=0.151
max1.733-1.628=0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=-0.000
σ580.934-580.934=-0.000
min155.271-155.270=0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean0.556-0.524=0.031
σ0.597-0.537=0.060
min0.255-0.254=0.001
max1.451-1.330=0.122
policies=20
mean1552.990-1552.987=0.003
σ0.327-0.328=-0.001
min1552.763-1552.761=0.002
max1553.475-1553.474=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean2.583-2.587=-0.004
σ0.013-0.015=-0.002
min2.573-2.572=0.001
max2.601-2.606=-0.005
policies=200
mean15537.960-15537.993=-0.032
σ0.096-0.070=0.025
min15537.859-15537.897=-0.038
max15538.051-15538.064=-0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1650.000=-30.000
σ0.000
min1620.000-1650.000=-30.000
max1620.000-1650.000=-30.000
mean26.286-26.155=0.131
σ0.032-0.190=-0.159
min26.248-26.021=0.227
max26.317-26.433=-0.116