Compare commits

Home / Compare f2da90d1 .. 399d96bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.000
σ0.367-0.369=-0.001
min53.917-53.922=-0.005
max55.102-55.106=-0.003
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.139-0.141=-0.002
σ0.003-0.007=-0.003
min0.136-0.133=0.003
max0.144-0.156=-0.012
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.006-0.006=0.000
min43.385-43.385=-0.000
max43.404-43.401=0.003
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.123-0.122=0.000
σ0.004-0.003=0.001
min0.117-0.119=-0.002
max0.130-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.980=-0.001
σ0.866-0.870=-0.004
min1006.505-1006.481=0.024
max1010.558-1010.582=-0.024
mean1053.650-1048.250=5.400
σ319.689-311.486=8.203
min577.000
max1621.000-1650.000=-29.000
mean1.542-1.542=0.001
σ0.124-0.096=0.028
min1.454-1.460=-0.006
max2.044-1.791=0.254

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.409-0.445=-0.037
σ0.098-0.181=-0.083
min0.341-0.346=-0.005
max0.581-0.767=-0.186
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.886-0.921=-0.035
σ0.092-0.155=-0.063
min0.807-0.830=-0.023
max1.044-1.197=-0.152
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.536-0.529=0.006
σ0.057-0.046=0.011
min0.479-0.494=-0.016
max0.625-0.607=0.018
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.841-0.839=0.001
σ0.043-0.038=0.005
min0.809-0.802=0.007
max0.914-0.902=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.025-0.030=-0.005
min964.803-964.811=-0.008
max964.859-964.886=-0.027
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.814-0.785=0.028
σ0.051-0.058=-0.008
min0.734-0.708=0.026
max0.859-0.864=-0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.008-0.009=-0.000
min885.504
max885.523-885.525=-0.002
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.734-0.710=0.024
σ0.022-0.064=-0.042
min0.695-0.598=0.097
max0.749-0.755=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean4.240-4.224=0.016
σ0.087-0.070=0.018
min4.105-4.093=0.012
max4.522-4.591=-0.069
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean4.215-4.231=-0.017
σ0.085-0.069=0.015
min4.067-4.106=-0.039
max4.495-4.511=-0.016
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.742-0.742=0.000
σ0.016-0.025=-0.008
min0.708-0.575=0.132
max0.844-0.859=-0.015
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.704-0.704=0.001
σ0.013-0.015=-0.001
min0.680-0.676=0.004
max0.773-0.802=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-295.572=-0.056
σ0.247-0.240=0.007
min295.327-295.411=-0.083
max296.137-296.235=-0.098
mean1941.000-2031.000=-90.000
σ0.000
min1941.000-2031.000=-90.000
max1941.000-2031.000=-90.000
mean0.587-0.545=0.042
σ0.034-0.029=0.005
min0.541-0.505=0.036
max0.657-0.574=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-285.409=-0.005
σ0.039-0.031=0.008
min285.361-285.375=-0.014
max285.446-285.442=0.004
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.393-0.386=0.006
σ0.005-0.007=-0.002
min0.384-0.380=0.003
max0.397-0.398=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.807=-0.014
σ0.104-0.111=-0.007
min1295.673-1295.682=-0.009
max1295.932-1295.951=-0.018
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean1.890-1.893=-0.003
σ0.084-0.089=-0.005
min1.795-1.805=-0.010
max1.969-2.023=-0.054
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.915=0.026
σ6.859-6.882=-0.023
min1536.686-1536.608=0.078
max1552.209-1552.221=-0.013
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean2.132-2.297=-0.165
σ0.178-0.235=-0.057
min1.952-2.037=-0.085
max2.421-2.587=-0.166
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.710=-0.003
σ0.061-0.048=0.013
min1857.645-1857.660=-0.015
max1857.779-1857.768=0.011
mean1784.400-1789.200=-4.800
σ154.343-165.069=-10.726
min1621.000-1650.000=-29.000
max1941.000-2031.000=-90.000
mean2.971-3.037=-0.067
σ0.075-0.252=-0.176
min2.882-2.839=0.043
max3.074-3.461=-0.387

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.305=0.101
σ0.272-0.216=0.056
min1.105-1.107=-0.002
max1.769-1.628=0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=-0.000
σ580.934-580.934=-0.000
min155.270-155.270=0.000
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean0.538-0.524=0.014
σ0.554-0.537=0.017
min0.259-0.254=0.004
max1.369-1.330=0.039
policies=20
mean1552.991-1552.987=0.004
σ0.330-0.328=0.002
min1552.762-1552.761=0.001
max1553.480-1553.474=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean2.593-2.587=0.007
σ0.019-0.015=0.003
min2.574-2.572=0.002
max2.615-2.606=0.009
policies=200
mean15538.048-15537.993=0.055
σ0.086-0.070=0.015
min15537.935-15537.897=0.038
max15538.140-15538.064=0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1650.000=-29.000
σ0.000
min1621.000-1650.000=-29.000
max1621.000-1650.000=-29.000
mean26.226-26.155=0.071
σ0.234-0.190=0.043
min26.093-26.021=0.071
max26.574-26.433=0.141