Compare commits

Home / Compare 1e8968b4 .. a586f647

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.371-0.368=0.003
min53.916-53.914=0.002
max55.110-55.103=0.008
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.139-0.141=-0.003
σ0.004-0.004=-0.001
min0.135-0.135=0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.008-0.006=0.002
min43.379-43.387=-0.008
max43.410-43.405=0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.123=-0.002
σ0.005-0.002=0.002
min0.114-0.120=-0.006
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.024-1007.024=-0.000
σ1.174-1.187=-0.013
min1006.448-1006.453=-0.005
max1011.937-1011.998=-0.061
mean1054.800-1048.900=5.900
σ316.784-310.255=6.530
min560.000-562.000=-2.000
max1619.000-1629.000=-10.000
mean1.530-1.541=-0.011
σ0.051-0.078=-0.027
min1.469-1.468=0.001
max1.639-1.810=-0.171

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.003=-0.001
min0.882
max0.887-0.889=-0.002
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.430-0.421=0.009
σ0.140-0.127=0.014
min0.351-0.344=0.007
max0.680-0.645=0.035
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.887-0.899=-0.012
σ0.087-0.093=-0.006
min0.827-0.825=0.003
max1.040-1.054=-0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.541-0.544=-0.004
σ0.047-0.055=-0.008
min0.506-0.503=0.003
max0.621-0.640=-0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.854-0.861=-0.007
σ0.036-0.039=-0.004
min0.829-0.827=0.002
max0.917-0.925=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.831=-0.001
σ0.024-0.024=0.000
min964.802-964.803=-0.001
max964.861-964.861=-0.000
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.846-0.858=-0.012
σ0.032-0.017=0.015
min0.790-0.828=-0.038
max0.871-0.871=0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.009-0.008=0.001
min885.504
max885.524-885.524=0.000
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.717-0.730=-0.013
σ0.050-0.014=0.037
min0.628-0.709=-0.082
max0.750-0.740=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean4.266-4.313=-0.047
σ0.075-0.071=0.004
min4.100-4.170=-0.070
max4.574-4.661=-0.087
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean4.249-4.287=-0.038
σ0.083-0.054=0.029
min4.082-4.190=-0.108
max4.503-4.456=0.047
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.743-0.765=-0.022
σ0.028-0.036=-0.008
min0.701-0.723=-0.023
max0.933-1.000=-0.067
name=record_render_syntax_err.art
mean2.166-2.166=-0.000
σ0.002-0.002=-0.000
min2.165
max2.169-2.170=-0.001
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.699-0.730=-0.031
σ0.031-0.015=0.016
min0.505-0.692=-0.188
max0.761-0.808=-0.046

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.902-297.172=-0.270
σ0.238-0.209=0.030
min296.772-297.014=-0.242
max297.573-297.742=-0.169
mean2034.000-2019.000=15.000
σ0.000
min2034.000-2019.000=15.000
max2034.000-2019.000=15.000
mean0.577-0.551=0.027
σ0.034-0.030=0.003
min0.506-0.508=-0.002
max0.600-0.581=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.836-286.841=-0.004
σ0.039-0.041=-0.002
min286.782-286.788=-0.006
max286.874-286.881=-0.008
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.396-0.398=-0.001
σ0.007-0.008=-0.002
min0.389-0.388=0.000
max0.402-0.408=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.209-1297.291=-0.082
σ0.119-0.100=0.019
min1297.105-1297.193=-0.088
max1297.399-1297.436=-0.037
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean1.971-2.003=-0.032
σ0.231-0.027=0.204
min1.791-1.974=-0.183
max2.361-2.048=0.314
iters=5
new-facts=6402
prior-facts=1
mean1541.342-1541.349=-0.006
σ6.824-6.858=-0.034
min1538.112-1538.081=0.032
max1553.547-1553.612=-0.065
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean2.198-2.296=-0.098
σ0.107-0.151=-0.044
min2.114-2.158=-0.044
max2.368-2.542=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean1859.139-1859.118=0.020
σ0.052-0.077=-0.025
min1859.075-1858.994=0.081
max1859.204-1859.188=0.015
mean1778.200-1763.400=14.800
σ181.449-168.377=13.072
min1619.000-1629.000=-10.000
max2034.000-2019.000=15.000
mean3.006-2.886=0.120
σ0.294-0.214=0.080
min2.849-2.561=0.288
max3.529-3.104=0.425

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.365-1.366=-0.000
σ0.207-0.278=-0.071
min1.106-1.110=-0.004
max1.669-1.842=-0.173

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.855-448.853=0.002
σ581.372-581.373=-0.000
min158.168-158.165=0.003
max1320.914-1320.912=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean0.549-0.540=0.009
σ0.569-0.549=0.020
min0.261-0.264=-0.003
max1.403-1.363=0.040
policies=20
mean1581.963-1581.963=-0.001
σ0.356-0.360=-0.004
min1581.722-1581.719=0.003
max1582.492-1582.498=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean2.636-2.629=0.007
σ0.022-0.015=0.006
min2.618-2.612=0.006
max2.667-2.649=0.018
policies=200
mean15827.617-15827.606=0.011
σ0.119-0.094=0.025
min15827.536-15827.530=0.005
max15827.791-15827.744=0.047
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1629.000=-10.000
σ0.000
min1619.000-1629.000=-10.000
max1619.000-1629.000=-10.000
mean26.702-26.603=0.099
σ0.108-0.053=0.055
min26.600-26.551=0.049
max26.855-26.678=0.177