Compare commits

Home / Compare c3034a81 .. dc0a58f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.044-54.046=-0.002
σ0.368-0.370=-0.002
min53.902-53.907=-0.005
max55.092-55.099=-0.007
mean415.000-417.800=-2.800
σ0.000-0.422=-0.422
min415.000-417.000=-2.000
max415.000-418.000=-3.000
mean0.135-0.137=-0.002
σ0.005-0.005=0.001
min0.129-0.131=-0.002
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.007-0.006=0.001
min43.376-43.375=0.001
max43.399-43.397=0.002
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.121-0.123=-0.002
σ0.005-0.003=0.001
min0.115-0.119=-0.005
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.979=0.001
σ0.871-0.867=0.004
min1006.491-1006.479=0.011
max1010.580-1010.563=0.016
mean1043.650-1049.800=-6.150
σ314.008-313.735=0.274
min574.000-580.000=-6.000
max1638.000-1647.000=-9.000
mean1.565-1.548=0.017
σ0.087-0.071=0.016
min1.481-1.480=0.002
max1.841-1.769=0.072

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.882
max0.887
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.413-0.413=-0.001
σ0.137-0.139=-0.002
min0.330-0.331=-0.000
max0.654-0.660=-0.006
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.870-0.886=-0.015
σ0.094-0.089=0.005
min0.806-0.831=-0.025
max1.034-1.042=-0.008
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.001=0.000
min1.522
max1.525
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.531-0.532=-0.000
σ0.048-0.056=-0.008
min0.499-0.492=0.007
max0.615-0.628=-0.013
name=nested_use.art
mean2.362-2.362=-0.001
σ0.002-0.003=-0.001
min2.360
max2.364-2.366=-0.002
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.845-0.852=-0.007
σ0.045-0.057=-0.012
min0.807-0.797=0.010
max0.921-0.920=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.833=0.003
σ0.031-0.030=0.001
min964.811-964.802=0.009
max964.889-964.878=0.011
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.804-0.823=-0.019
σ0.043-0.028=0.015
min0.765-0.786=-0.021
max0.854-0.854=-0.001
name=cdr_enhanced_4k_loc.art
mean885.514-885.515=-0.001
σ0.007-0.005=0.003
min885.504-885.508=-0.004
max885.521-885.520=0.001
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.661-0.722=-0.062
σ0.054-0.020=0.034
min0.604-0.689=-0.086
max0.734-0.742=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean4.205-4.189=0.016
σ0.067-0.073=-0.006
min4.076-4.057=0.020
max4.401-4.535=-0.134
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean4.226-4.192=0.034
σ0.103-0.075=0.028
min4.050-4.045=0.005
max4.485-4.407=0.078
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.745-0.739=0.007
σ0.037-0.016=0.021
min0.524-0.702=-0.178
max0.924-0.835=0.089
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.700-0.694=0.006
σ0.015-0.012=0.002
min0.673-0.671=0.002
max0.763-0.742=0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.483-295.614=-0.131
σ0.249-0.228=0.021
min295.335-295.460=-0.125
max296.177-296.241=-0.064
mean2013.000-1903.000=110.000
σ0.000
min2013.000-1903.000=110.000
max2013.000-1903.000=110.000
mean0.564-0.582=-0.018
σ0.040-0.053=-0.013
min0.517-0.510=0.007
max0.609-0.696=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.410=0.001
σ0.039-0.039=-0.000
min285.359-285.356=0.002
max285.450-285.448=0.002
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.386-0.390=-0.004
σ0.007-0.007=-0.001
min0.380-0.383=-0.003
max0.393-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.796=0.000
σ0.107-0.111=-0.004
min1295.668-1295.677=-0.009
max1295.924-1295.933=-0.009
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean1.892-1.910=-0.018
σ0.068-0.094=-0.026
min1.829-1.812=0.017
max1.986-2.034=-0.048
iters=5
new-facts=6402
prior-facts=1
mean1539.977-1539.916=0.061
σ6.833-6.871=-0.038
min1536.636-1536.665=-0.029
max1552.194-1552.203=-0.009
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean2.428-2.220=0.208
σ0.243-0.171=0.072
min2.023-2.053=-0.029
max2.662-2.404=0.259
iters=5
new-facts=6402
prior-facts=6402
mean1857.703-1857.714=-0.012
σ0.060-0.057=0.003
min1857.645-1857.656=-0.011
max1857.780-1857.796=-0.015
mean1777.800-1779.400=-1.600
σ162.167-123.664=38.503
min1638.000-1647.000=-9.000
max2013.000-1903.000=110.000
mean3.091-2.980=0.111
σ0.276-0.196=0.079
min2.842-2.734=0.108
max3.518-3.253=0.265

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.320-1.337=-0.018
σ0.230-0.200=0.030
min1.105-1.095=0.010
max1.710-1.639=0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.001
σ580.934-580.934=0.000
min155.271-155.273=-0.001
max1317.140-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.540-0.533=0.007
σ0.565-0.559=0.007
min0.255-0.251=0.004
max1.388-1.372=0.017
policies=20
mean1552.973-1552.995=-0.022
σ0.331-0.342=-0.011
min1552.746-1552.762=-0.016
max1553.464-1553.503=-0.039
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean2.591-2.606=-0.015
σ0.015-0.023=-0.008
min2.578-2.576=0.002
max2.610-2.630=-0.020
policies=200
mean15537.970-15538.040=-0.070
σ0.129-0.071=0.057
min15537.804-15537.973=-0.169
max15538.087-15538.106=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean26.134-26.277=-0.142
σ0.129-0.139=-0.010
min26.026-26.151=-0.125
max26.320-26.463=-0.143