Compare commits

Home / Compare 261a7164 .. 8c0d2cfe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.054=0.003
σ0.367-0.370=-0.002
min53.917-53.906=0.011
max55.102-55.106=-0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.139-0.137=0.002
σ0.003-0.005=-0.002
min0.136-0.129=0.007
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.002
σ0.006-0.006=-0.000
min43.385-43.384=0.000
max43.404-43.401=0.003
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.123-0.120=0.003
σ0.004-0.005=-0.000
min0.117-0.114=0.003
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.980=-0.002
σ0.866-0.913=-0.047
min1006.505-1006.504=0.001
max1010.558-1010.776=-0.218
mean1053.650-1046.250=7.400
σ319.689-305.874=13.814
min577.000-571.000=6.000
max1621.000-1636.000=-15.000
mean1.542-1.571=-0.028
σ0.124-0.122=0.002
min1.454-1.472=-0.018
max2.044-1.933=0.111

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.409-0.419=-0.011
σ0.098-0.138=-0.040
min0.341-0.331=0.011
max0.581-0.662=-0.081
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.886-0.879=0.007
σ0.092-0.092=0.000
min0.807-0.822=-0.015
max1.044-1.040=0.004
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.536-0.544=-0.009
σ0.057-0.053=0.004
min0.479-0.497=-0.018
max0.625-0.635=-0.010
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.841-0.852=-0.012
σ0.043-0.043=-0.000
min0.809-0.810=-0.001
max0.914-0.915=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.025-0.031=-0.007
min964.803-964.810=-0.007
max964.859-964.889=-0.030
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.814-0.799=0.015
σ0.051-0.058=-0.007
min0.734-0.735=-0.002
max0.859-0.855=0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.008-0.004=0.004
min885.504-885.508=-0.004
max885.523-885.518=0.005
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.734-0.710=0.024
σ0.022-0.024=-0.002
min0.695-0.674=0.022
max0.749-0.735=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.001
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean4.240-4.239=0.001
σ0.087-0.098=-0.011
min4.105-4.120=-0.015
max4.522-4.851=-0.328
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean4.215-4.217=-0.002
σ0.085-0.090=-0.005
min4.067-4.056=0.011
max4.495-4.477=0.018
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.742-0.745=-0.003
σ0.016-0.021=-0.004
min0.708-0.710=-0.002
max0.844-0.873=-0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.704-0.703=0.001
σ0.013-0.016=-0.003
min0.680-0.673=0.007
max0.773-0.788=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-295.499=0.016
σ0.247-0.215=0.033
min295.327-295.260=0.068
max296.137-296.043=0.094
mean1941.000-1887.000=54.000
σ0.000
min1941.000-1887.000=54.000
max1941.000-1887.000=54.000
mean0.587-0.558=0.030
σ0.034-0.046=-0.012
min0.541-0.494=0.047
max0.657-0.613=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-285.411=-0.007
σ0.039-0.037=0.002
min285.361-285.362=-0.002
max285.446-285.449=-0.003
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.393-0.388=0.005
σ0.005-0.006=-0.001
min0.384-0.383=0.001
max0.397-0.396=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.796=-0.003
σ0.104-0.111=-0.006
min1295.673-1295.669=0.005
max1295.932-1295.921=0.011
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean1.890-1.898=-0.008
σ0.084-0.099=-0.015
min1.795-1.813=-0.018
max1.969-2.034=-0.064
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.924=0.017
σ6.859-6.856=0.003
min1536.686-1536.695=-0.009
max1552.209-1552.186=0.023
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean2.132-2.168=-0.036
σ0.178-0.136=0.043
min1.952-2.009=-0.057
max2.421-2.349=0.072
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.701=0.006
σ0.061-0.058=0.003
min1857.645-1857.647=-0.002
max1857.779-1857.787=-0.008
mean1784.400-1769.000=15.400
σ154.343-120.584=33.759
min1621.000-1636.000=-15.000
max1941.000-1887.000=54.000
mean2.971-2.987=-0.016
σ0.075-0.192=-0.117
min2.882-2.687=0.195
max3.074-3.204=-0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.323=0.083
σ0.272-0.309=-0.037
min1.105-1.100=0.005
max1.769-1.853=-0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.001
σ580.934-580.935=-0.000
min155.270-155.271=-0.000
max1317.142-1317.142=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean0.538-0.531=0.008
σ0.554-0.548=0.006
min0.259-0.256=0.002
max1.369-1.353=0.016
policies=20
mean1552.991-1552.976=0.015
σ0.330-0.329=0.001
min1552.762-1552.751=0.011
max1553.480-1553.465=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean2.593-2.598=-0.005
σ0.019-0.013=0.005
min2.574-2.584=-0.009
max2.615-2.611=0.004
policies=200
mean15538.048-15537.982=0.066
σ0.086-0.126=-0.040
min15537.935-15537.815=0.120
max15538.140-15538.121=0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1636.000=-15.000
σ0.000
min1621.000-1636.000=-15.000
max1621.000-1636.000=-15.000
mean26.226-26.256=-0.031
σ0.234-0.234=-0.001
min26.093-26.096=-0.003
max26.574-26.602=-0.027