Compare commits

Home / Compare ffc6f78d .. d82967c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.055=0.002
σ0.367-0.369=-0.001
min53.917-53.908=0.009
max55.102-55.103=-0.001
mean419.000
σ0.000
min419.000
max419.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.000
min0.136-0.132=0.004
max0.144-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.002
σ0.006-0.006=-0.000
min43.385-43.386=-0.001
max43.404-43.402=0.002
mean419.000
σ0.000
min419.000
max419.000
mean0.123-0.120=0.003
σ0.004-0.004=0.000
min0.117-0.115=0.002
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=-0.000
σ0.866-0.925=-0.059
min1006.505-1006.507=-0.002
max1010.558-1010.827=-0.269
mean1053.650-1055.650=-2.000
σ319.689-306.148=13.541
min577.000-576.000=1.000
max1621.000-1457.000=164.000
mean1.542-1.568=-0.026
σ0.124-0.135=-0.011
min1.454-1.469=-0.015
max2.044-2.021=0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.409-0.441=-0.032
σ0.098-0.126=-0.028
min0.341-0.352=-0.010
max0.581-0.659=-0.078
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.886-0.886=-0.000
σ0.092-0.097=-0.005
min0.807-0.826=-0.019
max1.044-1.058=-0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.536-0.532=0.004
σ0.057-0.051=0.006
min0.479-0.482=-0.004
max0.625-0.616=0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.841-0.843=-0.003
σ0.043-0.040=0.003
min0.809-0.816=-0.007
max0.914-0.911=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.822=0.008
σ0.025-0.026=-0.001
min964.803-964.802=0.001
max964.859-964.864=-0.005
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.814-0.829=-0.015
σ0.051-0.032=0.019
min0.734-0.795=-0.062
max0.859-0.865=-0.006
name=cdr_enhanced_4k_loc.art
mean885.513-885.511=0.002
σ0.008-0.006=0.002
min885.504
max885.523-885.518=0.005
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.734-0.736=-0.002
σ0.022-0.008=0.014
min0.695-0.723=-0.028
max0.749-0.745=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean4.240-3.535=0.704
σ0.087-0.084=0.003
min4.105-3.395=0.710
max4.522-3.894=0.628
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean4.215-3.523=0.691
σ0.085-0.064=0.020
min4.067-3.386=0.681
max4.495-3.734=0.761
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.742-0.540=0.202
σ0.016-0.015=0.001
min0.708-0.520=0.188
max0.844-0.638=0.206
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.704-0.506=0.198
σ0.013-0.016=-0.003
min0.680-0.475=0.205
max0.773-0.569=0.204

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-295.628=-0.113
σ0.247-0.285=-0.038
min295.327-295.466=-0.139
max296.137-296.421=-0.284
mean1941.000-1905.000=36.000
σ0.000
min1941.000-1905.000=36.000
max1941.000-1905.000=36.000
mean0.587-0.583=0.004
σ0.034-0.046=-0.012
min0.541-0.500=0.041
max0.657-0.645=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-285.398=0.006
σ0.039-0.030=0.008
min285.361-285.360=0.001
max285.446-285.431=0.015
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.393-0.403=-0.011
σ0.005-0.005=0.000
min0.384-0.396=-0.012
max0.397-0.410=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.765=0.028
σ0.104-0.069=0.036
min1295.673-1295.676=-0.003
max1295.932-1295.838=0.094
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean1.890-1.913=-0.023
σ0.084-0.102=-0.018
min1.795-1.819=-0.024
max1.969-2.048=-0.078
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.992=-0.051
σ6.859-6.860=-0.001
min1536.686-1536.776=-0.090
max1552.209-1552.261=-0.052
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean2.132-2.503=-0.370
σ0.178-0.156=0.022
min1.952-2.248=-0.296
max2.421-2.645=-0.224
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.700=0.007
σ0.061-0.051=0.010
min1857.645-1857.654=-0.010
max1857.779-1857.774=0.005
mean1784.400-1744.600=39.800
σ154.343-171.144=-16.801
min1621.000-1505.000=116.000
max1941.000-1905.000=36.000
mean2.971-3.058=-0.088
σ0.075-0.264=-0.188
min2.882-2.869=0.013
max3.074-3.524=-0.450

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.759=-0.354
σ0.272-0.129=0.143
min1.105-1.608=-0.504
max1.769-1.917=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.270-155.272=-0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean0.538-0.542=-0.003
σ0.554-0.558=-0.004
min0.259-0.262=-0.003
max1.369-1.378=-0.009
policies=20
mean1552.991-1552.986=0.005
σ0.330-0.317=0.013
min1552.762-1552.769=-0.007
max1553.480-1553.457=0.024
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean2.593-2.572=0.022
σ0.019-0.017=0.002
min2.574-2.557=0.017
max2.615-2.595=0.020
policies=200
mean15538.048-15538.060=-0.012
σ0.086-0.060=0.026
min15537.935-15538.014=-0.079
max15538.140-15538.147=-0.008
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1457.000=164.000
σ0.000
min1621.000-1457.000=164.000
max1621.000-1457.000=164.000
mean26.226-26.140=0.086
σ0.234-0.018=0.216
min26.093-26.118=-0.025
max26.574-26.161=0.413