Compare commits

Home / Compare bce4a750 .. beb0b48a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.371-0.369=0.002
min53.913-53.914=-0.001
max55.111-55.106=0.005
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.137-0.136=0.002
σ0.005-0.006=-0.001
min0.130-0.130=0.000
max0.145-0.149=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.007-0.005=0.002
min43.385-43.387=-0.002
max43.405-43.402=0.004
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.119-0.120=-0.002
σ0.005-0.005=-0.001
min0.113-0.114=-0.001
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.959-1006.927=0.032
σ0.868-0.902=-0.034
min1006.464-1006.438=0.026
max1010.553-1010.672=-0.119
mean1055.700-1056.050=-0.350
σ316.342-316.402=-0.059
min566.000
max1620.000-1621.000=-1.000
mean1.532-1.531=0.001
σ0.050-0.085=-0.035
min1.448-1.351=0.097
max1.624-1.761=-0.137

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.415-0.440=-0.024
σ0.130-0.207=-0.077
min0.336-0.322=0.014
max0.644-0.808=-0.164
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.888-0.918=-0.030
σ0.103-0.168=-0.065
min0.832-0.811=0.022
max1.072-1.215=-0.143
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.537-0.522=0.015
σ0.048-0.048=0.001
min0.500-0.485=0.015
max0.617-0.597=0.020
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.846-0.827=0.019
σ0.038-0.031=0.007
min0.819-0.801=0.018
max0.912-0.878=0.034

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.838=-0.001
σ0.035-0.033=0.002
min964.811-964.810=0.001
max964.897-964.892=0.005
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.848-0.837=0.011
σ0.021-0.027=-0.006
min0.814-0.804=0.010
max0.866-0.864=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.004-0.007=-0.003
min885.505
max885.516-885.522=-0.006
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.736-0.735=0.001
σ0.010-0.010=-0.000
min0.719-0.717=0.002
max0.743-0.741=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean3.517-4.238=-0.721
σ0.104-0.087=0.017
min3.388-4.097=-0.709
max4.156-4.510=-0.353
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean3.486-4.226=-0.741
σ0.078-0.098=-0.020
min3.365-4.095=-0.730
max3.790-4.671=-0.881
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.741-0.732=0.009
σ0.017-0.020=-0.003
min0.713-0.703=0.010
max0.844-0.882=-0.038
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.694-0.701=-0.008
σ0.041-0.026=0.015
min0.512-0.561=-0.049
max0.791-0.800=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.555-295.387=0.168
σ0.236-0.202=0.034
min295.353-295.203=0.150
max296.195-295.922=0.274
mean1893.000-1910.000=-17.000
σ0.000
min1893.000-1910.000=-17.000
max1893.000-1910.000=-17.000
mean0.561-0.560=0.002
σ0.048-0.029=0.019
min0.499-0.508=-0.008
max0.643-0.612=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.358=0.037
σ0.036-0.033=0.003
min285.353-285.311=0.041
max285.438-285.396=0.042
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.387-0.386=0.001
σ0.006-0.006=0.000
min0.381-0.381=0.000
max0.395-0.396=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.777-1295.744=0.033
σ0.112-0.114=-0.002
min1295.659-1295.629=0.030
max1295.915-1295.883=0.032
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean1.891-1.936=-0.045
σ0.088-0.114=-0.026
min1.804-1.804=0.000
max1.986-2.037=-0.051
iters=5
new-facts=6402
prior-facts=1
mean1538.641-1538.595=0.046
σ4.005-4.000=0.005
min1536.636-1536.567=0.069
max1545.798-1545.742=0.055
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean2.323-2.302=0.021
σ0.237-0.247=-0.010
min2.051-2.001=0.050
max2.652-2.660=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean1857.683-1857.640=0.043
σ0.067-0.067=-0.001
min1857.601-1857.563=0.037
max1857.772-1857.735=0.037
mean1767.800-1776.400=-8.600
σ128.237-137.369=-9.132
min1620.000-1621.000=-1.000
max1893.000-1910.000=-17.000
mean2.953-3.056=-0.103
σ0.124-0.264=-0.140
min2.839-2.852=-0.013
max3.134-3.516=-0.382

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.295-1.204=0.092
σ0.312-0.298=0.015
min1.070-0.940=0.130
max1.833-1.693=0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.027-443.829=0.199
σ577.575-577.319=0.255
min155.238-155.168=0.070
max1310.389-1309.808=0.581
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean0.550-0.536=0.014
σ0.569-0.550=0.019
min0.256-0.258=-0.002
max1.404-1.361=0.043
policies=20
mean1552.662-1551.926=0.736
σ0.344-0.336=0.008
min1552.427-1551.698=0.729
max1553.173-1552.425=0.748
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean2.604-2.597=0.006
σ0.011-0.013=-0.001
min2.590-2.578=0.012
max2.613-2.605=0.008
policies=200
mean15534.616-15527.597=7.019
σ0.170-0.163=0.007
min15534.466-15527.463=7.003
max15534.850-15527.827=7.023
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1621.000=-1.000
σ0.000
min1620.000-1621.000=-1.000
max1620.000-1621.000=-1.000
mean26.231-26.120=0.111
σ0.195-0.043=0.152
min26.049-26.073=-0.024
max26.455-26.157=0.298