Compare commits

Home / Compare 97c57de0 .. 929f523d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.050-54.055=-0.006
σ0.370-0.371=-0.002
min53.915-53.911=0.004
max55.101-55.112=-0.010
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.141-0.136=0.004
σ0.004-0.006=-0.002
min0.137-0.130=0.007
max0.146-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.390-43.395=-0.005
σ0.007-0.006=0.001
min43.382-43.385=-0.003
max43.405-43.405=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.124-0.123=0.000
σ0.004-0.004=0.000
min0.120-0.119=0.001
max0.131-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.026-1007.029=-0.002
σ1.207-1.205=0.002
min1006.466-1006.467=-0.001
max1012.088-1012.083=0.005
mean1048.450-1053.250=-4.800
σ301.874-307.944=-6.070
min576.000-578.000=-2.000
max1632.000-1645.000=-13.000
mean1.548-1.541=0.007
σ0.083-0.082=0.001
min1.477-1.468=0.009
max1.779-1.772=0.007

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.003-0.003=0.001
min0.882
max0.889-0.887=0.003
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.423-0.423=0.000
σ0.126-0.152=-0.027
min0.349-0.339=0.010
max0.646-0.694=-0.048
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.881-0.942=-0.061
σ0.096-0.211=-0.115
min0.811-0.832=-0.021
max1.048-1.318=-0.270
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.537-0.541=-0.004
σ0.055-0.048=0.006
min0.499-0.499=0.000
max0.633-0.622=0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.853-0.847=0.006
σ0.047-0.042=0.005
min0.813-0.814=-0.002
max0.930-0.919=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.836=0.003
σ0.034-0.022=0.011
min964.810-964.810=0.001
max964.896-964.862=0.034
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.813-0.825=-0.011
σ0.056-0.027=0.029
min0.720-0.790=-0.070
max0.863-0.860=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.516=-0.004
σ0.007-0.009=-0.002
min885.504-885.505=-0.001
max885.522-885.531=-0.008
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.726-0.694=0.032
σ0.015-0.078=-0.062
min0.702-0.564=0.138
max0.738-0.748=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.723=-0.003
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean4.195-4.235=-0.040
σ0.081-0.080=0.001
min4.079-4.115=-0.036
max4.474-4.502=-0.028
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean4.183-4.236=-0.053
σ0.079-0.066=0.012
min4.069-4.080=-0.011
max4.468-4.496=-0.029
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.747-0.756=-0.009
σ0.017-0.021=-0.004
min0.711-0.726=-0.015
max0.834-0.864=-0.030
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.644-0.713=-0.069
σ0.098-0.014=0.083
min0.487-0.684=-0.197
max0.781-0.787=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.082-296.714=0.368
σ0.195-0.286=-0.091
min296.906-296.488=0.418
max297.599-297.489=0.110
mean1946.000-1892.000=54.000
σ0.000
min1946.000-1892.000=54.000
max1946.000-1892.000=54.000
mean0.581-0.586=-0.005
σ0.033-0.030=0.003
min0.509-0.537=-0.029
max0.609-0.630=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.843-286.851=-0.008
σ0.038-0.039=-0.001
min286.791-286.800=-0.010
max286.882-286.894=-0.012
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.396-0.397=-0.001
σ0.006-0.006=-0.000
min0.390-0.389=0.001
max0.403-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1297.227-1297.240=-0.013
σ0.109-0.112=-0.003
min1297.104-1297.119=-0.015
max1297.376-1297.374=0.002
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean1.882-1.901=-0.018
σ0.080-0.086=-0.005
min1.795-1.807=-0.013
max1.988-2.020=-0.032
iters=5
new-facts=6402
prior-facts=1
mean1541.363-1541.334=0.029
σ6.835-6.826=0.009
min1538.097-1538.028=0.069
max1553.588-1553.540=0.048
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean2.138-2.238=-0.101
σ0.182-0.177=0.005
min2.005-1.997=0.008
max2.439-2.467=-0.028
iters=5
new-facts=6402
prior-facts=6402
mean1859.144-1859.139=0.005
σ0.062-0.074=-0.013
min1859.088-1859.047=0.041
max1859.231-1859.239=-0.008
mean1784.600-1777.200=7.400
σ157.308-119.540=37.768
min1632.000-1645.000=-13.000
max1946.000-1892.000=54.000
mean2.920-2.930=-0.011
σ0.087-0.164=-0.077
min2.851-2.766=0.085
max3.039-3.117=-0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.092=0.120
σ0.392-0.142=0.249
min0.926-0.928=-0.003
max1.870-1.251=0.619

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.867-448.866=0.001
σ581.372-581.372=-0.001
min158.179-158.177=0.003
max1320.925-1320.925=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean0.536-0.540=-0.004
σ0.544-0.534=0.011
min0.262-0.266=-0.004
max1.353-1.341=0.012
policies=20
mean1582.082-1582.088=-0.006
σ0.352-0.361=-0.009
min1581.844-1581.847=-0.003
max1582.605-1582.625=-0.021
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean2.627-2.635=-0.008
σ0.006-0.011=-0.005
min2.622-2.624=-0.002
max2.636-2.651=-0.015
policies=200
mean15828.736-15828.741=-0.005
σ0.156-0.125=0.031
min15828.594-15828.605=-0.011
max15828.945-15828.865=0.080
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1645.000=-13.000
σ0.000
min1632.000-1645.000=-13.000
max1632.000-1645.000=-13.000
mean26.637-26.713=-0.076
σ0.072-0.130=-0.058
min26.565-26.602=-0.037
max26.718-26.900=-0.183