Compare commits

Home / Compare 929f523d .. 2e725c5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.050=0.007
σ0.370-0.370=0.000
min53.915-53.915=0.001
max55.108-55.101=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.141=-0.002
σ0.005-0.004=0.001
min0.132-0.137=-0.004
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.390=0.005
σ0.007-0.007=-0.000
min43.385-43.382=0.003
max43.412-43.405=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.124=-0.002
σ0.002-0.004=-0.001
min0.120-0.120=-0.000
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.028-1007.026=0.002
σ1.178-1.207=-0.029
min1006.456-1006.466=-0.010
max1011.961-1012.088=-0.127
mean1050.600-1048.450=2.150
σ320.498-301.874=18.624
min568.000-576.000=-8.000
max1619.000-1632.000=-13.000
mean1.521-1.548=-0.027
σ0.085-0.083=0.002
min1.342-1.477=-0.135
max1.719-1.779=-0.060

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.003-0.003=-0.001
min0.882
max0.887-0.889=-0.003
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.407-0.423=-0.015
σ0.129-0.126=0.003
min0.335-0.349=-0.014
max0.636-0.646=-0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.878-0.881=-0.003
σ0.098-0.096=0.002
min0.799-0.811=-0.012
max1.048-1.048=-0.000
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.530-0.537=-0.007
σ0.043-0.055=-0.011
min0.493-0.499=-0.007
max0.602-0.633=-0.031
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.841-0.853=-0.013
σ0.034-0.047=-0.013
min0.811-0.813=-0.001
max0.899-0.930=-0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.034-0.034=-0.000
min964.811-964.810=0.000
max964.894-964.896=-0.002
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.777-0.813=-0.036
σ0.083-0.056=0.026
min0.639-0.720=-0.081
max0.852-0.863=-0.010
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.007=-0.001
min885.506-885.504=0.001
max885.520-885.522=-0.003
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.738-0.726=0.011
σ0.009-0.015=-0.006
min0.722-0.702=0.020
max0.744-0.738=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean4.182-4.195=-0.013
σ0.090-0.081=0.009
min4.042-4.079=-0.037
max4.573-4.474=0.099
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean4.186-4.183=0.003
σ0.081-0.079=0.002
min4.012-4.069=-0.058
max4.512-4.468=0.044
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.745-0.747=-0.002
σ0.020-0.017=0.004
min0.708-0.711=-0.003
max0.863-0.834=0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.707-0.644=0.063
σ0.017-0.098=-0.080
min0.632-0.487=0.145
max0.773-0.781=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.904-297.082=-0.178
σ0.214-0.195=0.019
min296.734-296.906=-0.171
max297.477-297.599=-0.122
mean1950.000-1946.000=4.000
σ0.000
min1950.000-1946.000=4.000
max1950.000-1946.000=4.000
mean0.589-0.581=0.008
σ0.025-0.033=-0.008
min0.576-0.509=0.067
max0.659-0.609=0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.841-286.843=-0.002
σ0.038-0.038=-0.000
min286.791-286.791=0.001
max286.880-286.882=-0.003
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.402-0.396=0.006
σ0.009-0.006=0.003
min0.388-0.390=-0.003
max0.412-0.403=0.008
iters=5
new-facts=1
prior-facts=6402
mean1297.235-1297.227=0.008
σ0.116-0.109=0.007
min1297.116-1297.104=0.012
max1297.403-1297.376=0.027
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean1.884-1.882=0.001
σ0.085-0.080=0.005
min1.807-1.795=0.013
max2.015-1.988=0.026
iters=5
new-facts=6402
prior-facts=1
mean1541.356-1541.363=-0.008
σ6.820-6.835=-0.015
min1538.125-1538.097=0.028
max1553.553-1553.588=-0.034
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean2.126-2.138=-0.011
σ0.115-0.182=-0.068
min2.018-2.005=0.013
max2.303-2.439=-0.136
iters=5
new-facts=6402
prior-facts=6402
mean1859.136-1859.144=-0.007
σ0.067-0.062=0.006
min1859.051-1859.088=-0.037
max1859.215-1859.231=-0.016
mean1781.400-1784.600=-3.200
σ165.420-157.308=8.112
min1619.000-1632.000=-13.000
max1950.000-1946.000=4.000
mean2.975-2.920=0.056
σ0.235-0.087=0.147
min2.830-2.851=-0.021
max3.386-3.039=0.347

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.212=0.013
σ0.271-0.392=-0.121
min0.930-0.926=0.005
max1.654-1.870=-0.216

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.865-448.867=-0.002
σ581.372-581.372=0.001
min158.175-158.179=-0.004
max1320.924-1320.925=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean0.525-0.536=-0.011
σ0.513-0.544=-0.031
min0.267-0.262=0.006
max1.295-1.353=-0.058
policies=20
mean1582.076-1582.082=-0.006
σ0.362-0.352=0.011
min1581.833-1581.844=-0.012
max1582.615-1582.605=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean2.635-2.627=0.009
σ0.007-0.006=0.001
min2.628-2.622=0.005
max2.643-2.636=0.007
policies=200
mean15828.702-15828.736=-0.034
σ0.063-0.156=-0.092
min15828.611-15828.594=0.017
max15828.747-15828.945=-0.198
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1632.000=-13.000
σ0.000
min1619.000-1632.000=-13.000
max1619.000-1632.000=-13.000
mean26.685-26.637=0.049
σ0.148-0.072=0.076
min26.514-26.565=-0.051
max26.872-26.718=0.154