Compare commits

Home / Compare 8fa514e1 .. a2f52fae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.052=-0.005
σ0.369-0.370=-0.001
min53.900-53.916=-0.016
max55.097-55.105=-0.008
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.140-0.159=-0.019
σ0.004-0.006=-0.001
min0.135-0.150=-0.014
max0.148-0.168=-0.019
cache=y
dps=1
iters=10
policies=100
mean43.384-43.389=-0.006
σ0.006-0.007=-0.001
min43.373-43.378=-0.005
max43.395-43.404=-0.009
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.122-0.140=-0.017
σ0.004-0.010=-0.005
min0.119-0.122=-0.003
max0.129-0.155=-0.026

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.974-1006.979=-0.005
σ0.945-0.907=0.038
min1006.506-1006.481=0.025
max1010.913-1010.751=0.163
mean1043.100-1051.000=-7.900
σ292.666-306.535=-13.868
min593.000-578.000=15.000
max1425.000-1645.000=-220.000
mean1.571-1.559=0.013
σ0.150-0.066=0.084
min1.395-1.485=-0.090
max2.121-1.676=0.444

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.004-0.003=0.001
min0.882
max0.890-0.887=0.003
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.408-0.421=-0.013
σ0.142-0.151=-0.008
min0.324-0.336=-0.011
max0.661-0.689=-0.028
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.878-0.889=-0.012
σ0.086-0.085=0.001
min0.820-0.824=-0.004
max1.025-1.034=-0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.530-0.540=-0.010
σ0.050-0.051=-0.001
min0.493-0.502=-0.009
max0.616-0.628=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.831-0.858=-0.027
σ0.035-0.043=-0.008
min0.811-0.823=-0.012
max0.893-0.934=-0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.819-964.831=-0.012
σ0.027-0.025=0.001
min964.802
max964.865-964.863=0.002
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.823-0.822=0.001
σ0.022-0.063=-0.041
min0.807-0.709=0.099
max0.863-0.852=0.011
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.006-0.006=-0.000
min885.504
max885.518-885.519=-0.001
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.720-0.666=0.054
σ0.029-0.039=-0.010
min0.670-0.615=0.055
max0.742-0.714=0.028

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean4.201-4.246=-0.045
σ0.077-0.082=-0.004
min4.049-4.061=-0.012
max4.420-4.522=-0.102
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean4.187-4.219=-0.032
σ0.073-0.071=0.001
min4.036-4.106=-0.070
max4.377-4.474=-0.097
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.737-0.739=-0.002
σ0.019-0.019=0.000
min0.707-0.707=0.000
max0.855-0.858=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.699-0.598=0.101
σ0.017-0.102=-0.085
min0.667-0.485=0.182
max0.799-0.887=-0.088

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.477-295.439=0.037
σ0.203-0.279=-0.076
min295.308-295.201=0.108
max295.997-296.195=-0.198
mean1920.000-2027.000=-107.000
σ0.000
min1920.000-2027.000=-107.000
max1920.000-2027.000=-107.000
mean0.572-0.543=0.029
σ0.057-0.039=0.018
min0.500-0.500=0.000
max0.702-0.596=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.412=-0.001
σ0.034-0.038=-0.004
min285.365-285.361=0.004
max285.445-285.452=-0.007
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.397-0.396=0.001
σ0.011-0.005=0.005
min0.391-0.391=0.001
max0.416-0.405=0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.800-1295.810=-0.010
σ0.110-0.118=-0.008
min1295.679-1295.682=-0.003
max1295.935-1295.969=-0.034
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean1.910-1.894=0.016
σ0.084-0.098=-0.014
min1.809-1.819=-0.010
max1.987-2.049=-0.062
iters=5
new-facts=6402
prior-facts=1
mean1539.931-1539.922=0.009
σ6.944-6.878=0.066
min1536.602-1536.644=-0.042
max1552.347-1552.222=0.125
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean2.363-2.237=0.126
σ0.353-0.218=0.135
min2.018-2.038=-0.020
max2.895-2.550=0.345
iters=5
new-facts=6402
prior-facts=6402
mean1857.711-1857.710=0.001
σ0.059-0.047=0.012
min1857.646-1857.655=-0.009
max1857.777-1857.772=0.004
mean1743.800-1777.800=-34.000
σ189.895-167.813=22.082
min1479.000-1645.000=-166.000
max1920.000-2027.000=-107.000
mean2.964-2.901=0.063
σ0.137-0.068=0.069
min2.838-2.845=-0.007
max3.132-2.981=0.150

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.800-1.373=0.426
σ0.127-0.218=-0.091
min1.647-1.113=0.534
max1.995-1.638=0.356

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.738=0.002
σ580.934-580.935=-0.000
min155.271-155.268=0.003
max1317.141-1317.140=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean0.548-0.527=0.021
σ0.581-0.531=0.050
min0.256-0.257=-0.001
max1.420-1.324=0.096
policies=20
mean1552.980-1552.976=0.005
σ0.328-0.330=-0.002
min1552.753-1552.750=0.004
max1553.468-1553.466=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean2.589-2.599=-0.010
σ0.015-0.013=0.002
min2.568-2.586=-0.018
max2.602-2.618=-0.016
policies=200
mean15538.044-15537.928=0.116
σ0.089-0.269=-0.180
min15537.985-15537.584=0.401
max15538.175-15538.207=-0.032
mean9200.000
σ0.000
min9200.000
max9200.000
mean1425.000-1645.000=-220.000
σ0.000
min1425.000-1645.000=-220.000
max1425.000-1645.000=-220.000
mean26.178-26.280=-0.102
σ0.047-0.031=0.015
min26.109-26.239=-0.130
max26.211-26.310=-0.099