Compare commits

Home / Compare 68f98ff8 .. b2b90d8d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.036=-0.004
σ0.369-0.368=0.001
min53.892-53.890=0.003
max55.081-55.082=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.140-0.149=-0.009
σ0.004-0.009=-0.005
min0.133-0.138=-0.004
max0.146-0.162=-0.016
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=-0.000
σ0.007-0.005=0.001
min43.374-43.378=-0.004
max43.396-43.396=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.001
min0.120-0.120=-0.000
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.327=0.004
σ0.912-0.911=0.001
min1005.859-1005.867=-0.009
max1010.118-1010.118=0.000
mean1047.000-1053.800=-6.800
σ307.890-305.174=2.716
min551.000-582.000=-31.000
max1641.000-1453.000=188.000
mean1.556-1.559=-0.003
σ0.098-0.086=0.012
min1.486-1.477=0.010
max1.845-1.759=0.086

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=0.000
min0.881
max0.886-0.886=0.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.418-0.443=-0.024
σ0.134-0.181=-0.047
min0.348-0.352=-0.004
max0.657-0.766=-0.109
name=error_case.art
mean2.334-2.333=0.001
σ0.002-0.003=-0.000
min2.332
max2.337
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.887-0.920=-0.033
σ0.092-0.174=-0.081
min0.818-0.818=-0.001
max1.048-1.228=-0.180
name=heavy_item.art
mean1.522-1.521=0.000
σ0.002-0.002=0.001
min1.520
max1.525-1.524=0.001
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.545-0.540=0.005
σ0.051-0.047=0.003
min0.500-0.499=0.001
max0.632-0.616=0.016
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.001
min2.355
max2.360-2.358=0.002
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.848-0.846=0.002
σ0.037-0.037=0.000
min0.816-0.800=0.016
max0.910-0.902=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.557-963.543=0.013
σ0.030-0.025=0.005
min963.531-963.523=0.008
max963.608-963.585=0.023
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.848-0.812=0.035
σ0.020-0.044=-0.025
min0.815-0.766=0.049
max0.866-0.858=0.008
name=cdr_enhanced_4k_loc.art
mean884.856-884.853=0.002
σ0.005-0.005=0.000
min884.847
max884.860-884.861=-0.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.727-0.726=0.001
σ0.016-0.027=-0.011
min0.709-0.679=0.030
max0.740-0.744=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.711=-0.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean3.495-4.249=-0.753
σ0.063-0.073=-0.010
min3.371-4.116=-0.744
max3.761-4.550=-0.788
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean3.495-4.057=-0.561
σ0.077-0.312=-0.235
min3.384-3.382=0.001
max3.809-4.352=-0.543
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.740-0.748=-0.009
σ0.025-0.026=-0.001
min0.562-0.667=-0.104
max0.852-0.937=-0.084
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.619-0.708=-0.089
σ0.095-0.017=0.078
min0.493-0.681=-0.188
max0.801-0.819=-0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.391-295.573=-0.182
σ0.189-0.203=-0.015
min295.127-295.441=-0.315
max295.831-296.116=-0.285
mean1906.000-1912.000=-6.000
σ0.000
min1906.000-1912.000=-6.000
max1906.000-1912.000=-6.000
mean0.595-0.588=0.007
σ0.049-0.028=0.021
min0.495-0.518=-0.023
max0.694-0.616=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.248-285.245=0.003
σ0.031-0.040=-0.009
min285.209-285.193=0.016
max285.282-285.286=-0.004
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.386-0.392=-0.006
σ0.010-0.011=-0.001
min0.380-0.380=-0.000
max0.404-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.199-1295.155=0.044
σ0.110-0.112=-0.002
min1295.080-1295.074=0.006
max1295.331-1295.342=-0.010
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean1.932-1.973=-0.041
σ0.095-0.219=-0.123
min1.826-1.797=0.029
max2.022-2.337=-0.315
iters=5
new-facts=6402
prior-facts=1
mean1538.083-1538.138=-0.055
σ4.037-3.973=0.065
min1536.006-1536.239=-0.233
max1545.293-1545.242=0.052
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean2.346-2.334=0.011
σ0.287-0.276=0.011
min2.029-2.077=-0.049
max2.633-2.761=-0.128
iters=5
new-facts=6402
prior-facts=6402
mean1857.105-1857.101=0.003
σ0.056-0.054=0.002
min1857.053-1857.049=0.004
max1857.186-1857.176=0.010
mean1774.400-1749.000=25.400
σ130.554-176.634=-46.080
min1641.000-1499.000=142.000
max1906.000-1912.000=-6.000
mean3.031-3.054=-0.024
σ0.343-0.274=0.069
min2.747-2.863=-0.116
max3.616-3.529=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.275-1.756=-0.481
σ0.286-0.179=0.106
min1.001-1.445=-0.444
max1.749-1.906=-0.157

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.611=-0.001
σ577.062-577.065=-0.003
min155.077-155.077=0.000
max1309.203-1309.208=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean0.538-0.539=-0.001
σ0.551-0.560=-0.010
min0.261-0.257=0.004
max1.363-1.379=-0.016
policies=20
mean1551.042-1551.052=-0.011
σ0.323-0.342=-0.019
min1550.820-1550.820=-0.000
max1551.521-1551.560=-0.039
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean2.589-2.608=-0.019
σ0.007-0.040=-0.033
min2.579-2.580=-0.001
max2.595-2.667=-0.072
policies=200
mean15518.558-15518.511=0.047
σ0.076-0.070=0.006
min15518.498-15518.449=0.049
max15518.662-15518.606=0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1453.000=188.000
σ0.000
min1641.000-1453.000=188.000
max1641.000-1453.000=188.000
mean26.155-26.174=-0.018
σ0.121-0.125=-0.004
min26.031-26.042=-0.011
max26.308-26.287=0.021