Compare commits

Home / Compare e27ae70e .. edb1a3e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.036=-0.330
σ0.367-0.368=-0.001
min53.565-53.890=-0.324
max54.751-55.082=-0.332
mean416.700-413.000=3.700
σ0.483-0.000=0.483
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.140-0.149=-0.009
σ0.003-0.009=-0.006
min0.136-0.138=-0.001
max0.146-0.162=-0.016
cache=y
dps=1
iters=10
policies=100
mean43.059-43.384=-0.326
σ0.006-0.005=0.001
min43.048-43.378=-0.330
max43.067-43.396=-0.329
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.123-0.123=-0.001
σ0.004-0.004=0.000
min0.118-0.120=-0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1006.327=-1.222
σ0.888-0.911=-0.023
min1004.637-1005.867=-1.231
max1008.782-1010.118=-1.336
mean1055.100-1053.800=1.300
σ321.597-305.174=16.422
min553.000-582.000=-29.000
max1632.000-1453.000=179.000
mean1.628-1.559=0.070
σ0.090-0.086=0.003
min1.556-1.477=0.079
max1.879-1.759=0.119

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=0.000
min0.881
max0.886-0.886=0.000
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.418-0.443=-0.025
σ0.135-0.181=-0.046
min0.335-0.352=-0.018
max0.658-0.766=-0.108
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.878-0.920=-0.042
σ0.086-0.174=-0.087
min0.830-0.818=0.011
max1.031-1.228=-0.197
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.542-0.540=0.001
σ0.057-0.047=0.009
min0.485-0.499=-0.014
max0.636-0.616=0.020
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.840-0.846=-0.006
σ0.039-0.037=0.002
min0.808-0.800=0.009
max0.904-0.902=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.543=0.011
σ0.026-0.025=0.000
min963.535-963.523=0.012
max963.599-963.585=0.014
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.827-0.812=0.014
σ0.039-0.044=-0.005
min0.773-0.766=0.007
max0.860-0.858=0.002
name=cdr_enhanced_4k_loc.art
mean884.853-884.853=-0.000
σ0.008-0.005=0.003
min884.847
max884.866-884.861=0.006
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.713-0.726=-0.014
σ0.065-0.027=0.039
min0.596-0.679=-0.083
max0.746-0.744=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.711=0.001
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean4.266-4.249=0.017
σ0.067-0.073=-0.006
min4.148-4.116=0.032
max4.538-4.550=-0.012
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean4.265-4.057=0.208
σ0.069-0.312=-0.243
min4.144-3.382=0.762
max4.636-4.352=0.284
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.745-0.748=-0.003
σ0.016-0.026=-0.010
min0.717-0.667=0.051
max0.863-0.937=-0.074
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.703-0.708=-0.005
σ0.016-0.017=-0.001
min0.678-0.681=-0.004
max0.803-0.819=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.342-295.573=-1.231
σ0.279-0.203=0.076
min294.065-295.441=-1.377
max295.075-296.116=-1.041
mean1974.000-1912.000=62.000
σ0.000
min1974.000-1912.000=62.000
max1974.000-1912.000=62.000
mean0.570-0.588=-0.018
σ0.067-0.028=0.039
min0.495-0.518=-0.023
max0.717-0.616=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.245=-3.752
σ0.036-0.040=-0.004
min281.453-285.193=-3.740
max281.529-285.286=-3.757
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.379-0.392=-0.013
σ0.001-0.011=-0.011
min0.378-0.380=-0.002
max0.380-0.404=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1295.155=-3.676
σ0.117-0.112=0.004
min1291.352-1295.074=-3.722
max1291.646-1295.342=-3.695
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean1.928-1.973=-0.044
σ0.109-0.219=-0.110
min1.788-1.797=-0.009
max2.046-2.337=-0.292
iters=5
new-facts=6402
prior-facts=1
mean1534.344-1538.138=-3.794
σ4.031-3.973=0.058
min1532.322-1536.239=-3.916
max1541.543-1545.242=-3.699
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean2.349-2.334=0.014
σ0.263-0.276=-0.013
min2.093-2.077=0.016
max2.705-2.761=-0.056
iters=5
new-facts=6402
prior-facts=6402
mean1853.374-1857.101=-3.727
σ0.078-0.054=0.024
min1853.284-1857.049=-3.765
max1853.469-1857.176=-3.708
mean1802.800-1749.000=53.800
σ168.869-176.634=-7.765
min1632.000-1499.000=133.000
max1974.000-1912.000=62.000
mean3.253-3.054=0.198
σ0.334-0.274=0.060
min2.892-2.863=0.028
max3.656-3.529=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.424-1.756=-0.332
σ0.305-0.179=0.125
min1.102-1.445=-0.343
max1.873-1.906=-0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-443.611=-1.182
σ577.063-577.065=-0.001
min153.895-155.077=-1.183
max1308.024-1309.208=-1.185
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean0.521-0.539=-0.019
σ0.515-0.560=-0.045
min0.261-0.257=0.003
max1.293-1.379=-0.086
policies=20
mean1539.224-1551.052=-11.828
σ0.321-0.342=-0.021
min1538.999-1550.820=-11.821
max1539.700-1551.560=-11.860
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean2.573-2.608=-0.035
σ0.016-0.040=-0.024
min2.554-2.580=-0.026
max2.589-2.667=-0.079
policies=200
mean15400.365-15518.511=-118.147
σ0.085-0.070=0.015
min15400.270-15518.449=-118.179
max15400.467-15518.606=-118.139
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1453.000=179.000
σ0.000
min1632.000-1453.000=179.000
max1632.000-1453.000=179.000
mean25.961-26.174=-0.213
σ0.075-0.125=-0.051
min25.862-26.042=-0.180
max26.035-26.287=-0.253