Compare commits

Home / Compare 4ccd3372 .. a292298b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.036-54.032=0.004
σ0.368-0.370=-0.002
min53.890-53.887=0.002
max55.082-55.084=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.149-0.140=0.009
σ0.009-0.005=0.004
min0.138-0.132=0.005
max0.162-0.149=0.013
cache=y
dps=1
iters=10
policies=100
mean43.384-43.383=0.001
σ0.005-0.008=-0.002
min43.378-43.369=0.009
max43.396-43.395=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.123-0.122=0.002
σ0.004-0.005=-0.001
min0.120-0.115=0.005
max0.130-0.132=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.335=-0.007
σ0.911-0.874=0.037
min1005.867-1005.832=0.035
max1010.118-1009.950=0.168
mean1053.800-1054.650=-0.850
σ305.174-318.302=-13.128
min582.000-563.000=19.000
max1453.000-1634.000=-181.000
mean1.559-1.558=0.001
σ0.086-0.055=0.031
min1.477-1.493=-0.017
max1.759-1.663=0.096

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.443-0.430=0.013
σ0.181-0.126=0.055
min0.352-0.356=-0.004
max0.766-0.653=0.113
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.920-0.882=0.038
σ0.174-0.092=0.082
min0.818-0.819=-0.001
max1.228-1.043=0.185
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.540-0.548=-0.008
σ0.047-0.054=-0.007
min0.499-0.497=0.002
max0.616-0.638=-0.022
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.846-0.881=-0.035
σ0.037-0.056=-0.018
min0.800-0.833=-0.034
max0.902-0.956=-0.053

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-963.551=-0.008
σ0.025-0.025=0.000
min963.523-963.526=-0.003
max963.585-963.590=-0.005
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.812-0.832=-0.019
σ0.044-0.060=-0.016
min0.766-0.725=0.041
max0.858-0.865=-0.007
name=cdr_enhanced_4k_loc.art
mean884.853-884.855=-0.002
σ0.005-0.009=-0.003
min884.847
max884.861-884.867=-0.007
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.726-0.705=0.022
σ0.027-0.050=-0.023
min0.679-0.628=0.051
max0.744-0.744=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.712=-0.001
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean4.249-4.284=-0.035
σ0.073-0.096=-0.023
min4.116-4.122=-0.007
max4.550-4.657=-0.107
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean4.057-4.249=-0.192
σ0.312-0.073=0.239
min3.382-4.090=-0.708
max4.352-4.542=-0.190
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.748-0.750=-0.001
σ0.026-0.023=0.003
min0.667-0.712=-0.046
max0.937-0.892=0.044
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.708-0.714=-0.007
σ0.017-0.026=-0.009
min0.681-0.681=0.000
max0.819-0.896=-0.077

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-295.652=-0.079
σ0.203-0.250=-0.046
min295.441-295.515=-0.074
max296.116-296.337=-0.222
mean1912.000-1896.000=16.000
σ0.000
min1912.000-1896.000=16.000
max1912.000-1896.000=16.000
mean0.588-0.568=0.019
σ0.028-0.063=-0.035
min0.518-0.494=0.023
max0.616-0.711=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-285.249=-0.004
σ0.040-0.041=-0.001
min285.193-285.191=0.002
max285.286-285.292=-0.006
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.392-0.398=-0.006
σ0.011-0.011=0.001
min0.380-0.391=-0.011
max0.404-0.414=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.155-1295.193=-0.038
σ0.112-0.109=0.003
min1295.074-1295.069=0.005
max1295.342-1295.329=0.013
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean1.973-1.876=0.096
σ0.219-0.094=0.125
min1.797-1.786=0.011
max2.337-2.020=0.317
iters=5
new-facts=6402
prior-facts=1
mean1538.138-1538.095=0.043
σ3.973-4.015=-0.042
min1536.239-1536.109=0.129
max1545.242-1545.272=-0.030
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean2.334-2.157=0.177
σ0.276-0.161=0.115
min2.077-1.995=0.082
max2.761-2.365=0.396
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1857.112=-0.011
σ0.054-0.049=0.004
min1857.049-1857.063=-0.014
max1857.176-1857.179=-0.003
mean1749.000-1765.600=-16.600
σ176.634-125.373=51.261
min1499.000-1634.000=-135.000
max1912.000-1896.000=16.000
mean3.054-3.140=-0.085
σ0.274-0.355=-0.080
min2.863-2.900=-0.037
max3.529-3.758=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.467=0.289
σ0.179-0.238=-0.059
min1.445-1.260=0.185
max1.906-1.825=0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.610=0.001
σ577.065-577.065=-0.000
min155.077-155.075=0.002
max1309.208-1309.208=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean0.539-0.550=-0.011
σ0.560-0.578=-0.018
min0.257-0.256=0.001
max1.379-1.418=-0.038
policies=20
mean1551.052-1551.041=0.011
σ0.342-0.330=0.012
min1550.820-1550.814=0.006
max1551.560-1551.530=0.030
mean920.000
σ0.000
min920.000
max920.000
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean2.608-2.592=0.017
σ0.040-0.010=0.030
min2.580-2.580=0.000
max2.667-2.604=0.063
policies=200
mean15518.511-15518.533=-0.021
σ0.070-0.109=-0.039
min15518.449-15518.460=-0.011
max15518.606-15518.693=-0.087
mean9200.000
σ0.000
min9200.000
max9200.000
mean1453.000-1634.000=-181.000
σ0.000
min1453.000-1634.000=-181.000
max1453.000-1634.000=-181.000
mean26.174-26.157=0.016
σ0.125-0.093=0.033
min26.042-26.048=-0.007
max26.287-26.269=0.018