Compare commits

Home / Compare a13ba7dd .. 37223152

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.728-53.730=-0.002
σ0.369-0.369=0.000
min53.580-53.592=-0.012
max54.777-54.778=-0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.134-0.137=-0.003
σ0.005-0.005=0.000
min0.128-0.130=-0.001
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.068-43.069=-0.001
σ0.006-0.007=-0.001
min43.059-43.061=-0.003
max43.077-43.080=-0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.120-0.121=-0.001
σ0.005-0.004=0.001
min0.113-0.117=-0.004
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.757-1005.740=0.017
σ0.871-0.867=0.004
min1005.258-1005.241=0.017
max1009.362-1009.325=0.037
mean1052.300-1050.550=1.750
σ306.407-306.649=-0.242
min576.000-575.000=1.000
max1646.000-1645.000=1.000
mean1.550-1.520=0.030
σ0.060-0.052=0.008
min1.491-1.427=0.063
max1.666-1.634=0.032

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.417-0.417=0.000
σ0.147-0.131=0.016
min0.338-0.332=0.006
max0.678-0.647=0.030
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.878-0.893=-0.015
σ0.088-0.095=-0.007
min0.806-0.833=-0.026
max1.028-1.060=-0.031
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.542-0.535=0.007
σ0.061-0.045=0.016
min0.497-0.497=-0.001
max0.645-0.608=0.037
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.001
min2.360
max2.365-2.364=0.001
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.857-0.848=0.009
σ0.048-0.032=0.016
min0.818-0.816=0.002
max0.938-0.898=0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.838=-0.005
σ0.031-0.033=-0.003
min964.802-964.811=-0.009
max964.880-964.894=-0.014
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.823-0.849=-0.026
σ0.021-0.006=0.016
min0.802-0.841=-0.039
max0.849-0.854=-0.005
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.004-0.007=-0.003
min885.508-885.504=0.004
max885.518-885.522=-0.003
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.701-0.728=-0.027
σ0.032-0.032=-0.001
min0.662-0.672=-0.011
max0.739-0.755=-0.017

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.002
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean4.250-4.279=-0.028
σ0.086-0.151=-0.064
min4.074-4.155=-0.080
max4.582-5.398=-0.815
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean4.175-4.265=-0.089
σ0.093-0.082=0.011
min4.011-4.107=-0.096
max4.676-4.537=0.138
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.719-0.734=-0.014
σ0.081-0.046=0.035
min0.529-0.533=-0.004
max0.933-0.864=0.068
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.509-0.709=-0.200
σ0.015-0.016=-0.001
min0.489-0.672=-0.183
max0.616-0.775=-0.159

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.171-294.281=-0.110
σ0.230-0.184=0.046
min294.036-294.158=-0.122
max294.807-294.777=0.030
mean2027.000-1923.000=104.000
σ0.000
min2027.000-1923.000=104.000
max2027.000-1923.000=104.000
mean0.549-0.578=-0.030
σ0.033-0.042=-0.009
min0.502-0.496=0.006
max0.600-0.647=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.659-281.647=0.012
σ0.037-0.041=-0.005
min281.606-281.595=0.011
max281.698-281.696=0.002
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.387-0.387=0.000
σ0.011-0.007=0.004
min0.379-0.379=0.000
max0.406-0.398=0.009
iters=5
new-facts=1
prior-facts=6402
mean1292.080-1292.059=0.020
σ0.114-0.118=-0.004
min1291.961-1291.934=0.027
max1292.258-1292.209=0.049
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean1.873-1.977=-0.103
σ0.095-0.132=-0.037
min1.765-1.798=-0.034
max2.003-2.168=-0.164
iters=5
new-facts=6402
prior-facts=1
mean1536.173-1536.196=-0.023
σ6.875-6.821=0.054
min1532.851-1532.931=-0.080
max1548.467-1548.394=0.073
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean2.196-2.384=-0.188
σ0.253-0.252=0.001
min1.934-2.012=-0.078
max2.532-2.640=-0.108
iters=5
new-facts=6402
prior-facts=6402
mean1853.945-1853.926=0.020
σ0.052-0.060=-0.008
min1853.897-1853.852=0.044
max1854.022-1854.003=0.019
mean1788.200-1784.000=4.200
σ169.609-139.000=30.609
min1646.000-1645.000=1.000
max2027.000-1923.000=104.000
mean2.959-3.069=-0.110
σ0.227-0.278=-0.050
min2.827-2.797=0.031
max3.356-3.529=-0.173

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.330-1.206=0.124
σ0.269-0.314=-0.045
min1.111-0.933=0.178
max1.794-1.725=0.069

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.555-444.524=0.031
σ580.933-580.934=-0.001
min154.087-154.053=0.034
max1315.955-1315.925=0.030
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean0.517-0.537=-0.020
σ0.520-0.556=-0.036
min0.249-0.256=-0.008
max1.297-1.371=-0.074
policies=20
mean1541.153-1540.841=0.312
σ0.327-0.320=0.007
min1540.931-1540.620=0.312
max1541.639-1541.316=0.323
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean2.581-2.582=-0.001
σ0.009-0.006=0.003
min2.574-2.574=0.001
max2.593-2.589=0.004
policies=200
mean15419.873-15416.518=3.354
σ0.153-0.122=0.031
min15419.711-15416.401=3.310
max15420.073-15416.690=3.383
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1645.000=1.000
σ0.000
min1646.000-1645.000=1.000
max1646.000-1645.000=1.000
mean26.074-26.049=0.026
σ0.111-0.154=-0.043
min25.978-25.934=0.044
max26.211-26.276=-0.065