Compare commits

Home / Compare f9b2bca2 .. 6c1aebc7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.055=0.002
σ0.369-0.367=0.002
min53.911-53.914=-0.004
max55.105-55.098=0.008
mean417.000-417.700=-0.700
σ0.000-0.483=-0.483
min417.000
max417.000-418.000=-1.000
mean0.140-0.137=0.003
σ0.004-0.005=-0.001
min0.136-0.130=0.007
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.007-0.005=0.002
min43.381-43.386=-0.006
max43.404-43.403=0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.123=-0.001
σ0.004-0.004=0.001
min0.119-0.119=-0.000
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.979=-0.002
σ0.891-0.886=0.005
min1006.503-1006.490=0.013
max1010.676-1010.654=0.023
mean1052.800-1046.600=6.200
σ305.332-314.288=-8.955
min577.000
max1649.000-1645.000=4.000
mean1.584-1.574=0.010
σ0.094-0.103=-0.009
min1.493-1.494=-0.001
max1.847-1.824=0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.459-0.422=0.037
σ0.175-0.147=0.029
min0.331-0.333=-0.003
max0.766-0.682=0.084
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.894-0.873=0.022
σ0.151-0.089=0.062
min0.815-0.823=-0.008
max1.163-1.031=0.133
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.565-0.536=0.030
σ0.039-0.047=-0.008
min0.534-0.489=0.045
max0.609-0.614=-0.005
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.847-0.838=0.009
σ0.043-0.045=-0.003
min0.821-0.795=0.025
max0.920-0.906=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.001
σ0.025-0.025=-0.000
min964.802
max964.860-964.862=-0.002
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.820-0.845=-0.025
σ0.035-0.036=-0.001
min0.776-0.780=-0.004
max0.861-0.865=-0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.515=-0.002
σ0.005-0.004=0.001
min885.505-885.509=-0.004
max885.518-885.520=-0.002
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.715-0.712=0.003
σ0.027-0.046=-0.019
min0.673-0.636=0.037
max0.744-0.748=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.230-4.273=-0.044
σ0.091-0.104=-0.013
min4.099-4.089=0.010
max4.666-4.931=-0.265
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.214-4.254=-0.041
σ0.083-0.076=0.008
min4.044-4.111=-0.067
max4.529-4.543=-0.014
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.734-0.745=-0.010
σ0.018-0.018=0.000
min0.702-0.712=-0.010
max0.839-0.848=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.697-0.703=-0.006
σ0.014-0.019=-0.004
min0.670-0.593=0.077
max0.779-0.764=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.602-295.480=0.122
σ0.256-0.230=0.026
min295.380-295.310=0.071
max296.257-296.086=0.171
mean2027.000-1898.000=129.000
σ0.000
min2027.000-1898.000=129.000
max2027.000-1898.000=129.000
mean0.552-0.602=-0.050
σ0.024-0.038=-0.014
min0.528-0.527=0.000
max0.584-0.685=-0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.411=0.001
σ0.034-0.040=-0.006
min285.368-285.357=0.010
max285.445-285.455=-0.010
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.393-0.398=-0.004
σ0.009-0.009=-0.000
min0.383-0.389=-0.006
max0.403-0.412=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.802-1295.795=0.007
σ0.107-0.112=-0.004
min1295.677-1295.675=0.002
max1295.932-1295.928=0.004
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean1.889-1.912=-0.023
σ0.095-0.085=0.010
min1.808-1.833=-0.026
max2.025-2.038=-0.013
iters=5
new-facts=6402
prior-facts=1
mean1539.922-1539.914=0.008
σ6.898-6.902=-0.004
min1536.593-1536.632=-0.040
max1552.256-1552.257=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.359-2.260=0.099
σ0.309-0.247=0.062
min2.046-2.019=0.028
max2.733-2.527=0.206
iters=5
new-facts=6402
prior-facts=6402
mean1857.711-1857.709=0.002
σ0.050-0.051=-0.001
min1857.651-1857.654=-0.002
max1857.777-1857.776=0.001
mean1779.400-1769.800=9.600
σ166.237-123.647=42.590
min1649.000-1645.000=4.000
max2027.000-1898.000=129.000
mean2.872-3.117=-0.245
σ0.116-0.305=-0.189
min2.693-2.869=-0.177
max2.988-3.639=-0.651

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.402-1.367=0.035
σ0.231-0.282=-0.051
min1.207-1.121=0.087
max1.755-1.854=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.001
σ580.935-580.935=0.000
min155.272-155.271=0.001
max1317.143-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.566-0.527=0.039
σ0.604-0.536=0.068
min0.252-0.255=-0.003
max1.472-1.332=0.140
policies=20
mean1552.991-1552.968=0.022
σ0.328-0.325=0.003
min1552.763-1552.746=0.017
max1553.478-1553.452=0.026
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.586-2.599=-0.013
σ0.014-0.028=-0.015
min2.576-2.582=-0.006
max2.606-2.641=-0.035
policies=200
mean15537.940-15537.933=0.006
σ0.083-0.078=0.005
min15537.864-15537.834=0.030
max15538.045-15538.006=0.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean26.211-26.251=-0.040
σ0.050-0.130=-0.080
min26.138-26.154=-0.015
max26.251-26.435=-0.185