Compare commits

Home / Compare 3bc66610 .. f94f23f7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.000
σ0.370-0.371=-0.000
min53.871-53.869=0.002
max55.068-55.070=-0.001
mean417.000-417.700=-0.700
σ0.000-0.483=-0.483
min417.000
max417.000-418.000=-1.000
mean0.139-0.139=-0.000
σ0.005-0.004=0.002
min0.132-0.136=-0.004
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.008-0.006=0.001
min43.308-43.312=-0.004
max43.333-43.336=-0.003
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.001
min0.115-0.119=-0.004
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.307=0.001
σ1.173-1.179=-0.007
min1005.778-1005.768=0.010
max1011.207-1011.242=-0.036
mean1056.700-1048.350=8.350
σ303.448-313.433=-9.986
min600.000-598.000=2.000
max1454.000-1645.000=-191.000
mean1.569-1.548=0.022
σ0.101-0.082=0.019
min1.473-1.435=0.038
max1.804-1.776=0.028

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.417-0.411=0.005
σ0.134-0.137=-0.003
min0.347-0.335=0.011
max0.656-0.655=0.001
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.892-0.892=0.000
σ0.103-0.095=0.008
min0.818-0.829=-0.011
max1.071-1.059=0.012
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.542-0.542=-0.001
σ0.052-0.054=-0.001
min0.502-0.505=-0.004
max0.632-0.634=-0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.847-0.840=0.007
σ0.045-0.027=0.018
min0.810-0.823=-0.012
max0.922-0.887=0.035

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.115=-0.013
σ0.036-0.032=0.004
min964.077-964.087=-0.010
max964.165-964.167=-0.002
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.834-0.803=0.032
σ0.025-0.044=-0.020
min0.815-0.749=0.066
max0.868-0.851=0.017
name=cdr_enhanced_4k_loc.art
mean884.709-884.711=-0.002
σ0.006-0.008=-0.002
min884.703
max884.718-884.722=-0.004
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.724-0.722=0.002
σ0.019-0.027=-0.009
min0.704-0.683=0.020
max0.744-0.754=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.002
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean4.209-4.212=-0.003
σ0.076-0.075=0.000
min4.085-4.057=0.028
max4.518-4.461=0.058
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean4.167-4.216=-0.049
σ0.074-0.074=0.000
min4.046-4.085=-0.039
max4.434-4.461=-0.028
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.731-0.736=-0.005
σ0.017-0.019=-0.001
min0.693-0.704=-0.011
max0.849-0.858=-0.010
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.694-0.694=-0.000
σ0.014-0.013=0.001
min0.664-0.665=-0.001
max0.775-0.763=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.209-296.142=0.067
σ0.246-0.222=0.024
min296.001-295.964=0.037
max296.851-296.742=0.109
mean1906.000-1903.000=3.000
σ0.000
min1906.000-1903.000=3.000
max1906.000-1903.000=3.000
mean0.566-0.583=-0.017
σ0.038-0.049=-0.011
min0.509-0.513=-0.004
max0.618-0.692=-0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.692=0.003
σ0.035-0.039=-0.004
min284.655-284.642=0.014
max284.736-284.741=-0.004
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.397-0.398=-0.001
σ0.009-0.012=-0.003
min0.385-0.383=0.001
max0.405-0.409=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.077=-0.002
σ0.065-0.107=-0.042
min1294.999-1294.962=0.037
max1295.152-1295.210=-0.058
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean2.015-1.923=0.091
σ0.040-0.101=-0.061
min1.975-1.806=0.169
max2.080-2.025=0.055
iters=5
new-facts=6402
prior-facts=1
mean1539.212-1539.185=0.027
σ6.818-6.857=-0.039
min1536.035-1535.944=0.091
max1551.405-1551.447=-0.041
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean2.304-2.253=0.051
σ0.275-0.225=0.050
min2.109-2.042=0.067
max2.752-2.509=0.243
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.990=-0.010
σ0.070-0.052=0.018
min1856.903-1856.940=-0.037
max1857.066-1857.063=0.002
mean1744.200-1772.000=-27.800
σ175.332-128.183=47.148
min1496.000-1645.000=-149.000
max1906.000-1903.000=3.000
mean3.096-3.075=0.020
σ0.199-0.274=-0.075
min2.844-2.871=-0.026
max3.337-3.549=-0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.648-1.205=0.443
σ0.159-0.288=-0.129
min1.454-0.947=0.506
max1.895-1.680=0.216

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.001
σ581.212-581.212=0.001
min157.177-157.176=0.001
max1319.604-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean0.525-0.519=0.006
σ0.533-0.509=0.023
min0.258-0.263=-0.005
max1.324-1.282=0.042
policies=20
mean1572.101-1572.104=-0.003
σ0.358-0.360=-0.002
min1571.861-1571.858=0.003
max1572.633-1572.639=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean2.635-2.630=0.005
σ0.021-0.009=0.013
min2.607-2.622=-0.015
max2.659-2.641=0.018
policies=200
mean15729.048-15729.098=-0.050
σ0.129-0.115=0.014
min15728.942-15729.011=-0.070
max15729.229-15729.264=-0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1454.000-1645.000=-191.000
σ0.000
min1454.000-1645.000=-191.000
max1454.000-1645.000=-191.000
mean26.505-26.462=0.043
σ0.153-0.051=0.102
min26.379-26.422=-0.043
max26.720-26.529=0.191