Compare commits

Home / Compare 242d85a9 .. f24487aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.002
σ0.369-0.370=-0.001
min53.880-53.868=0.012
max55.066-55.067=-0.000
mean418.000-416.700=1.300
σ0.000-0.483=-0.483
min418.000-416.000=2.000
max418.000-417.000=1.000
mean0.140-0.139=0.001
σ0.004-0.004=0.000
min0.136-0.135=0.001
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.008=-0.001
min43.312-43.309=0.003
max43.334-43.337=-0.004
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.123-0.123=0.000
σ0.008-0.003=0.004
min0.115-0.120=-0.004
max0.141-0.130=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.306=0.001
σ1.186-1.187=-0.002
min1005.777-1005.760=0.016
max1011.277-1011.282=-0.005
mean1049.250-1057.250=-8.000
σ312.487-316.278=-3.791
min600.000-568.000=32.000
max1638.000-1622.000=16.000
mean1.591-1.537=0.054
σ0.097-0.065=0.032
min1.504-1.486=0.018
max1.859-1.744=0.115

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.417
σ0.139
min0.325
max0.661
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.890
σ0.109
min0.822
max1.081
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.543
σ0.054
min0.507
max0.632
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.835
σ0.039
min0.806
max0.896

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114
σ0.032
min964.086
max964.166
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.854
σ0.006
min0.849
max0.865
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.703
max884.721
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.732
σ0.012
min0.710
max0.739

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1638.000
σ0.000
min1638.000
max1638.000
mean4.224
σ0.073
min4.101
max4.477
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000
σ0.000
min1638.000
max1638.000
mean4.230
σ0.087
min4.103
max4.605
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.735
σ0.020
min0.696
max0.846
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000
σ0.000
min1638.000
max1638.000
mean0.690
σ0.016
min0.658
max0.768

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.269-296.106=0.162
σ0.241-0.256=-0.015
min296.060-295.981=0.078
max296.904-296.830=0.075
mean1898.000-1948.000=-50.000
σ0.000
min1898.000-1948.000=-50.000
max1898.000-1948.000=-50.000
mean0.580-0.554=0.026
σ0.045-0.024=0.021
min0.505-0.516=-0.011
max0.670-0.581=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.695=-0.002
σ0.036-0.037=-0.001
min284.653-284.650=0.003
max284.738-284.738=0.000
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean0.397-0.394=0.002
σ0.009-0.008=0.001
min0.385-0.387=-0.003
max0.404-0.404=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.058=0.021
σ0.108-0.082=0.026
min1294.960-1294.952=0.008
max1295.226-1295.158=0.067
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean1.932-1.925=0.007
σ0.088-0.109=-0.020
min1.830-1.802=0.028
max2.040-2.055=-0.016
iters=5
new-facts=6402
prior-facts=1
mean1539.208-1539.191=0.017
σ6.852-6.849=0.002
min1535.921-1535.905=0.016
max1551.461-1551.438=0.023
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean2.203-2.313=-0.110
σ0.224-0.243=-0.019
min2.029-2.011=0.017
max2.588-2.624=-0.036
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.980=-0.001
σ0.059-0.058=0.001
min1856.931-1856.918=0.013
max1857.065-1857.065=-0.000
mean1779.800-1758.800=21.000
σ123.864-131.395=-7.532
min1638.000-1622.000=16.000
max1898.000-1948.000=-50.000
mean2.904-2.878=0.026
σ0.057-0.090=-0.033
min2.853-2.791=0.062
max2.994-2.979=0.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.220=-0.012
σ0.322-0.284=0.038
min0.936-0.942=-0.006
max1.754-1.679=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.804=-0.019
σ581.212-581.229=-0.016
min157.177-157.184=-0.008
max1319.604-1319.647=-0.043
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean0.530-0.547=-0.017
σ0.533-0.561=-0.028
min0.262-0.264=-0.003
max1.329-1.388=-0.059
policies=20
mean1572.104-1572.094=0.010
σ0.358-0.275=0.083
min1571.860-1571.938=-0.077
max1572.637-1572.506=0.131
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean2.632-2.641=-0.009
σ0.008-0.016=-0.008
min2.626-2.630=-0.004
max2.644-2.664=-0.020
policies=200
mean15729.012-15729.053=-0.041
σ0.055-0.106=-0.051
min15728.967-15728.933=0.034
max15729.080-15729.191=-0.111
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1622.000=16.000
σ0.000
min1638.000-1622.000=16.000
max1638.000-1622.000=16.000
mean26.542-26.758=-0.216
σ0.074-0.101=-0.027
min26.464-26.664=-0.200
max26.627-26.859=-0.232