Compare commits

Home / Compare cce4adc3 .. 1331704f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.368-0.370=-0.002
min53.912-53.910=0.002
max55.101-55.109=-0.007
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.137-0.140=-0.003
σ0.006-0.004=0.002
min0.129-0.133=-0.004
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.006-0.008=-0.002
min43.387-43.385=0.002
max43.406-43.407=-0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.120=-0.000
σ0.004-0.004=-0.000
min0.114-0.115=-0.001
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.963-1006.957=0.005
σ0.927-0.892=0.035
min1006.497-1006.490=0.008
max1010.813-1010.661=0.152
mean1051.500-1047.700=3.800
σ309.832-317.556=-7.724
min556.000-545.000=11.000
max1644.000-1648.000=-4.000
mean1.585-1.557=0.028
σ0.144-0.094=0.050
min1.487-1.483=0.004
max2.048-1.821=0.227

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.423-0.449=-0.026
σ0.148-0.218=-0.070
min0.342-0.321=0.021
max0.685-0.837=-0.151
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.901-0.933=-0.032
σ0.117-0.200=-0.082
min0.834-0.831=0.003
max1.110-1.289=-0.178
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.571-0.539=0.032
σ0.060-0.058=0.002
min0.517-0.504=0.013
max0.643-0.641=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.853-0.844=0.009
σ0.052-0.048=0.004
min0.817-0.810=0.006
max0.935-0.925=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.837=0.003
σ0.035-0.022=0.012
min964.812-964.818=-0.006
max964.897-964.874=0.023
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.817-0.793=0.024
σ0.057-0.075=-0.018
min0.727-0.666=0.060
max0.860-0.850=0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.002
σ0.007-0.001=0.006
min885.505-885.513=-0.007
max885.522-885.516=0.006
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.726-0.667=0.059
σ0.031-0.087=-0.056
min0.670-0.545=0.125
max0.744-0.739=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean4.228-3.508=0.720
σ0.079-0.089=-0.010
min4.101-3.328=0.773
max4.682-4.096=0.585
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean4.275-3.496=0.779
σ0.092-0.064=0.028
min4.107-3.369=0.738
max4.617-3.694=0.924
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.766-0.744=0.022
σ0.036-0.021=0.015
min0.619-0.704=-0.085
max0.909-0.858=0.051
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.695-0.695=0.000
σ0.017-0.018=-0.001
min0.670-0.644=0.026
max0.797-0.768=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.806-295.462=0.344
σ0.224-0.214=0.010
min295.586-295.340=0.246
max296.361-296.060=0.301
mean1904.000-1900.000=4.000
σ0.000
min1904.000-1900.000=4.000
max1904.000-1900.000=4.000
mean0.586-0.570=0.015
σ0.041-0.040=0.001
min0.526-0.507=0.019
max0.687-0.625=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.400-285.394=0.006
σ0.037-0.036=0.001
min285.351-285.345=0.006
max285.439-285.430=0.009
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.390-0.387=0.003
σ0.008-0.007=0.001
min0.382-0.380=0.002
max0.401-0.397=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.774-1295.779=-0.005
σ0.109-0.111=-0.002
min1295.663-1295.660=0.002
max1295.904-1295.915=-0.011
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean1.911-1.886=0.025
σ0.103-0.087=0.016
min1.809-1.800=0.009
max2.045-1.985=0.060
iters=5
new-facts=6402
prior-facts=1
mean1539.905-1539.928=-0.023
σ6.888-6.870=0.019
min1536.609-1536.595=0.015
max1552.222-1552.210=0.012
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean2.273-2.369=-0.096
σ0.215-0.208=0.007
min2.048-2.041=0.007
max2.495-2.588=-0.093
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.684=-0.001
σ0.068-0.067=0.002
min1857.603-1857.604=-0.001
max1857.777-1857.776=0.002
mean1773.800-1772.800=1.000
σ125.917-126.029=-0.111
min1644.000-1648.000=-4.000
max1904.000-1900.000=4.000
mean3.064-3.016=0.048
σ0.255-0.302=-0.047
min2.819-2.652=0.167
max3.489-3.478=0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.167=0.054
σ0.365-0.338=0.026
min0.935-0.925=0.010
max1.793-1.725=0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.704-445.707=-0.003
σ580.934-580.934=0.000
min155.232-155.239=-0.007
max1317.105-1317.108=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean0.538-0.542=-0.004
σ0.547-0.561=-0.014
min0.263-0.257=0.006
max1.359-1.384=-0.025
policies=20
mean1552.642-1552.659=-0.017
σ0.344-0.326=0.018
min1552.401-1552.434=-0.033
max1553.152-1553.143=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean2.600-2.588=0.011
σ0.017-0.016=0.001
min2.583-2.571=0.011
max2.622-2.608=0.014
policies=200
mean15534.581-15534.739=-0.157
σ0.109-0.069=0.040
min15534.510-15534.668=-0.158
max15534.743-15534.827=-0.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1648.000=-4.000
σ0.000
min1644.000-1648.000=-4.000
max1644.000-1648.000=-4.000
mean26.110-26.172=-0.062
σ0.052-0.300=-0.248
min26.058-25.955=0.103
max26.176-26.614=-0.438