Compare commits

Home / Compare a6133706 .. 0f4c050e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.003
σ0.369-0.369=0.000
min53.915-53.906=0.009
max55.107-55.103=0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.140-0.138=0.002
σ0.004-0.004=-0.000
min0.134-0.131=0.003
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.005=0.001
min43.385-43.386=-0.002
max43.406-43.402=0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.122-0.123=-0.001
σ0.004-0.003=0.001
min0.117-0.120=-0.003
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.004=0.000
σ1.204-1.213=-0.008
min1006.461-1006.461=-0.000
max1012.058-1012.090=-0.032
mean1051.550-1052.500=-0.950
σ315.922-307.895=8.027
min576.000-577.000=-1.000
max1649.000-1644.000=5.000
mean1.577-1.575=0.002
σ0.108-0.081=0.028
min1.412-1.482=-0.070
max1.873-1.797=0.075

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.416-0.410=0.005
σ0.137-0.132=0.005
min0.319-0.332=-0.012
max0.658-0.646=0.012
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.880-0.887=-0.007
σ0.095-0.098=-0.003
min0.825-0.822=0.003
max1.048-1.060=-0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.536-0.537=-0.001
σ0.054-0.045=0.009
min0.494-0.495=-0.002
max0.629-0.609=0.020
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=0.001
min2.360
max2.365-2.364=0.002
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.853-0.856=-0.003
σ0.028-0.039=-0.011
min0.832-0.819=0.013
max0.901-0.923=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.033-0.033=0.000
min964.811-964.811=-0.000
max964.895-964.893=0.002
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.830-0.833=-0.003
σ0.035-0.029=0.007
min0.781-0.789=-0.008
max0.858-0.856=0.002
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=0.000
σ0.007-0.007=0.000
min885.504
max885.522-885.522=0.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.706-0.688=0.018
σ0.039-0.050=-0.012
min0.664-0.626=0.038
max0.743-0.743=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean4.260-4.246=0.014
σ0.076-0.091=-0.015
min4.141-4.119=0.021
max4.562-4.723=-0.161
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean4.246-4.246=0.001
σ0.065-0.097=-0.031
min4.132-4.125=0.006
max4.559-4.519=0.039
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.740-0.745=-0.005
σ0.019-0.021=-0.002
min0.710-0.714=-0.005
max0.860-0.875=-0.015
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.701-0.697=0.004
σ0.018-0.016=0.002
min0.662-0.672=-0.010
max0.783-0.796=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.062-296.880=0.182
σ0.278-0.233=0.045
min296.901-296.622=0.280
max297.828-297.467=0.361
mean2028.000-2033.000=-5.000
σ0.000
min2028.000-2033.000=-5.000
max2028.000-2033.000=-5.000
mean0.555-0.561=-0.006
σ0.034-0.042=-0.008
min0.505-0.498=0.007
max0.587-0.606=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.824=-0.002
σ0.038-0.037=0.001
min286.771-286.773=-0.002
max286.866-286.862=0.003
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.394-0.396=-0.002
σ0.006-0.008=-0.002
min0.389-0.389=-0.000
max0.401-0.406=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.284-1297.268=0.016
σ0.085-0.081=0.004
min1297.180-1297.169=0.011
max1297.403-1297.377=0.026
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean2.267-2.111=0.157
σ0.069-0.100=-0.031
min2.162-1.999=0.164
max2.336-2.247=0.090
iters=5
new-facts=6402
prior-facts=1
mean1541.336-1541.316=0.019
σ6.825-6.865=-0.040
min1538.124-1538.047=0.077
max1553.542-1553.593=-0.051
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean2.214-2.227=-0.013
σ0.107-0.165=-0.057
min2.125-2.117=0.007
max2.389-2.515=-0.126
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.108=0.009
σ0.062-0.079=-0.017
min1859.033-1858.992=0.041
max1859.189-1859.184=0.005
mean1789.600-1781.600=8.000
σ165.657-168.580=-2.923
min1649.000-1644.000=5.000
max2028.000-2033.000=-5.000
mean3.058-2.996=0.062
σ0.339-0.310=0.028
min2.832-2.772=0.060
max3.647-3.520=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.164=0.081
σ0.319-0.334=-0.015
min0.938-0.937=0.001
max1.644-1.739=-0.095

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=0.000
min158.134-158.134=0.000
max1320.880-1320.880=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean0.553-0.548=0.005
σ0.576-0.567=0.009
min0.262-0.260=0.001
max1.417-1.399=0.018
policies=20
mean1581.631-1581.630=0.001
σ0.366-0.362=0.004
min1581.382-1581.390=-0.007
max1582.174-1582.168=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean2.650-2.646=0.004
σ0.018-0.012=0.006
min2.631-2.629=0.002
max2.671-2.657=0.014
policies=200
mean15824.137-15824.206=-0.069
σ0.114-0.042=0.071
min15824.011-15824.153=-0.143
max15824.279-15824.254=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1644.000=5.000
σ0.000
min1649.000-1644.000=5.000
max1649.000-1644.000=5.000
mean26.734-26.713=0.021
σ0.028-0.036=-0.007
min26.699-26.680=0.019
max26.764-26.756=0.008