Compare commits

Home / Compare 2b70c76a .. c51395da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.001
σ0.367-0.370=-0.003
min53.828-53.822=0.006
max55.007-55.018=-0.010
mean417.700-416.000=1.700
σ0.483-0.000=0.483
min417.000-416.000=1.000
max418.000-416.000=2.000
mean0.140-0.139=0.001
σ0.004-0.004=0.000
min0.135-0.136=-0.001
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.008=-0.001
min43.316-43.309=0.007
max43.335-43.338=-0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.121=0.000
σ0.004-0.002=0.002
min0.116-0.118=-0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.510=0.005
σ1.169-1.199=-0.030
min1005.950-1005.976=-0.026
max1011.405-1011.544=-0.139
mean1041.500-1056.500=-15.000
σ311.560-320.726=-9.166
min552.000-544.000=8.000
max1511.000-1626.000=-115.000
mean1.545-1.556=-0.011
σ0.074-0.084=-0.010
min1.467-1.486=-0.019
max1.728-1.779=-0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887-0.887=0.000
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.435-0.443=-0.008
σ0.171-0.180=-0.009
min0.330-0.328=0.002
max0.740-0.763=-0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.919-0.931=-0.012
σ0.135-0.165=-0.030
min0.840-0.833=0.007
max1.157-1.222=-0.065
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.547-0.541=0.005
σ0.053-0.044=0.009
min0.497-0.499=-0.002
max0.633-0.614=0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.856-0.851=0.005
σ0.045-0.045=0.000
min0.821-0.816=0.005
max0.934-0.927=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.839=-0.009
σ0.025-0.034=-0.008
min964.807-964.812=-0.005
max964.870-964.896=-0.027
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.811-0.803=0.009
σ0.038-0.027=0.012
min0.762-0.785=-0.023
max0.852-0.847=0.005
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.006-0.007=-0.001
min885.504
max885.516-885.522=-0.005
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.677-0.732=-0.055
σ0.051-0.017=0.035
min0.609-0.703=-0.094
max0.746-0.744=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean4.224-4.210=0.015
σ0.076-0.083=-0.007
min4.093-4.095=-0.002
max4.570-4.515=0.055
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.668=0.003
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean4.202-3.693=0.509
σ0.065-0.344=-0.279
min4.085-3.343=0.742
max4.453-4.334=0.119
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.762-0.743=0.019
σ0.020-0.018=0.002
min0.719-0.711=0.008
max0.865-0.848=0.016
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.713-0.542=0.172
σ0.018-0.074=-0.057
min0.652-0.488=0.164
max0.784-0.777=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.453-296.408=0.045
σ0.204-0.224=-0.019
min296.286-296.285=0.000
max296.984-297.030=-0.046
mean1922.000-2028.000=-106.000
σ0.000
min1922.000-2028.000=-106.000
max1922.000-2028.000=-106.000
mean0.581-0.560=0.021
σ0.049-0.029=0.019
min0.504-0.504=-0.000
max0.682-0.581=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.033-285.030=0.002
σ0.038-0.040=-0.002
min284.979-284.976=0.002
max285.075-285.071=0.004
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.406-0.403=0.004
σ0.007-0.012=-0.005
min0.399-0.384=0.015
max0.415-0.413=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.459-1295.430=0.029
σ0.051-0.121=-0.069
min1295.404-1295.298=0.106
max1295.519-1295.590=-0.072
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean2.166-1.893=0.274
σ0.132-0.079=0.053
min2.007-1.819=0.188
max2.366-2.006=0.360
iters=5
new-facts=6402
prior-facts=1
mean1539.569-1539.516=0.053
σ6.846-6.856=-0.011
min1536.345-1536.231=0.114
max1551.812-1551.776=0.035
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean2.332-2.236=0.096
σ0.187-0.225=-0.038
min2.117-1.932=0.185
max2.549-2.456=0.093
iters=5
new-facts=6402
prior-facts=6402
mean1857.315-1857.325=-0.010
σ0.074-0.061=0.013
min1857.208-1857.258=-0.050
max1857.396-1857.402=-0.006
mean1752.000-1776.800=-24.800
σ177.990-173.573=4.417
min1511.000-1626.000=-115.000
max1922.000-2028.000=-106.000
mean3.100-3.118=-0.018
σ0.318-0.288=0.030
min2.844-2.848=-0.005
max3.589-3.553=0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.508-1.262=0.246
σ0.383-0.387=-0.003
min0.964-0.938=0.026
max1.850-1.889=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.194-448.193=0.001
σ581.341-581.341=-0.001
min157.521-157.519=0.002
max1320.205-1320.205=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean0.541-0.541=0.000
σ0.543-0.553=-0.010
min0.268-0.252=0.016
max1.355-1.370=-0.015
policies=20
mean1575.558-1575.555=0.003
σ0.361-0.358=0.003
min1575.316-1575.314=0.002
max1576.095-1576.088=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean2.643-2.630=0.013
σ0.017-0.027=-0.009
min2.626-2.602=0.024
max2.662-2.666=-0.004
policies=200
mean15763.699-15763.671=0.029
σ0.133-0.097=0.036
min15763.590-15763.530=0.060
max15763.883-15763.749=0.134
mean9200.000
σ0.000
min9200.000
max9200.000
mean1511.000-1626.000=-115.000
σ0.000
min1511.000-1626.000=-115.000
max1511.000-1626.000=-115.000
mean26.564-26.562=0.002
σ0.030-0.025=0.005
min26.520-26.532=-0.013
max26.584-26.594=-0.010