Compare commits

Home / Compare fe03c402 .. a248b3c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.001
σ0.369-0.370=-0.001
min53.826-53.821=0.005
max55.014-55.017=-0.003
mean413.000-419.700=-6.700
σ0.000-0.483=-0.483
min413.000-419.000=-6.000
max413.000-420.000=-7.000
mean0.137-0.139=-0.002
σ0.004-0.004=-0.001
min0.132-0.135=-0.004
max0.143-0.148=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.006=0.000
min43.312-43.313=-0.001
max43.333-43.334=-0.001
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.122-0.122=-0.000
σ0.005-0.003=0.001
min0.116-0.118=-0.003
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.513-1011.205=-4.692
σ1.177-1.185=-0.008
min1005.978-1010.666=-4.689
max1011.432-1016.180=-4.747
mean1044.100-1055.500=-11.400
σ315.200-310.825=4.376
min546.000-591.000=-45.000
max1525.000-1659.000=-134.000
mean1.560-1.542=0.018
σ0.083-0.071=0.012
min1.469-1.464=0.005
max1.798-1.745=0.053

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.425
σ0.140
min0.334
max0.672
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.903
σ0.103
min0.842
max1.085
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.548
σ0.052
min0.501
max0.633
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.857
σ0.043
min0.817
max0.930

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829
σ0.036
min964.802
max964.892
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.840
σ0.018
min0.820
max0.856
name=cdr_enhanced_4k_loc.art
mean885.510
σ0.005
min885.504
max885.517
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.735
σ0.010
min0.720
max0.748

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.721
mean1525.000
σ0.000
min1525.000
max1525.000
mean3.560
σ0.093
min3.386
max3.903
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1525.000
σ0.000
min1525.000
max1525.000
mean3.537
σ0.077
min3.388
max3.778
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.745
σ0.017
min0.716
max0.849
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1525.000
σ0.000
min1525.000
max1525.000
mean0.707
σ0.016
min0.678
max0.783

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.421-301.084=-4.662
σ0.211-0.207=0.005
min296.129-300.883=-4.753
max296.799-301.634=-4.836
mean2022.000-1977.000=45.000
σ0.000
min2022.000-1977.000=45.000
max2022.000-1977.000=45.000
mean0.551-0.538=0.013
σ0.034-0.032=0.002
min0.508-0.508=-0.000
max0.593-0.579=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.024-299.787=-14.762
σ0.035-0.046=-0.011
min284.974-299.718=-14.744
max285.060-299.832=-14.771
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean0.395-0.387=0.008
σ0.007-0.001=0.006
min0.388-0.386=0.002
max0.405-0.387=0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.430-1310.203=-14.773
σ0.057-0.080=-0.023
min1295.381-1310.103=-14.721
max1295.496-1310.315=-14.819
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean2.059-1.869=0.190
σ0.080-0.054=0.026
min1.989-1.800=0.189
max2.193-1.938=0.255
iters=5
new-facts=6402
prior-facts=1
mean1539.573-1554.315=-14.742
σ6.822-6.879=-0.057
min1536.365-1550.988=-14.623
max1551.774-1566.616=-14.842
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean2.360-2.210=0.150
σ0.254-0.135=0.119
min2.117-2.122=-0.005
max2.729-2.441=0.288
iters=5
new-facts=6402
prior-facts=6402
mean1857.321-1872.098=-14.777
σ0.078-0.046=0.032
min1857.199-1872.037=-14.838
max1857.396-1872.140=-14.744
mean1735.000-1770.600=-35.600
σ208.716-130.049=78.667
min1525.000-1659.000=-134.000
max2022.000-1977.000=45.000
mean2.917-2.918=-0.001
σ0.092-0.074=0.018
min2.795-2.848=-0.053
max3.034-3.019=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.611-1.262=0.350
σ0.231-0.280=-0.048
min1.240-0.949=0.292
max1.784-1.558=0.226

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.193-448.217=-0.024
σ581.340-581.362=-0.021
min157.521-157.528=-0.007
max1320.204-1320.260=-0.057
mean96.250
σ8.500
min92.000
max109.000
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean0.546-0.551=-0.005
σ0.572-0.579=-0.008
min0.257-0.260=-0.004
max1.403-1.420=-0.016
policies=20
mean1575.544-1575.592=-0.047
σ0.358-0.339=0.019
min1575.300-1575.389=-0.089
max1576.075-1576.099=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean2.632-2.630=0.002
σ0.010-0.015=-0.005
min2.621-2.610=0.011
max2.645-2.642=0.002
policies=200
mean15763.577-15763.742=-0.164
σ0.105-0.105=-0.000
min15763.492-15763.594=-0.102
max15763.729-15763.844=-0.115
mean9200.000
σ0.000
min9200.000
max9200.000
mean1525.000-1659.000=-134.000
σ0.000
min1525.000-1659.000=-134.000
max1525.000-1659.000=-134.000
mean26.633-26.685=-0.052
σ0.022-0.209=-0.187
min26.605-26.471=0.134
max26.659-26.964=-0.304