Compare commits

Home / Compare c4d5b694 .. b8e9d38c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.001
σ0.369-0.369=-0.001
min53.820-53.815=0.005
max55.012-55.015=-0.003
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.138-0.137=0.001
σ0.004-0.006=-0.002
min0.132-0.130=0.002
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.006-0.007=-0.001
min43.313-43.310=0.002
max43.334-43.333=0.000
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.004=-0.000
min0.115-0.118=-0.003
max0.125-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.513=0.004
σ1.163-1.190=-0.028
min1005.948-1005.975=-0.027
max1011.385-1011.501=-0.116
mean1050.150-1056.300=-6.150
σ306.327-312.765=-6.438
min558.000-557.000=1.000
max1640.000-1521.000=119.000
mean1.546-1.565=-0.019
σ0.082-0.052=0.030
min1.479-1.506=-0.027
max1.770-1.673=0.097

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887-0.887=-0.000
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.444-0.420=0.025
σ0.182-0.135=0.047
min0.344-0.331=0.013
max0.768-0.657=0.112
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.932-0.875=0.056
σ0.160-0.089=0.071
min0.834-0.820=0.014
max1.216-1.033=0.183
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.538-0.560=-0.022
σ0.048-0.058=-0.011
min0.496-0.505=-0.009
max0.618-0.637=-0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.848-0.859=-0.011
σ0.032-0.042=-0.009
min0.816-0.826=-0.010
max0.902-0.930=-0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.829=0.010
σ0.034-0.036=-0.002
min964.811-964.807=0.004
max964.895-964.891=0.003
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.811-0.814=-0.003
σ0.046-0.054=-0.008
min0.751-0.729=0.021
max0.861-0.866=-0.006
name=cdr_enhanced_4k_loc.art
mean885.511-885.510=0.001
σ0.006-0.005=0.001
min885.504
max885.519-885.516=0.003
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.701-0.675=0.026
σ0.040-0.050=-0.010
min0.645-0.613=0.033
max0.742-0.739=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean3.511-4.260=-0.750
σ0.076-0.087=-0.011
min3.371-4.116=-0.745
max3.814-4.598=-0.784
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.668=0.003
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean3.457-4.250=-0.793
σ0.070-0.082=-0.012
min3.348-4.050=-0.701
max3.694-4.479=-0.785
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.729-0.743=-0.014
σ0.018-0.028=-0.009
min0.695-0.708=-0.013
max0.845-0.930=-0.085
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.697-0.700=-0.003
σ0.017-0.015=0.002
min0.663-0.669=-0.006
max0.795-0.769=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.422-296.511=-0.088
σ0.182-0.255=-0.072
min296.291-296.306=-0.015
max296.924-297.201=-0.277
mean1918.000-1916.000=2.000
σ0.000
min1918.000-1916.000=2.000
max1918.000-1916.000=2.000
mean0.578-0.573=0.005
σ0.035-0.040=-0.006
min0.500-0.523=-0.023
max0.609-0.666=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.035-285.036=-0.001
σ0.039-0.029=0.010
min284.990-285.004=-0.014
max285.084-285.072=0.012
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.396-0.395=0.001
σ0.016-0.012=0.004
min0.385-0.387=-0.002
max0.420-0.415=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.425=-0.013
σ0.105-0.059=0.047
min1295.297-1295.361=-0.065
max1295.550-1295.482=0.068
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean1.908-2.051=-0.143
σ0.099-0.073=0.026
min1.797-1.985=-0.187
max2.020-2.139=-0.119
iters=5
new-facts=6402
prior-facts=1
mean1539.546-1539.604=-0.058
σ6.854-6.794=0.060
min1536.264-1536.411=-0.146
max1551.803-1551.754=0.049
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean2.180-2.408=-0.228
σ0.228-0.196=0.033
min2.018-2.153=-0.135
max2.581-2.693=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean1857.326-1857.309=0.016
σ0.074-0.076=-0.003
min1857.233-1857.194=0.039
max1857.417-1857.385=0.032
mean1774.200-1760.400=13.800
σ139.414-171.940=-32.526
min1640.000-1521.000=119.000
max1918.000-1916.000=2.000
mean2.989-3.237=-0.248
σ0.178-0.271=-0.094
min2.697-2.871=-0.174
max3.142-3.572=-0.430

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.526=-0.334
σ0.235-0.348=-0.113
min0.925-1.070=-0.145
max1.543-1.847=-0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.196=-0.007
σ581.332-581.340=-0.009
min157.523-157.524=-0.002
max1320.187-1320.207=-0.020
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean0.544-0.569=-0.025
σ0.559-0.600=-0.042
min0.261-0.268=-0.008
max1.382-1.469=-0.087
policies=20
mean1575.546-1575.574=-0.028
σ0.340-0.364=-0.024
min1575.311-1575.328=-0.016
max1576.051-1576.115=-0.064
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean2.611-2.644=-0.033
σ0.021-0.014=0.007
min2.587-2.627=-0.041
max2.633-2.656=-0.023
policies=200
mean15763.624-15763.745=-0.121
σ0.305-0.122=0.182
min15763.173-15763.649=-0.476
max15763.839-15763.918=-0.078
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1521.000=119.000
σ0.000
min1640.000-1521.000=119.000
max1640.000-1521.000=119.000
mean26.467-26.616=-0.149
σ0.106-0.034=0.071
min26.372-26.587=-0.215
max26.618-26.657=-0.039