Compare commits

Home / Compare 0aa09be9 .. 6ecc5793

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.964=0.001
σ0.369-0.370=-0.000
min53.824-53.824=0.000
max55.015-55.016=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.140-0.140=0.001
σ0.004-0.004=0.000
min0.136-0.136=0.000
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.001
σ0.006-0.006=0.000
min43.313-43.316=-0.003
max43.334-43.333=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.121-0.123=-0.002
σ0.004-0.004=0.001
min0.115-0.120=-0.005
max0.129-0.131=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.512-1006.513=-0.000
σ1.195-1.208=-0.014
min1005.963-1005.979=-0.016
max1011.517-1011.567=-0.050
mean1035.800-1055.200=-19.400
σ309.963-317.847=-7.884
min546.000-547.000=-1.000
max1502.000-1519.000=-17.000
mean1.556-1.578=-0.022
σ0.074-0.100=-0.026
min1.487-1.496=-0.009
max1.799-1.837=-0.038

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.447-0.437=0.010
σ0.137-0.192=-0.054
min0.358-0.325=0.032
max0.684-0.778=-0.094
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=0.000
min2.337
max2.342-2.342=-0.000
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.893-0.910=-0.018
σ0.097-0.156=-0.059
min0.833-0.820=0.013
max1.065-1.187=-0.122
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.535-0.533=0.003
σ0.047-0.051=-0.004
min0.491-0.492=-0.001
max0.608-0.611=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.851-0.844=0.007
σ0.033-0.042=-0.009
min0.829-0.799=0.030
max0.909-0.909=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.826=0.003
σ0.037-0.034=0.003
min964.807-964.807=0.000
max964.893-964.886=0.007
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.841-0.820=0.021
σ0.027-0.060=-0.033
min0.809-0.717=0.092
max0.871-0.859=0.012
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=-0.001
σ0.007-0.006=0.002
min885.504
max885.521-885.517=0.003
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.696-0.699=-0.003
σ0.048-0.056=-0.008
min0.634-0.616=0.018
max0.745-0.746=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean4.215-3.528=0.687
σ0.083-0.081=0.002
min4.087-3.404=0.684
max4.479-3.791=0.688
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean4.202-3.516=0.686
σ0.085-0.064=0.022
min4.083-3.414=0.670
max4.454-3.754=0.699
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.742-0.544=0.198
σ0.017-0.075=-0.058
min0.710-0.510=0.200
max0.856-1.277=-0.421
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.535-0.494=0.041
σ0.071-0.051=0.019
min0.485-0.294=0.192
max0.791-0.691=0.100

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.379-296.298=0.081
σ0.225-0.240=-0.014
min296.195-296.048=0.147
max296.997-296.914=0.083
mean2023.000-1916.000=107.000
σ0.000
min2023.000-1916.000=107.000
max2023.000-1916.000=107.000
mean0.557-0.591=-0.034
σ0.029-0.051=-0.021
min0.505-0.510=-0.005
max0.583-0.701=-0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.035-285.033=0.002
σ0.039-0.035=0.004
min284.984-284.985=-0.001
max285.076-285.071=0.005
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.394-0.397=-0.003
σ0.007-0.009=-0.002
min0.385-0.388=-0.003
max0.403-0.410=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.420-1295.439=-0.019
σ0.040-0.057=-0.016
min1295.382-1295.367=0.015
max1295.482-1295.510=-0.028
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean2.022-2.131=-0.109
σ0.104-0.177=-0.073
min1.955-1.949=0.007
max2.205-2.408=-0.203
iters=5
new-facts=6402
prior-facts=1
mean1539.562-1539.567=-0.005
σ6.839-6.825=0.014
min1536.337-1536.374=-0.036
max1551.794-1551.774=0.019
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean2.348-2.349=-0.001
σ0.309-0.233=0.076
min1.976-2.111=-0.135
max2.690-2.692=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean1857.317-1857.321=-0.004
σ0.078-0.066=0.012
min1857.197-1857.238=-0.041
max1857.386-1857.392=-0.006
mean1728.600-1750.800=-22.200
σ215.080-172.409=42.671
min1502.000-1519.000=-17.000
max2023.000-1916.000=107.000
mean2.929-3.059=-0.131
σ0.071-0.234=-0.163
min2.861-2.861=-0.000
max3.033-3.391=-0.358

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.553-1.632=-0.080
σ0.189-0.269=-0.080
min1.250-1.211=0.040
max1.740-1.908=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.189=0.003
σ581.331-581.331=0.000
min157.524-157.522=0.002
max1320.189-1320.186=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean0.546-0.556=-0.010
σ0.564-0.567=-0.003
min0.260-0.271=-0.011
max1.391-1.406=-0.015
policies=20
mean1575.568-1575.550=0.018
σ0.353-0.357=-0.004
min1575.331-1575.306=0.025
max1576.093-1576.079=0.014
mean920.000
σ0.000
min920.000
max920.000
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean2.625-2.627=-0.002
σ0.016-0.011=0.005
min2.610-2.615=-0.006
max2.645-2.642=0.003
policies=200
mean15763.758-15763.704=0.055
σ0.078-0.138=-0.060
min15763.699-15763.596=0.103
max15763.866-15763.887=-0.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1502.000-1519.000=-17.000
σ0.000
min1502.000-1519.000=-17.000
max1502.000-1519.000=-17.000
mean26.573-26.620=-0.047
σ0.047-0.053=-0.006
min26.507-26.570=-0.063
max26.613-26.691=-0.078