Compare commits

Home / Compare 55a01783 .. 0c957669

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.033-54.041=-0.008
σ0.370-0.368=0.001
min53.886-53.896=-0.010
max55.084-55.089=-0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.140-0.139=0.001
σ0.005-0.003=0.002
min0.135-0.136=-0.001
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.396=-0.012
σ0.007-0.007=0.000
min43.372-43.385=-0.014
max43.396-43.410=-0.013
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.122-0.124=-0.002
σ0.004-0.006=-0.002
min0.119-0.120=-0.001
max0.129-0.139=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.339-1006.331=0.008
σ0.860-0.896=-0.036
min1005.823-1005.838=-0.015
max1009.876-1010.051=-0.175
mean1053.100-1044.400=8.700
σ310.201-305.094=5.108
min556.000-574.000=-18.000
max1647.000-1660.000=-13.000
mean1.538-1.552=-0.014
σ0.093-0.077=0.016
min1.408-1.463=-0.055
max1.834-1.760=0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.419-0.431=-0.012
σ0.121-0.132=-0.011
min0.352-0.341=0.011
max0.634-0.653=-0.019
name=error_case.art
mean2.334-2.334=0.000
σ0.003-0.002=0.000
min2.332
max2.337
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.885-0.883=0.002
σ0.080-0.093=-0.013
min0.828-0.820=0.008
max1.020-1.045=-0.025
name=heavy_item.art
mean1.521-1.522=-0.001
σ0.001-0.002=-0.000
min1.520
max1.523-1.524=-0.001
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.543-0.578=-0.036
σ0.045-0.063=-0.017
min0.507-0.524=-0.017
max0.621-0.662=-0.041
name=nested_use.art
mean2.356-2.356=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.829-0.887=-0.058
σ0.036-0.067=-0.031
min0.802-0.813=-0.010
max0.892-0.975=-0.083

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.555=-0.004
σ0.025-0.030=-0.005
min963.523
max963.583-963.598=-0.015
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.832-0.824=0.007
σ0.016-0.033=-0.017
min0.818-0.775=0.043
max0.851-0.860=-0.009
name=cdr_enhanced_4k_loc.art
mean884.857-884.855=0.002
σ0.008-0.005=0.003
min884.847
max884.867-884.860=0.007
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.733-0.711=0.021
σ0.011-0.040=-0.029
min0.716-0.649=0.067
max0.742-0.742=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.713-7.710=0.002
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean3.537-3.542=-0.006
σ0.096-0.081=0.015
min3.396-3.377=0.019
max4.068-3.772=0.296
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean3.798-3.516=0.283
σ0.362-0.078=0.285
min3.359-3.289=0.070
max4.446-3.806=0.639
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.753-0.549=0.204
σ0.026-0.019=0.006
min0.551-0.517=0.034
max0.860-0.665=0.195
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.717-0.518=0.200
σ0.014-0.019=-0.004
min0.688-0.496=0.192
max0.785-0.646=0.139

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.532-295.543=-0.011
σ0.220-0.287=-0.067
min295.405-295.287=0.118
max296.141-296.311=-0.170
mean2027.000-1914.000=113.000
σ0.000
min2027.000-1914.000=113.000
max2027.000-1914.000=113.000
mean0.563-0.579=-0.015
σ0.040-0.055=-0.014
min0.502-0.499=0.003
max0.602-0.694=-0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.253-285.243=0.010
σ0.040-0.039=0.001
min285.201-285.193=0.008
max285.295-285.283=0.012
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.391-0.391=0.000
σ0.009-0.009=0.001
min0.383-0.383=-0.000
max0.403-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.207-1295.193=0.015
σ0.115-0.107=0.008
min1295.082-1295.073=0.009
max1295.378-1295.317=0.061
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean1.883-1.969=-0.086
σ0.096-0.195=-0.099
min1.813-1.811=0.002
max2.047-2.288=-0.241
iters=5
new-facts=6402
prior-facts=1
mean1539.366-1539.348=0.018
σ6.852-6.866=-0.014
min1536.079-1536.052=0.027
max1551.618-1551.625=-0.008
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean2.290-2.259=0.031
σ0.120-0.197=-0.076
min2.122-2.043=0.079
max2.425-2.477=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean1857.108-1857.108=0.000
σ0.057-0.051=0.006
min1857.049-1857.059=-0.010
max1857.180-1857.180=0.001
mean1787.800-1780.600=7.200
σ164.638-127.804=36.834
min1647.000-1660.000=-13.000
max2027.000-1914.000=113.000
mean3.052-3.112=-0.061
σ0.249-0.382=-0.133
min2.825-2.861=-0.036
max3.453-3.787=-0.335

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.364-1.345=0.019
σ0.314-0.282=0.032
min1.116-1.107=0.009
max1.884-1.832=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.289-445.290=-0.001
σ580.422-580.425=-0.002
min155.077-155.073=0.004
max1315.922-1315.927=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean0.560-0.534=0.025
σ0.603-0.538=0.065
min0.255-0.261=-0.006
max1.463-1.341=0.123
policies=20
mean1551.036-1551.037=-0.002
σ0.330-0.325=0.005
min1550.810-1550.815=-0.006
max1551.526-1551.520=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean2.579-2.591=-0.012
σ0.015-0.008=0.007
min2.565-2.583=-0.018
max2.596-2.601=-0.004
policies=200
mean15518.583-15518.481=0.102
σ0.067-0.071=-0.004
min15518.509-15518.380=0.129
max15518.665-15518.537=0.128
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1660.000=-13.000
σ0.000
min1647.000-1660.000=-13.000
max1647.000-1660.000=-13.000
mean26.188-26.089=0.099
σ0.123-0.151=-0.028
min26.116-25.939=0.178
max26.372-26.281=0.091