Compare commits

Home / Compare 5c586852 .. 76e27af4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.000
σ0.370-0.369=0.000
min53.910-53.910=-0.000
max55.106-55.106=0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.142=-0.002
σ0.003-0.004=-0.001
min0.136-0.138=-0.002
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.005-0.007=-0.003
min43.386-43.383=0.003
max43.398-43.406=-0.007
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.120-0.123=-0.003
σ0.003-0.004=-0.001
min0.114-0.119=-0.005
max0.124-0.131=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.000=0.006
σ1.190-1.211=-0.021
min1006.432-1006.442=-0.010
max1011.989-1012.080=-0.091
mean1044.500-1053.300=-8.800
σ305.405-306.095=-0.690
min585.000-579.000=6.000
max1616.000-1651.000=-35.000
mean1.539-1.551=-0.012
σ0.098-0.086=0.012
min1.465-1.472=-0.007
max1.922-1.778=0.144

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.419-0.433=-0.014
σ0.141-0.122=0.020
min0.349-0.348=0.001
max0.671-0.647=0.024
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.002
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.936-0.894=0.041
σ0.185-0.091=0.095
min0.838-0.840=-0.002
max1.267-1.055=0.211
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.001
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.516-0.534=-0.018
σ0.055-0.058=-0.003
min0.479-0.496=-0.017
max0.613-0.635=-0.022
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.831-0.851=-0.020
σ0.041-0.030=0.011
min0.802-0.830=-0.028
max0.904-0.903=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.838=-0.002
σ0.019-0.020=-0.001
min964.820-964.819=0.001
max964.868-964.872=-0.004
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.810-0.796=0.014
σ0.056-0.028=0.028
min0.743-0.769=-0.026
max0.856-0.832=0.024
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.002
σ0.007-0.007=0.001
min885.504
max885.523-885.523=0.000
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.710-0.706=0.004
σ0.040-0.040=-0.000
min0.663-0.653=0.009
max0.741-0.736=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean3.485-4.217=-0.732
σ0.095-0.076=0.018
min3.312-4.094=-0.782
max3.802-4.510=-0.708
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.669=0.000
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean3.781-4.198=-0.417
σ0.389-0.080=0.309
min3.333-4.062=-0.729
max4.481-4.564=-0.082
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.749-0.747=0.002
σ0.024-0.017=0.008
min0.659-0.716=-0.058
max0.855-0.836=0.019
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.666-0.711=-0.044
σ0.082-0.016=0.065
min0.483-0.681=-0.198
max0.768-0.812=-0.044

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.139-296.841=0.298
σ0.201-0.221=-0.020
min296.948-296.621=0.327
max297.677-297.399=0.277
mean2029.000-2024.000=5.000
σ0.000
min2029.000-2024.000=5.000
max2029.000-2024.000=5.000
mean0.547-0.557=-0.010
σ0.033-0.031=0.002
min0.514-0.507=0.007
max0.609-0.584=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.821=-0.002
σ0.037-0.038=-0.001
min286.767-286.771=-0.004
max286.856-286.859=-0.003
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.392-0.395=-0.003
σ0.007-0.007=0.001
min0.385-0.388=-0.003
max0.400-0.403=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.251-1297.228=0.023
σ0.086-0.075=0.011
min1297.145-1297.163=-0.017
max1297.365-1297.328=0.037
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean2.087-2.091=-0.004
σ0.093-0.093=0.000
min1.997-2.001=-0.004
max2.218-2.209=0.010
iters=5
new-facts=6402
prior-facts=1
mean1541.306-1541.352=-0.045
σ6.833-6.822=0.011
min1538.051-1538.164=-0.112
max1553.524-1553.552=-0.028
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean2.179-2.308=-0.130
σ0.097-0.249=-0.153
min2.092-2.135=-0.043
max2.342-2.714=-0.372
iters=5
new-facts=6402
prior-facts=6402
mean1859.108-1859.115=-0.008
σ0.082-0.074=0.008
min1858.989-1859.008=-0.019
max1859.188-1859.187=0.001
mean1773.200-1788.200=-15.000
σ181.104-161.863=19.241
min1616.000-1651.000=-35.000
max2029.000-2024.000=5.000
mean3.056-2.999=0.057
σ0.197-0.086=0.111
min2.832-2.867=-0.035
max3.373-3.082=0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.167=0.007
σ0.207-0.324=-0.117
min0.936-0.935=0.002
max1.419-1.700=-0.281

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.819=0.003
σ581.372-581.372=-0.000
min158.135-158.130=0.005
max1320.881-1320.878=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean0.549-0.529=0.019
σ0.569-0.530=0.039
min0.259-0.261=-0.001
max1.402-1.324=0.078
policies=20
mean1581.626-1581.610=0.015
σ0.361-0.357=0.004
min1581.386-1581.371=0.015
max1582.163-1582.142=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean2.644-2.630=0.014
σ0.017-0.015=0.003
min2.630-2.616=0.014
max2.669-2.648=0.021
policies=200
mean15824.141-15824.233=-0.092
σ0.175-0.122=0.053
min15823.992-15824.134=-0.142
max15824.394-15824.398=-0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1616.000-1651.000=-35.000
σ0.000
min1616.000-1651.000=-35.000
max1616.000-1651.000=-35.000
mean26.538-26.654=-0.116
σ0.072-0.063=0.009
min26.448-26.592=-0.144
max26.624-26.731=-0.107