Compare commits

Home / Compare e1491021 .. 5475dd87

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.126-54.126=0.000
σ0.351-0.350=0.001
min53.989-53.992=-0.004
max55.125-55.121=0.004
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.140-0.139=0.001
σ0.006-0.004=0.002
min0.132-0.133=-0.001
max0.150-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.404-43.404=0.000
σ0.006-0.006=-0.000
min43.396-43.394=0.002
max43.417-43.415=0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.123-0.123=0.000
σ0.003-0.003=0.000
min0.120-0.120=0.000
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.334-1006.331=0.002
σ0.870-0.889=-0.019
min1005.835-1005.836=-0.000
max1009.936-1010.023=-0.087
mean1051.800-1047.750=4.050
σ306.550-311.133=-4.583
min577.000-563.000=14.000
max1645.000-1642.000=3.000
mean1.547-1.547=-0.000
σ0.101-0.066=0.036
min1.423-1.478=-0.054
max1.901-1.668=0.234

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=-0.000
min0.881
max0.886
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.428-0.450=-0.022
σ0.127-0.171=-0.044
min0.345-0.356=-0.011
max0.652-0.755=-0.103
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.908-0.912=-0.004
σ0.090-0.140=-0.051
min0.849-0.821=0.029
max1.065-1.160=-0.095
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.547-0.541=0.005
σ0.051-0.054=-0.003
min0.506-0.497=0.009
max0.634-0.630=0.004
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.851-0.850=0.001
σ0.050-0.040=0.009
min0.813-0.808=0.004
max0.935-0.912=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=0.001
σ0.023-0.025=-0.002
min963.535-963.523=0.012
max963.590-963.584=0.006
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.846-0.815=0.031
σ0.010-0.042=-0.033
min0.833-0.756=0.077
max0.855-0.858=-0.003
name=cdr_enhanced_4k_loc.art
mean884.854-884.855=-0.002
σ0.009-0.005=0.003
min884.847
max884.867-884.861=0.006
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.748-0.713=0.035
σ0.007-0.032=-0.025
min0.741-0.668=0.072
max0.760-0.740=0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.711=0.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean4.304-4.276=0.028
σ0.147-0.094=0.052
min4.138-4.128=0.010
max5.411-4.593=0.817
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean4.292-4.252=0.040
σ0.093-0.092=0.001
min4.089-4.117=-0.027
max4.668-4.548=0.119
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.757-0.763=-0.006
σ0.028-0.030=-0.002
min0.543-0.725=-0.183
max0.866-0.929=-0.063
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.714-0.720=-0.006
σ0.014-0.016=-0.002
min0.682-0.683=-0.001
max0.779-0.787=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.533=0.095
σ0.204-0.264=-0.060
min295.406-295.291=0.116
max296.158-296.234=-0.075
mean2017.000-1919.000=98.000
σ0.000
min2017.000-1919.000=98.000
max2017.000-1919.000=98.000
mean0.566-0.596=-0.031
σ0.030-0.040=-0.010
min0.518-0.566=-0.048
max0.594-0.700=-0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.258-285.257=0.000
σ0.036-0.037=-0.001
min285.211-285.205=0.005
max285.294-285.294=0.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.405-0.415=-0.010
σ0.011-0.014=-0.004
min0.392-0.402=-0.010
max0.416-0.439=-0.023
iters=5
new-facts=1
prior-facts=6402
mean1295.208-1295.203=0.006
σ0.113-0.114=-0.000
min1295.081-1295.085=-0.004
max1295.358-1295.356=0.002
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean1.861-1.902=-0.041
σ0.060-0.073=-0.014
min1.798-1.815=-0.017
max1.936-1.978=-0.042
iters=5
new-facts=6402
prior-facts=1
mean1538.098-1538.153=-0.055
σ4.039-4.008=0.030
min1536.046-1536.073=-0.028
max1545.315-1545.313=0.002
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean2.315-2.434=-0.119
σ0.261-0.286=-0.025
min2.044-2.100=-0.056
max2.687-2.754=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.110=-0.000
σ0.049-0.058=-0.009
min1857.071-1857.051=0.020
max1857.175-1857.185=-0.011
mean1774.400-1774.600=-0.200
σ163.627-139.127=24.500
min1645.000-1642.000=3.000
max2017.000-1919.000=98.000
mean3.005-2.941=0.064
σ0.328-0.109=0.219
min2.788-2.858=-0.070
max3.580-3.124=0.456

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.460-1.386=0.074
σ0.310-0.302=0.009
min1.127-1.117=0.009
max1.832-1.853=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.612-443.613=-0.001
σ577.065-577.066=-0.001
min155.078-155.077=0.001
max1309.209-1309.211=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.549-0.557=-0.008
σ0.573-0.588=-0.015
min0.259-0.259=-0.000
max1.408-1.438=-0.030
policies=20
mean1551.069-1551.079=-0.010
σ0.359-0.342=0.017
min1550.828-1550.846=-0.018
max1551.603-1551.587=0.016
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean2.643-2.607=0.036
σ0.063-0.012=0.052
min2.608-2.591=0.017
max2.738-2.618=0.119
policies=200
mean15518.832-15518.815=0.017
σ0.142-0.103=0.039
min15518.672-15518.736=-0.064
max15519.018-15518.962=0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean26.328-26.368=-0.039
σ0.067-0.071=-0.003
min26.233-26.284=-0.051
max26.385-26.452=-0.067