Compare commits

Home / Compare 286efd27 .. cdbfa016

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.002
σ0.368-0.370=-0.001
min53.910-53.908=0.002
max55.103-55.109=-0.006
mean413.500-415.000=-1.500
σ0.527-0.000=0.527
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.137-0.138=-0.001
σ0.004-0.004=-0.001
min0.131-0.134=-0.003
max0.142-0.147=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.006-0.006=-0.001
min43.388-43.385=0.003
max43.402-43.403=-0.001
mean414.000-415.100=-1.100
σ0.000-0.316=-0.316
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.123-0.122=0.000
σ0.003-0.004=-0.001
min0.120-0.118=0.002
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.962=0.017
σ0.871-0.904=-0.034
min1006.482-1006.487=-0.006
max1010.581-1010.713=-0.133
mean1047.650-1050.600=-2.950
σ307.736-310.102=-2.366
min553.000-551.000=2.000
max1642.000-1643.000=-1.000
mean1.546-1.561=-0.016
σ0.072-0.119=-0.047
min1.481-1.471=0.010
max1.753-1.841=-0.088

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.421-0.425=-0.004
σ0.138-0.141=-0.003
min0.336-0.325=0.011
max0.666-0.665=0.002
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.882-0.879=0.003
σ0.089-0.109=-0.020
min0.814-0.815=-0.001
max1.034-1.073=-0.039
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.544-0.528=0.016
σ0.043-0.049=-0.007
min0.508-0.478=0.029
max0.615-0.611=0.004
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.837-0.838=-0.002
σ0.038-0.044=-0.006
min0.800-0.805=-0.005
max0.895-0.914=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.840=-0.005
σ0.031-0.034=-0.003
min964.807-964.811=-0.005
max964.888-964.896=-0.008
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.832-0.848=-0.016
σ0.048-0.028=0.020
min0.750-0.799=-0.049
max0.872-0.867=0.005
name=cdr_enhanced_4k_loc.art
mean885.515-885.512=0.002
σ0.005-0.006=-0.001
min885.508-885.505=0.002
max885.519-885.518=0.000
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.698-0.726=-0.028
σ0.042-0.023=0.019
min0.643-0.686=-0.043
max0.734-0.740=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean3.498-4.244=-0.745
σ0.090-0.087=0.003
min3.326-4.116=-0.790
max4.069-4.480=-0.410
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean3.477-4.257=-0.781
σ0.080-0.080=-0.000
min3.365-4.124=-0.760
max3.762-4.517=-0.755
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.744-0.744=-0.000
σ0.027-0.027=0.000
min0.570-0.607=-0.038
max0.856-0.855=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.581-0.701=-0.119
σ0.099-0.023=0.076
min0.487-0.586=-0.098
max0.788-0.797=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.380-295.426=-0.045
σ0.165-0.268=-0.103
min295.277-295.280=-0.004
max295.832-296.172=-0.340
mean1906.000-1913.000=-7.000
σ0.000
min1906.000-1913.000=-7.000
max1906.000-1913.000=-7.000
mean0.574-0.574=-0.000
σ0.041-0.033=0.008
min0.493-0.535=-0.041
max0.627-0.635=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.394=0.019
σ0.037-0.038=-0.001
min285.368-285.350=0.019
max285.453-285.434=0.019
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.387-0.390=-0.004
σ0.007-0.008=-0.001
min0.380-0.380=-0.000
max0.396-0.397=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.782=0.013
σ0.114-0.117=-0.004
min1295.663-1295.655=0.008
max1295.936-1295.926=0.010
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean1.988-1.898=0.090
σ0.276-0.075=0.201
min1.797-1.809=-0.012
max2.467-1.982=0.485
iters=5
new-facts=6402
prior-facts=1
mean1539.974-1539.897=0.077
σ6.833-6.868=-0.035
min1536.707-1536.643=0.064
max1552.192-1552.178=0.014
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean2.403-2.230=0.172
σ0.238-0.195=0.043
min2.052-2.035=0.017
max2.635-2.472=0.162
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.684=0.023
σ0.056-0.063=-0.007
min1857.654-1857.613=0.041
max1857.784-1857.770=0.014
mean1774.200-1772.400=1.800
σ130.550-135.579=-5.030
min1642.000-1643.000=-1.000
max1906.000-1913.000=-7.000
mean3.056-3.130=-0.074
σ0.272-0.373=-0.100
min2.842-2.862=-0.020
max3.525-3.785=-0.260

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.306-1.238=0.068
σ0.279-0.376=-0.097
min1.098-0.930=0.168
max1.779-1.851=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.742-445.705=0.038
σ580.937-580.934=0.003
min155.270-155.236=0.035
max1317.147-1317.106=0.042
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean0.544-0.526=0.018
σ0.561-0.528=0.032
min0.262-0.262=-0.000
max1.385-1.319=0.066
policies=20
mean1552.990-1552.633=0.356
σ0.325-0.333=-0.009
min1552.768-1552.401=0.367
max1553.472-1553.128=0.344
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean2.586-2.590=-0.004
σ0.009-0.016=-0.007
min2.575-2.571=0.004
max2.594-2.609=-0.015
policies=200
mean15537.740-15534.642=3.098
σ0.469-0.134=0.336
min15537.052-15534.555=2.497
max15538.071-15534.839=3.233
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1643.000=-1.000
σ0.000
min1642.000-1643.000=-1.000
max1642.000-1643.000=-1.000
mean26.183-26.082=0.102
σ0.213-0.055=0.158
min26.024-26.049=-0.024
max26.497-26.163=0.334