Compare commits

Home / Compare 86c27746 .. 1da67a22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.019-54.016=0.002
σ0.368-0.371=-0.003
min53.879-53.881=-0.002
max55.066-55.072=-0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.140=0.000
σ0.005-0.004=0.001
min0.131-0.135=-0.004
max0.149-0.147=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.000
σ0.005-0.004=0.001
min43.314-43.316=-0.002
max43.329-43.329=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.123=0.000
σ0.004-0.004=-0.001
min0.120-0.119=0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.305=0.001
σ1.173-1.187=-0.015
min1005.770-1005.779=-0.008
max1011.218-1011.282=-0.064
mean1052.200
σ307.194-304.135=3.059
min585.000-586.000=-1.000
max1644.000-1639.000=5.000
mean1.555-1.575=-0.020
σ0.084-0.104=-0.020
min1.469-1.475=-0.006
max1.782-1.855=-0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.417-0.401=0.016
σ0.152-0.112=0.040
min0.334-0.330=0.004
max0.687-0.598=0.089
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.896-0.894=0.002
σ0.094-0.099=-0.005
min0.832-0.825=0.007
max1.060-1.068=-0.008
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.550-0.543=0.008
σ0.062-0.049=0.012
min0.504-0.499=0.005
max0.655-0.624=0.030
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.852-0.865=-0.013
σ0.037-0.035=0.001
min0.821-0.842=-0.021
max0.914-0.926=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.002
σ0.032-0.033=-0.001
min964.088-964.085=0.003
max964.169-964.167=0.002
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.845-0.823=0.022
σ0.013-0.018=-0.005
min0.824-0.806=0.019
max0.855-0.847=0.008
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.000
σ0.008-0.007=0.000
min884.705
max884.723-884.722=0.001
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.699-0.705=-0.006
σ0.039-0.053=-0.014
min0.661-0.635=0.026
max0.746-0.748=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.719=0.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean3.506-4.195=-0.689
σ0.082-0.079=0.002
min3.359-4.085=-0.726
max3.797-4.567=-0.770
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean3.511-4.200=-0.690
σ0.082-0.077=0.005
min3.365-4.071=-0.705
max3.762-4.539=-0.777
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.738-0.740=-0.002
σ0.027-0.028=-0.001
min0.559-0.701=-0.143
max0.856-0.918=-0.062
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.702-0.705=-0.004
σ0.035-0.021=0.015
min0.503-0.676=-0.173
max0.794-0.837=-0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.206-296.344=-0.139
σ0.260-0.215=0.044
min296.010-296.217=-0.206
max296.889-296.932=-0.042
mean1914.000-2065.000=-151.000
σ0.000
min1914.000-2065.000=-151.000
max1914.000-2065.000=-151.000
mean0.577-0.570=0.007
σ0.056-0.013=0.043
min0.509-0.539=-0.030
max0.706-0.582=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.645-284.641=0.004
σ0.063-0.051=0.013
min284.571-284.580=-0.009
max284.717-284.686=0.031
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.402-0.402=-0.000
σ0.012-0.010=0.001
min0.387-0.386=0.000
max0.417-0.412=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.085-1295.084=0.001
σ0.104-0.104=-0.000
min1295.019-1295.006=0.013
max1295.268-1295.266=0.002
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean2.044-1.907=0.136
σ0.118-0.094=0.024
min1.895-1.797=0.098
max2.154-2.017=0.137
iters=5
new-facts=6402
prior-facts=1
mean1539.284-1539.258=0.027
σ6.833-6.859=-0.026
min1535.985-1535.984=0.001
max1551.502-1551.522=-0.020
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean2.321-2.314=0.007
σ0.215-0.207=0.008
min2.022-2.046=-0.024
max2.627-2.505=0.122
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.975=0.005
σ0.079-0.073=0.006
min1856.918-1856.927=-0.008
max1857.088-1857.093=-0.005
mean1774.200-1801.000=-26.800
σ135.426-185.139=-49.713
min1644.000-1639.000=5.000
max1914.000-2065.000=-151.000
mean3.065-2.917=0.148
σ0.255-0.087=0.167
min2.858-2.829=0.029
max3.508-3.040=0.468

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.220=0.002
σ0.328-0.340=-0.012
min0.946-0.934=0.011
max1.770-1.764=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.243-448.244=-0.001
σ581.217-581.216=0.000
min157.631-157.632=-0.001
max1320.068-1320.068=0.000
mean98.250
σ8.500
min94.000
max111.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.533-0.552=-0.019
σ0.540-0.577=-0.037
min0.257-0.261=-0.004
max1.343-1.418=-0.075
policies=20
mean1576.678-1576.657=0.021
σ0.396-0.360=0.036
min1576.416-1576.416=-0.000
max1577.266-1577.191=0.075
mean940.000
σ0.000
min940.000
max940.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean2.702-2.633=0.069
σ0.062-0.006=0.057
min2.640-2.625=0.014
max2.781-2.639=0.142
policies=200
mean15774.794-15774.818=-0.024
σ0.146-0.079=0.067
min15774.710-15774.770=-0.060
max15775.011-15774.935=0.076
mean9400.000
σ0.000
min9400.000
max9400.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean26.738-26.709=0.029
σ0.090-0.052=0.038
min26.631-26.660=-0.029
max26.831-26.777=0.054