Compare commits

Home / Compare 3e82d176 .. 7a004480

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.000
σ0.369-0.371=-0.001
min53.870-53.877=-0.007
max55.065-55.069=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.138-0.137=0.001
σ0.006-0.004=0.002
min0.129-0.131=-0.001
max0.147-0.143=0.004
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.006-0.007=-0.001
min43.311-43.310=0.002
max43.332-43.336=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.120=0.000
σ0.004-0.003=0.001
min0.113-0.115=-0.001
max0.128-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.305=0.004
σ1.177-1.188=-0.011
min1005.742-1005.774=-0.032
max1011.236-1011.278=-0.042
mean1055.400-1044.550=10.850
σ314.638-313.337=1.301
min588.000-595.000=-7.000
max1619.000-1638.000=-19.000
mean1.537-1.580=-0.043
σ0.077-0.103=-0.026
min1.367-1.476=-0.110
max1.729-1.814=-0.085

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.415-0.414=0.001
σ0.160-0.138=0.022
min0.321-0.331=-0.010
max0.698-0.658=0.041
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.909-0.874=0.035
σ0.160-0.098=0.062
min0.826-0.815=0.011
max1.193-1.046=0.147
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.608-0.537=0.070
σ0.050-0.052=-0.002
min0.543-0.498=0.045
max0.659-0.627=0.032
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.857-0.877=-0.020
σ0.039-0.055=-0.016
min0.834-0.826=0.008
max0.926-0.957=-0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.113=0.001
σ0.033-0.032=0.001
min964.086-964.088=-0.002
max964.168-964.167=0.001
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.837-0.854=-0.018
σ0.039-0.005=0.033
min0.768-0.847=-0.079
max0.862-0.860=0.001
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.006=0.000
min884.705-884.705=0.000
max884.721-884.721=0.001
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.718-0.715=0.002
σ0.019-0.031=-0.012
min0.696-0.671=0.025
max0.737-0.742=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean3.868-3.552=0.317
σ0.357-0.079=0.279
min3.427-3.423=0.004
max4.587-3.996=0.591
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean4.227-4.094=0.133
σ0.066-0.323=-0.257
min4.101-3.433=0.669
max4.467-4.553=-0.086
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.729-0.737=-0.007
σ0.024-0.019=0.005
min0.570-0.699=-0.129
max0.847-0.855=-0.008
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.697-0.701=-0.004
σ0.013-0.015=-0.002
min0.669-0.668=0.001
max0.766-0.775=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.192-296.160=0.032
σ0.202-0.210=-0.008
min296.054-295.939=0.116
max296.724-296.620=0.104
mean1904.000-1913.000=-9.000
σ0.000
min1904.000-1913.000=-9.000
max1904.000-1913.000=-9.000
mean0.588-0.587=0.000
σ0.015-0.053=-0.038
min0.556-0.512=0.045
max0.604-0.715=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.689=0.006
σ0.035-0.042=-0.007
min284.649-284.651=-0.003
max284.731-284.744=-0.013
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.396-0.398=-0.002
σ0.009-0.013=-0.003
min0.385-0.380=0.004
max0.404-0.411=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.091-1295.075=0.016
σ0.118-0.101=0.016
min1294.968-1294.959=0.009
max1295.249-1295.196=0.053
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean1.890-1.948=-0.058
σ0.096-0.121=-0.026
min1.798-1.814=-0.016
max2.019-2.122=-0.103
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.197=-0.012
σ6.840-6.845=-0.005
min1535.955-1535.906=0.049
max1551.418-1551.437=-0.019
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean2.214-2.330=-0.116
σ0.192-0.191=0.001
min2.040-2.062=-0.022
max2.480-2.570=-0.090
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1856.982=0.006
σ0.050-0.053=-0.003
min1856.941-1856.935=0.006
max1857.064-1857.062=0.002
mean1767.200-1771.800=-4.600
σ135.682-136.710=-1.028
min1619.000-1638.000=-19.000
max1904.000-1913.000=-9.000
mean3.102-3.048=0.053
σ0.353-0.259=0.094
min2.850-2.832=0.017
max3.720-3.497=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.219-1.238=-0.019
σ0.260-0.356=-0.095
min0.932-0.935=-0.003
max1.623-1.839=-0.216

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.785=-0.002
σ581.211-581.212=-0.001
min157.175-157.177=-0.002
max1319.599-1319.603=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean0.550-0.544=0.006
σ0.578-0.566=0.012
min0.259-0.259=0.000
max1.417-1.393=0.024
policies=20
mean1572.078-1572.088=-0.010
σ0.360-0.357=0.003
min1571.832-1571.849=-0.017
max1572.612-1572.619=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean2.624-2.632=-0.008
σ0.012-0.031=-0.019
min2.615-2.607=0.008
max2.641-2.674=-0.033
policies=200
mean15729.009-15729.064=-0.055
σ0.160-0.136=0.024
min15728.839-15728.926=-0.087
max15729.189-15729.243=-0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1638.000=-19.000
σ0.000
min1619.000-1638.000=-19.000
max1619.000-1638.000=-19.000
mean26.497-26.523=-0.025
σ0.122-0.032=0.091
min26.375-26.493=-0.118
max26.667-26.561=0.106