Compare commits

Home / Compare b624f39a .. c71b7ac7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.000
σ0.369-0.368=0.000
min53.920-53.913=0.007
max55.105-55.103=0.002
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.140=-0.002
σ0.004-0.004=-0.001
min0.132-0.134=-0.002
max0.143-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.008-0.006=0.002
min43.382-43.382=0.000
max43.407-43.404=0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.123-0.120=0.003
σ0.004-0.004=-0.001
min0.118-0.113=0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.007=-0.004
σ1.196-1.186=0.010
min1006.442-1006.437=0.005
max1012.015-1011.970=0.045
mean1053.350-1055.500=-2.150
σ308.036-307.787=0.249
min578.000-581.000=-3.000
max1645.000-1647.000=-2.000
mean1.559-1.545=0.013
σ0.066-0.080=-0.014
min1.489-1.458=0.031
max1.751-1.777=-0.026

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.423-0.424=-0.001
σ0.137-0.131=0.007
min0.349-0.347=0.002
max0.666-0.656=0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.881-0.925=-0.044
σ0.094-0.182=-0.087
min0.821-0.812=0.009
max1.045-1.248=-0.203
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.543-0.545=-0.002
σ0.048-0.042=0.006
min0.508-0.509=-0.001
max0.625-0.616=0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.849-0.851=-0.002
σ0.052-0.037=0.015
min0.818-0.810=0.008
max0.939-0.908=0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.033-0.034=-0.001
min964.816-964.812=0.004
max964.893-964.896=-0.002
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.856-0.827=0.028
σ0.012-0.038=-0.026
min0.845-0.764=0.082
max0.875-0.855=0.019
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.006-0.007=-0.001
min885.505-885.506=-0.000
max885.520-885.524=-0.003
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.733-0.725=0.008
σ0.023-0.026=-0.003
min0.692-0.682=0.010
max0.751-0.747=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean4.225-4.235=-0.010
σ0.086-0.085=0.001
min4.093-4.090=0.002
max4.483-4.715=-0.232
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean4.222-4.231=-0.010
σ0.086-0.075=0.011
min4.075-4.087=-0.013
max4.578-4.503=0.075
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.743-0.742=0.000
σ0.026-0.019=0.008
min0.567-0.712=-0.144
max0.844-0.851=-0.007
name=record_render_syntax_err.art
mean2.166-2.166=0.000
σ0.002-0.002=-0.000
min2.165
max2.169
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.700-0.699=0.001
σ0.025-0.014=0.011
min0.545-0.670=-0.125
max0.760-0.765=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.995-297.055=-0.060
σ0.193-0.244=-0.051
min296.836-296.883=-0.048
max297.516-297.713=-0.197
mean2066.000-2036.000=30.000
σ0.000
min2066.000-2036.000=30.000
max2066.000-2036.000=30.000
mean0.542-0.559=-0.017
σ0.034-0.035=-0.000
min0.502-0.513=-0.012
max0.577-0.598=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.824=-0.007
σ0.039-0.034=0.004
min286.769-286.777=-0.008
max286.856-286.860=-0.004
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.400-0.396=0.003
σ0.008-0.011=-0.003
min0.390-0.386=0.004
max0.408-0.411=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.259-1297.222=0.037
σ0.113-0.058=0.055
min1297.090-1297.163=-0.072
max1297.392-1297.288=0.105
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.215-2.030=0.185
σ0.104-0.041=0.062
min2.125-2.009=0.116
max2.332-2.104=0.229
iters=5
new-facts=6402
prior-facts=1
mean1541.375-1541.335=0.040
σ6.808-6.825=-0.017
min1538.227-1538.116=0.112
max1553.552-1553.540=0.013
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.317-2.276=0.041
σ0.261-0.193=0.068
min2.117-2.117=-0.000
max2.753-2.560=0.192
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1859.117=0.002
σ0.069-0.078=-0.008
min1859.034-1859.003=0.031
max1859.196-1859.194=0.002
mean1800.800-1790.800=10.000
σ181.959-168.768=13.191
min1645.000-1647.000=-2.000
max2066.000-2036.000=30.000
mean2.996-3.032=-0.036
σ0.105-0.056=0.049
min2.842-2.982=-0.141
max3.109-3.107=0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.247-1.187=0.060
σ0.347-0.289=0.058
min0.940-0.933=0.007
max1.801-1.658=0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.818-448.821=-0.003
σ581.373-581.372=0.000
min158.130-158.130=-0.000
max1320.877-1320.880=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.551-0.559=-0.008
σ0.555-0.573=-0.018
min0.265-0.261=0.005
max1.383-1.417=-0.034
policies=20
mean1581.605-1581.626=-0.021
σ0.373-0.353=0.020
min1581.353-1581.386=-0.032
max1582.159-1582.150=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.649-2.631=0.018
σ0.013-0.021=-0.008
min2.633-2.603=0.031
max2.664-2.650=0.014
policies=200
mean15824.175-15824.249=-0.075
σ0.168-0.104=0.064
min15824.021-15824.164=-0.143
max15824.405-15824.387=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean26.742-26.707=0.035
σ0.084-0.127=-0.043
min26.649-26.610=0.039
max26.840-26.894=-0.054