Compare commits

Home / Compare 12c6572a .. 8a9c7f9c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.000
σ0.371-0.369=0.002
min53.903-53.911=-0.008
max55.109-55.105=0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.139-0.139=-0.000
σ0.004-0.003=0.001
min0.131-0.135=-0.004
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.392=0.001
σ0.005-0.007=-0.003
min43.388-43.383=0.005
max43.402-43.408=-0.006
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.121-0.123=-0.002
σ0.004-0.004=-0.001
min0.115-0.118=-0.003
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.008=-0.002
σ1.193-1.198=-0.005
min1006.444-1006.430=0.014
max1012.004-1012.028=-0.024
mean1051.150-1047.300=3.850
σ305.605-313.194=-7.589
min578.000-593.000=-15.000
max1645.000-1644.000=1.000
mean1.553-1.551=0.002
σ0.080-0.116=-0.036
min1.461-1.370=0.091
max1.735-1.819=-0.083

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.422-0.454=-0.032
σ0.148-0.129=0.019
min0.336-0.370=-0.034
max0.685-0.679=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.896-0.929=-0.032
σ0.103-0.082=0.021
min0.829-0.862=-0.033
max1.078-1.048=0.030
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.528-0.539=-0.011
σ0.058-0.047=0.010
min0.476-0.498=-0.021
max0.626-0.617=0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.852-0.860=-0.008
σ0.039-0.027=0.012
min0.824-0.840=-0.016
max0.919-0.908=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.001
σ0.033-0.034=-0.000
min964.813-964.810=0.003
max964.895-964.894=0.001
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.800-0.843=-0.043
σ0.060-0.016=0.044
min0.729-0.818=-0.089
max0.863-0.861=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.007-0.007=-0.000
min885.505-885.504=0.001
max885.523-885.522=0.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.742-0.706=0.036
σ0.007-0.041=-0.034
min0.730-0.658=0.073
max0.750-0.742=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean4.247-3.475=0.772
σ0.092-0.104=-0.012
min4.094-3.321=0.773
max4.593-4.249=0.344
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean4.220-3.493=0.727
σ0.071-0.070=0.002
min4.058-3.359=0.699
max4.468-3.748=0.720
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.744-0.736=0.008
σ0.027-0.038=-0.011
min0.711-0.526=0.185
max0.931-0.833=0.097
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.693-0.694=-0.001
σ0.028-0.021=0.008
min0.495-0.544=-0.049
max0.790-0.768=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.931-297.130=-0.200
σ0.226-0.185=0.041
min296.801-296.914=-0.113
max297.559-297.595=-0.036
mean1937.000-1899.000=38.000
σ0.000
min1937.000-1899.000=38.000
max1937.000-1899.000=38.000
mean0.593-0.610=-0.017
σ0.026-0.038=-0.011
min0.547-0.578=-0.031
max0.640-0.713=-0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.819=0.006
σ0.037-0.039=-0.002
min286.772-286.768=0.003
max286.862-286.859=0.003
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.395-0.395=0.000
σ0.006-0.008=-0.003
min0.388-0.388=-0.001
max0.401-0.407=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.227=0.026
σ0.073-0.071=0.003
min1297.169-1297.151=0.018
max1297.331-1297.322=0.010
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean2.100-2.078=0.022
σ0.082-0.058=0.024
min2.010-2.006=0.004
max2.166-2.151=0.015
iters=5
new-facts=6402
prior-facts=1
mean1541.299-1541.339=-0.040
σ6.842-6.821=0.021
min1538.044-1538.132=-0.088
max1553.534-1553.538=-0.005
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean2.188-2.265=-0.077
σ0.119-0.196=-0.077
min2.088-2.119=-0.031
max2.392-2.569=-0.178
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.113=0.001
σ0.082-0.083=-0.001
min1859.003-1858.990=0.013
max1859.204-1859.194=0.010
mean1784.600-1769.400=15.200
σ146.700-124.211=22.489
min1645.000-1644.000=1.000
max1937.000-1899.000=38.000
mean2.950-3.136=-0.186
σ0.076-0.277=-0.201
min2.857-2.859=-0.003
max3.046-3.557=-0.511

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.209=0.034
σ0.310-0.324=-0.015
min1.058-0.940=0.117
max1.776-1.732=0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.821=-0.002
σ581.372-581.372=-0.000
min158.132-158.132=-0.000
max1320.876-1320.879=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.539-0.555=-0.016
σ0.553-0.573=-0.020
min0.259-0.263=-0.004
max1.368-1.414=-0.046
policies=20
mean1581.600-1581.632=-0.032
σ0.356-0.365=-0.009
min1581.357-1581.386=-0.029
max1582.128-1582.175=-0.046
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean2.626-2.641=-0.015
σ0.008-0.009=-0.002
min2.615-2.632=-0.017
max2.634-2.655=-0.020
policies=200
mean15824.186-15824.052=0.134
σ0.175-0.276=-0.101
min15824.018-15823.738=0.280
max15824.431-15824.411=0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean26.549-26.574=-0.025
σ0.110-0.107=0.003
min26.424-26.457=-0.032
max26.692-26.705=-0.013