Compare commits

Home / Compare 46b6e2f9 .. 61512480

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.055=-0.001
σ0.369-0.372=-0.003
min53.914-53.909=0.005
max55.103-55.112=-0.010
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.139=-0.002
σ0.005-0.004=0.000
min0.131-0.133=-0.002
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.392=0.001
σ0.005-0.007=-0.003
min43.385-43.382=0.003
max43.401-43.409=-0.008
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.000
min0.114-0.115=-0.001
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.009=-0.005
σ1.241-1.189=0.052
min1006.463-1006.434=0.030
max1012.213-1011.988=0.225
mean1054.650-1052.350=2.300
σ304.799-305.975=-1.177
min593.000-577.000=16.000
max1454.000-1650.000=-196.000
mean1.583-1.560=0.023
σ0.129-0.080=0.050
min1.490-1.494=-0.004
max2.033-1.795=0.238

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.434-0.423=0.010
σ0.155-0.131=0.024
min0.343-0.345=-0.002
max0.706-0.656=0.050
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.001
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.933-0.897=0.036
σ0.108-0.093=0.015
min0.824-0.826=-0.002
max1.089-1.059=0.030
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.001
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.534-0.539=-0.005
σ0.043-0.050=-0.007
min0.500-0.505=-0.005
max0.608-0.626=-0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.851-0.860=-0.009
σ0.036-0.031=0.004
min0.826-0.843=-0.017
max0.912-0.915=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.839=-0.017
σ0.024-0.037=-0.013
min964.802-964.807=-0.005
max964.860-964.900=-0.040
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.797-0.810=-0.013
σ0.093-0.050=0.043
min0.664-0.728=-0.064
max0.866-0.851=0.015
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.005-0.008=-0.002
min885.504
max885.517-885.523=-0.006
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.711-0.718=-0.007
σ0.037-0.033=0.004
min0.654-0.665=-0.011
max0.755-0.748=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean4.316-4.235=0.080
σ0.077-0.095=-0.018
min4.170-4.069=0.101
max4.657-4.584=0.074
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean4.300-4.199=0.101
σ0.082-0.080=0.002
min4.128-4.079=0.049
max4.632-4.518=0.114
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.750-0.746=0.004
σ0.019-0.016=0.003
min0.718-0.719=-0.001
max0.864-0.858=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.711-0.708=0.003
σ0.015-0.024=-0.009
min0.677-0.554=0.123
max0.770-0.791=-0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.068-297.126=-0.058
σ0.266-0.173=0.092
min296.829-297.016=-0.187
max297.769-297.599=0.170
mean1946.000-1951.000=-5.000
σ0.000
min1946.000-1951.000=-5.000
max1946.000-1951.000=-5.000
mean0.584-0.572=0.012
σ0.034-0.033=0.002
min0.516-0.506=0.010
max0.616-0.622=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.816-286.818=-0.003
σ0.042-0.041=0.001
min286.770-286.771=-0.002
max286.866-286.864=0.002
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.405-0.395=0.010
σ0.007-0.007=-0.000
min0.397-0.388=0.009
max0.411-0.402=0.008
iters=5
new-facts=1
prior-facts=6402
mean1297.268-1297.282=-0.013
σ0.103-0.081=0.022
min1297.148-1297.199=-0.051
max1297.406-1297.407=-0.001
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean2.227-2.236=-0.009
σ0.044-0.054=-0.009
min2.189-2.157=0.033
max2.297-2.291=0.006
iters=5
new-facts=6402
prior-facts=1
mean1541.378-1541.349=0.029
σ6.868-6.869=-0.001
min1538.193-1538.104=0.089
max1553.662-1553.634=0.028
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean2.248-2.214=0.034
σ0.210-0.099=0.112
min2.072-2.122=-0.051
max2.588-2.383=0.205
iters=5
new-facts=6402
prior-facts=6402
mean1859.124-1859.117=0.007
σ0.068-0.069=-0.002
min1859.034-1859.029=0.004
max1859.201-1859.188=0.013
mean1745.600-1794.000=-48.400
σ213.463-151.200=62.262
min1454.000-1650.000=-196.000
max1946.000-1951.000=-5.000
mean2.922-2.997=-0.074
σ0.164-0.163=0.000
min2.678-2.838=-0.160
max3.126-3.239=-0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.702-1.187=0.515
σ0.183-0.348=-0.165
min1.411-0.938=0.473
max1.880-1.762=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.968-448.968=-0.000
σ581.665-581.665=0.000
min158.134-158.135=-0.001
max1321.465-1321.465=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean0.558-0.545=0.014
σ0.582-0.562=0.021
min0.267-0.263=0.004
max1.432-1.387=0.045
policies=20
mean1581.626-1581.625=0.002
σ0.357-0.355=0.002
min1581.386-1581.389=-0.003
max1582.157-1582.152=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean2.632-2.645=-0.012
σ0.012-0.004=0.008
min2.616-2.640=-0.024
max2.644-2.649=-0.005
policies=200
mean15824.134-15824.233=-0.099
σ0.181-0.137=0.044
min15824.013-15824.139=-0.126
max15824.401-15824.432=-0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1454.000-1650.000=-196.000
σ0.000
min1454.000-1650.000=-196.000
max1454.000-1650.000=-196.000
mean26.621-26.688=-0.066
σ0.088-0.128=-0.040
min26.554-26.600=-0.047
max26.751-26.877=-0.126