Compare commits

Home / Compare 7b122a5a .. 89eb1237

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.371-0.368=0.003
min53.907-53.908=-0.000
max55.112-55.102=0.009
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.141-0.135=0.006
σ0.004-0.004=0.000
min0.138-0.132=0.006
max0.148-0.143=0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.001
σ0.006-0.008=-0.002
min43.386-43.385=0.001
max43.406-43.411=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.001
min0.118-0.117=0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.001=0.003
σ1.209-1.213=-0.004
min1006.435-1006.458=-0.024
max1012.074-1012.090=-0.016
mean1050.400-1049.250=1.150
σ308.002-306.136=1.866
min576.000-574.000=2.000
max1643.000-1647.000=-4.000
mean1.567-1.583=-0.016
σ0.081-0.069=0.012
min1.426-1.519=-0.093
max1.826-1.747=0.079

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.414-0.414=0.000
σ0.134-0.136=-0.002
min0.330-0.328=0.002
max0.652-0.654=-0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.876-0.888=-0.011
σ0.100-0.103=-0.003
min0.786-0.824=-0.038
max1.046-1.070=-0.024
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.555-0.534=0.021
σ0.054-0.060=-0.005
min0.505-0.491=0.014
max0.632-0.635=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.848-0.843=0.005
σ0.065-0.047=0.018
min0.802-0.797=0.005
max0.959-0.921=0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.840=-0.003
σ0.031-0.036=-0.005
min964.810-964.811=-0.001
max964.888-964.898=-0.011
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.824-0.815=0.009
σ0.046-0.047=-0.001
min0.745-0.751=-0.007
max0.855-0.860=-0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.008=-0.000
min885.505-885.504=0.001
max885.523-885.523=0.000
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.715-0.706=0.008
σ0.034-0.039=-0.005
min0.662-0.657=0.005
max0.744-0.741=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean4.214-4.258=-0.044
σ0.076-0.101=-0.025
min4.106-4.074=0.032
max4.562-4.674=-0.112
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean4.175-4.263=-0.088
σ0.070-0.084=-0.014
min4.055-4.109=-0.054
max4.500-4.539=-0.040
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.730-0.744=-0.013
σ0.016-0.017=-0.000
min0.696-0.717=-0.021
max0.843-0.842=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.693-0.701=-0.008
σ0.012-0.017=-0.005
min0.660-0.627=0.033
max0.748-0.770=-0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.842-296.860=-0.019
σ0.247-0.230=0.017
min296.656-296.685=-0.029
max297.484-297.478=0.006
mean1900.000-1938.000=-38.000
σ0.000
min1900.000-1938.000=-38.000
max1900.000-1938.000=-38.000
mean0.565-0.588=-0.023
σ0.033-0.023=0.010
min0.517-0.532=-0.016
max0.602-0.611=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.821=0.001
σ0.039-0.039=0.001
min286.772-286.776=-0.003
max286.862-286.870=-0.008
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.397-0.404=-0.007
σ0.007-0.012=-0.005
min0.389-0.392=-0.003
max0.403-0.422=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1297.271-1297.264=0.007
σ0.085-0.108=-0.024
min1297.185-1297.110=0.075
max1297.389-1297.402=-0.013
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean2.172-2.204=-0.032
σ0.078-0.025=0.054
min2.089-2.179=-0.089
max2.265-2.237=0.028
iters=5
new-facts=6402
prior-facts=1
mean1541.334-1541.375=-0.042
σ6.819-6.826=-0.006
min1538.118-1538.205=-0.088
max1553.530-1553.584=-0.054
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean2.211-2.311=-0.099
σ0.085-0.185=-0.100
min2.096-2.166=-0.070
max2.313-2.610=-0.297
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.118=-0.004
σ0.067-0.066=0.001
min1859.023-1859.036=-0.014
max1859.196-1859.184=0.012
mean1769.400-1786.200=-16.800
σ125.373-146.180=-20.808
min1643.000-1647.000=-4.000
max1900.000-1938.000=-38.000
mean3.104-2.979=0.125
σ0.294-0.189=0.105
min2.833-2.825=0.008
max3.583-3.268=0.314

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.182=0.046
σ0.341-0.358=-0.017
min0.944-0.941=0.004
max1.804-1.795=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.001
σ581.371-581.372=-0.002
min158.135-158.131=0.004
max1320.877-1320.879=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean0.562-0.543=0.019
σ0.593-0.557=0.036
min0.265-0.261=0.003
max1.452-1.379=0.073
policies=20
mean1581.637-1581.620=0.017
σ0.373-0.362=0.011
min1581.391-1581.377=0.013
max1582.193-1582.159=0.033
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean2.660-2.647=0.013
σ0.021-0.014=0.007
min2.643-2.634=0.009
max2.687-2.663=0.024
policies=200
mean15824.088-15824.029=0.059
σ0.077-0.144=-0.067
min15823.984-15823.906=0.078
max15824.167-15824.230=-0.063
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1647.000=-4.000
σ0.000
min1643.000-1647.000=-4.000
max1643.000-1647.000=-4.000
mean26.831-26.865=-0.034
σ0.063-0.036=0.028
min26.748-26.830=-0.082
max26.901-26.896=0.005