Compare commits

Home / Compare 3e3a955d .. a66882de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.370=-0.001
min53.913-53.907=0.007
max55.105-55.107=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.142-0.141=0.001
σ0.005-0.005=-0.000
min0.137-0.137=0.001
max0.149-0.148=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.392=0.001
σ0.005-0.006=-0.002
min43.387-43.383=0.003
max43.403-43.403=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.123-0.120=0.003
σ0.004-0.004=0.000
min0.119-0.117=0.003
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.002=0.003
σ1.215-1.208=0.007
min1006.459-1006.462=-0.002
max1012.107-1012.070=0.037
mean1047.100-1055.050=-7.950
σ297.561-320.432=-22.871
min578.000-574.000=4.000
max1620.000-1623.000=-3.000
mean1.566-1.554=0.012
σ0.104-0.145=-0.040
min1.403-1.369=0.033
max1.812-2.087=-0.274

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.409-0.415=-0.006
σ0.139-0.124=0.016
min0.320-0.343=-0.023
max0.656-0.634=0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.873-0.881=-0.008
σ0.088-0.088=-0.000
min0.819-0.815=0.004
max1.029-1.035=-0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.537-0.534=0.003
σ0.050-0.042=0.009
min0.497-0.500=-0.003
max0.614-0.604=0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.841-0.836=0.005
σ0.038-0.047=-0.010
min0.807-0.801=0.006
max0.903-0.917=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.836=-0.001
σ0.030-0.030=0.000
min964.810-964.810=0.000
max964.885-964.886=-0.000
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.812-0.814=-0.001
σ0.046-0.037=0.009
min0.748-0.772=-0.025
max0.857-0.853=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.004-0.008=-0.003
min885.504-885.505=-0.001
max885.515-885.524=-0.009
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.724-0.723=0.001
σ0.027-0.033=-0.006
min0.678-0.668=0.010
max0.744-0.756=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.723=-0.003
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean4.262-4.214=0.047
σ0.086-0.085=0.001
min4.120-4.051=0.070
max4.527-4.612=-0.085
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean4.253-4.199=0.054
σ0.088-0.081=0.007
min4.125-4.069=0.057
max4.551-4.506=0.044
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.746-0.740=0.005
σ0.028-0.016=0.012
min0.708-0.714=-0.006
max0.929-0.830=0.099
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.511-0.698=-0.186
σ0.030-0.015=0.015
min0.489-0.672=-0.182
max0.788-0.769=0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.905-297.116=-0.211
σ0.200-0.177=0.023
min296.763-296.924=-0.161
max297.446-297.541=-0.095
mean1900.000-1899.000=1.000
σ0.000
min1900.000-1899.000=1.000
max1900.000-1899.000=1.000
mean0.561-0.589=-0.028
σ0.046-0.023=0.022
min0.500-0.535=-0.035
max0.640-0.617=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-286.820=-0.002
σ0.038-0.040=-0.002
min286.767-286.760=0.006
max286.857-286.857=-0.000
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.399-0.395=0.005
σ0.009-0.006=0.003
min0.390-0.389=0.001
max0.412-0.401=0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.259-1297.280=-0.022
σ0.106-0.083=0.023
min1297.105-1297.185=-0.080
max1297.389-1297.401=-0.013
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean2.213-2.228=-0.016
σ0.036-0.016=0.020
min2.151-2.206=-0.055
max2.247-2.244=0.004
iters=5
new-facts=6402
prior-facts=1
mean1541.416-1541.317=0.099
σ6.778-6.830=-0.053
min1538.288-1538.078=0.210
max1553.539-1553.532=0.006
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean2.399-2.174=0.225
σ0.244-0.153=0.090
min2.148-1.972=0.176
max2.768-2.368=0.400
iters=5
new-facts=6402
prior-facts=6402
mean1859.121-1859.111=0.010
σ0.057-0.068=-0.011
min1859.060-1859.030=0.030
max1859.194-1859.193=0.001
mean1765.000-1765.600=-0.600
σ131.084-129.502=1.582
min1620.000-1623.000=-3.000
max1900.000-1899.000=1.000
mean3.143-3.062=0.082
σ0.333-0.312=0.021
min2.838-2.753=0.085
max3.641-3.514=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.293-1.303=-0.010
σ0.347-0.295=0.052
min0.929-1.065=-0.136
max1.835-1.718=0.117

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.001
min158.134-158.134=-0.000
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean0.567-0.546=0.021
σ0.603-0.560=0.044
min0.259-0.264=-0.005
max1.472-1.386=0.087
policies=20
mean1581.622-1581.634=-0.012
σ0.364-0.371=-0.008
min1581.380-1581.385=-0.005
max1582.164-1582.187=-0.024
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean2.644-2.660=-0.016
σ0.013-0.019=-0.006
min2.634-2.636=-0.002
max2.661-2.676=-0.015
policies=200
mean15824.118-15824.177=-0.058
σ0.202-0.153=0.049
min15823.821-15824.058=-0.237
max15824.274-15824.402=-0.128
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1623.000=-3.000
σ0.000
min1620.000-1623.000=-3.000
max1620.000-1623.000=-3.000
mean26.671-26.813=-0.142
σ0.007-0.084=-0.077
min26.664-26.764=-0.100
max26.677-26.938=-0.261