Compare commits

Home / Compare cb381663 .. bdc2bee1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.711=-0.002
σ0.371-0.368=0.003
min53.563-53.572=-0.009
max54.765-54.758=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.140-0.149=-0.009
σ0.004-0.012=-0.008
min0.137-0.131=0.005
max0.147-0.164=-0.017
cache=y
dps=1
iters=10
policies=100
mean43.058-43.058=-0.000
σ0.006-0.007=-0.001
min43.048-43.047=0.001
max43.065-43.069=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.120-0.121=-0.001
σ0.002-0.004=-0.001
min0.116-0.115=0.001
max0.125-0.127=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.109=-0.004
σ0.886-0.892=-0.006
min1004.634-1004.641=-0.006
max1008.779-1008.795=-0.016
mean1061.300-1047.350=13.950
σ328.217-297.447=30.770
min551.000-592.000=-41.000
max1628.000-1438.000=190.000
mean1.639-1.632=0.007
σ0.093-0.079=0.014
min1.556-1.496=0.059
max1.915-1.854=0.061

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.906-0.906=0.000
σ0.003-0.002=0.001
min0.904
max0.910-0.908=0.002
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.441-0.430=0.012
σ0.161-0.153=0.008
min0.340-0.340=-0.001
max0.726-0.700=0.026
name=error_case.art
mean2.335-2.335=0.000
σ0.003-0.003=0.001
min2.333
max2.340-2.339=0.002
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.873-0.871=0.002
σ0.106-0.093=0.012
min0.803-0.810=-0.008
max1.057-1.034=0.023
name=heavy_item.art
mean1.522
σ0.002
min1.521
max1.525
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.549-0.544=0.005
σ0.047-0.056=-0.009
min0.507-0.503=0.004
max0.627-0.640=-0.013
name=nested_use.art
mean2.357
σ0.002
min2.356
max2.360
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.833-0.842=-0.009
σ0.039-0.040=-0.000
min0.804-0.803=0.001
max0.900-0.908=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.443-964.430=0.012
σ0.024-0.033=-0.008
min964.423-964.412=0.011
max964.483-964.488=-0.005
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.841-0.806=0.035
σ0.023-0.063=-0.040
min0.809-0.700=0.109
max0.865-0.860=0.006
name=cdr_enhanced_4k_loc.art
mean885.846-885.846=0.000
σ0.009-0.006=0.003
min885.839
max885.859-885.853=0.006
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.718-0.680=0.037
σ0.037-0.077=-0.039
min0.665-0.549=0.115
max0.747-0.738=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708-7.708=0.000
σ0.002-0.002=0.000
min7.707
max7.712-7.711=0.002
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean4.287-4.235=0.052
σ0.086-0.084=0.002
min4.131-4.112=0.019
max4.657-4.538=0.120
name=record_render_large_syntax_err.art
mean7.656-7.656=-0.000
σ0.002-0.002=-0.000
min7.655
max7.659
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean4.251-4.265=-0.014
σ0.076-0.077=-0.001
min4.132-4.127=0.005
max4.515-4.505=0.011
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.747-0.751=-0.004
σ0.028-0.019=0.009
min0.562-0.716=-0.154
max0.848-0.869=-0.021
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.708-0.718=-0.010
σ0.015-0.017=-0.001
min0.670-0.688=-0.018
max0.780-0.795=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.207-294.147=0.059
σ0.257-0.250=0.007
min294.040-293.914=0.126
max294.914-294.728=0.187
mean1933.000-2020.000=-87.000
σ0.000
min1933.000-2020.000=-87.000
max1933.000-2020.000=-87.000
mean0.573-0.556=0.016
σ0.019-0.036=-0.017
min0.534-0.502=0.032
max0.589-0.592=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.497=-0.000
σ0.039-0.034=0.004
min281.442-281.457=-0.015
max281.537-281.539=-0.002
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.398-0.390=0.008
σ0.007-0.006=0.000
min0.390-0.386=0.005
max0.407-0.402=0.005
iters=5
new-facts=1
prior-facts=6402
mean1291.477-1291.489=-0.012
σ0.113-0.118=-0.005
min1291.364-1291.356=0.008
max1291.655-1291.642=0.013
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean1.954-1.875=0.079
σ0.160-0.086=0.074
min1.797-1.796=0.001
max2.224-2.007=0.216
iters=5
new-facts=6402
prior-facts=1
mean1534.333-1534.336=-0.002
σ4.005-4.076=-0.072
min1532.337-1532.294=0.043
max1541.489-1541.618=-0.129
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean2.164-2.371=-0.207
σ0.155-0.379=-0.224
min2.040-2.034=0.006
max2.402-2.931=-0.528
iters=5
new-facts=6402
prior-facts=6402
mean1853.352-1853.349=0.003
σ0.059-0.057=0.002
min1853.296-1853.298=-0.002
max1853.438-1853.428=0.010
mean1789.000-1725.800=63.200
σ145.638-231.141=-85.503
min1628.000-1438.000=190.000
max1933.000-2020.000=-87.000
mean3.043-3.010=0.033
σ0.257-0.297=-0.040
min2.768-2.833=-0.066
max3.428-3.530=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.432-1.835=-0.402
σ0.266-0.051=0.215
min1.241-1.780=-0.539
max1.890-1.899=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.511-442.514=-0.002
σ577.234-577.234=-0.001
min153.893-153.896=-0.003
max1308.362-1308.365=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean0.541-0.540=0.000
σ0.566-0.562=0.004
min0.256-0.258=-0.003
max1.390-1.384=0.006
policies=20
mean1539.197-1539.225=-0.028
σ0.323-0.318=0.005
min1538.973-1539.005=-0.032
max1539.676-1539.698=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean2.572-2.578=-0.006
σ0.017-0.011=0.007
min2.556-2.563=-0.007
max2.595-2.588=0.007
policies=200
mean15400.284-15400.394=-0.110
σ0.100-0.102=-0.003
min15400.227-15400.246=-0.020
max15400.433-15400.465=-0.032
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1438.000=190.000
σ0.000
min1628.000-1438.000=190.000
max1628.000-1438.000=190.000
mean26.005-26.032=-0.027
σ0.108-0.076=0.032
min25.868-25.960=-0.092
max26.093-26.134=-0.041