Compare commits

Home / Compare 42fb2822 .. be81eccf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.963=0.002
σ0.369-0.368=0.000
min53.826-53.826=-0.001
max55.014-55.011=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.140-0.139=0.001
σ0.004-0.004=-0.000
min0.133-0.133=0.000
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.007-0.006=0.001
min43.314-43.313=0.001
max43.339-43.333=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.119=0.002
σ0.004-0.004=0.000
min0.114-0.114=0.000
max0.127-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.565-1006.569=-0.003
σ1.445-1.430=0.015
min1005.942-1005.941=0.000
max1012.654-1012.584=0.070
mean1047.500-1051.400=-3.900
σ305.053-313.459=-8.407
min588.000-547.000=41.000
max1638.000-1516.000=122.000
mean1.543-1.555=-0.012
σ0.062-0.051=0.011
min1.470-1.491=-0.021
max1.702-1.632=0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.439-0.440=-0.001
σ0.180-0.179=0.001
min0.336-0.331=0.005
max0.759-0.758=0.001
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.910-0.919=-0.008
σ0.150-0.161=-0.011
min0.812-0.819=-0.007
max1.175-1.204=-0.029
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.533-0.537=-0.004
σ0.050-0.050=-0.000
min0.492-0.492=-0.000
max0.614-0.622=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.952-0.832=0.121
σ0.175-0.044=0.131
min0.834-0.801=0.033
max1.259-0.909=0.350

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.831=0.009
σ0.033-0.024=0.009
min964.812-964.813=-0.001
max964.894-964.870=0.024
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.819-0.811=0.008
σ0.061-0.076=-0.014
min0.713-0.675=0.038
max0.865-0.849=0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.007=-0.000
min885.505-885.504=0.001
max885.523-885.521=0.002
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.717-0.714=0.003
σ0.041-0.031=0.010
min0.649-0.673=-0.024
max0.752-0.741=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean4.246-4.204=0.041
σ0.076-0.076=-0.001
min4.097-4.060=0.036
max4.557-4.469=0.088
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean4.216-4.189=0.028
σ0.082-0.085=-0.003
min4.076-4.044=0.031
max4.464-4.454=0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.739-0.696=0.043
σ0.019-0.088=-0.069
min0.709-0.520=0.189
max0.853-0.858=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.701-0.508=0.194
σ0.017-0.012=0.005
min0.646-0.488=0.158
max0.787-0.565=0.222

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.450-297.597=-0.147
σ0.177-0.221=-0.043
min297.307-297.413=-0.106
max297.924-298.184=-0.260
mean1895.000-2033.000=-138.000
σ0.000
min1895.000-2033.000=-138.000
max1895.000-2033.000=-138.000
mean0.568-0.544=0.024
σ0.045-0.038=0.007
min0.500-0.504=-0.004
max0.643-0.603=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.225-286.223=0.002
σ0.036-0.035=0.001
min286.180-286.177=0.003
max286.266-286.261=0.006
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.397-0.401=-0.005
σ0.006-0.008=-0.002
min0.388-0.394=-0.006
max0.406-0.413=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1296.636-1296.673=-0.036
σ0.076-0.099=-0.023
min1296.541-1296.538=0.004
max1296.722-1296.803=-0.081
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean2.066-2.245=-0.179
σ0.051-0.059=-0.008
min2.007-2.171=-0.165
max2.129-2.315=-0.186
iters=5
new-facts=6402
prior-facts=1
mean1540.776-1540.775=0.002
σ6.890-6.846=0.044
min1537.483-1537.586=-0.103
max1553.098-1553.020=0.078
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean2.403-2.318=0.085
σ0.324-0.244=0.080
min2.139-2.137=0.002
max2.937-2.589=0.348
iters=5
new-facts=6402
prior-facts=6402
mean1858.509-1858.522=-0.013
σ0.076-0.064=0.013
min1858.396-1858.441=-0.045
max1858.588-1858.596=-0.008
mean1768.400-1751.800=16.600
σ126.057-211.820=-85.763
min1638.000-1516.000=122.000
max1895.000-2033.000=-138.000
mean3.096-2.960=0.136
σ0.282-0.192=0.090
min2.857-2.634=0.223
max3.524-3.136=0.388

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.235-1.493=-0.258
σ0.291-0.257=0.034
min0.946-1.103=-0.157
max1.708-1.732=-0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean450.887-450.887=-0.000
σ581.929-581.929=0.000
min159.920-159.921=-0.000
max1323.781-1323.780=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean0.550-0.555=-0.005
σ0.572-0.572=0.001
min0.262-0.267=-0.005
max1.408-1.413=-0.005
policies=20
mean1599.477-1599.486=-0.009
σ0.367-0.384=-0.017
min1599.233-1599.232=0.001
max1600.023-1600.057=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean2.655-2.676=-0.021
σ0.009-0.014=-0.005
min2.642-2.659=-0.017
max2.662-2.692=-0.030
policies=200
mean16002.738-16002.681=0.057
σ0.106-0.081=0.025
min16002.649-16002.594=0.055
max16002.889-16002.770=0.118
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1516.000=122.000
σ0.000
min1638.000-1516.000=122.000
max1638.000-1516.000=122.000
mean26.874-26.940=-0.066
σ0.047-0.074=-0.027
min26.829-26.845=-0.016
max26.918-27.025=-0.107