Compare commits

Home / Compare eba61e3d .. 80be493c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.370-0.366=0.004
min53.908-53.916=-0.008
max55.109-55.096=0.012
mean415.000-417.700=-2.700
σ0.000-0.483=-0.483
min415.000-417.000=-2.000
max415.000-418.000=-3.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.006-0.005=0.001
min43.385-43.386=-0.002
max43.403-43.403=0.000
mean415.100-418.000=-2.900
σ0.316-0.000=0.316
min415.000-418.000=-3.000
max416.000-418.000=-2.000
mean0.122-0.122=0.000
σ0.004-0.004=-0.000
min0.118-0.118=-0.001
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1006.962=-0.001
σ0.904-0.869=0.036
min1006.487-1006.471=0.016
max1010.713-1010.556=0.158
mean1050.600-1061.000=-10.400
σ310.102-320.990=-10.888
min551.000-548.000=3.000
max1643.000-1628.000=15.000
mean1.561-1.537=0.024
σ0.119-0.078=0.041
min1.471-1.476=-0.006
max1.841-1.823=0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.425-0.448=-0.023
σ0.141-0.193=-0.051
min0.325-0.341=-0.015
max0.665-0.790=-0.125
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.879-0.920=-0.041
σ0.109-0.171=-0.061
min0.815-0.818=-0.003
max1.073-1.222=-0.149
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.528-0.541=-0.013
σ0.049-0.042=0.008
min0.478-0.497=-0.018
max0.611-0.601=0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.838-0.846=-0.008
σ0.044-0.048=-0.004
min0.805-0.818=-0.013
max0.914-0.930=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.034-0.033=0.001
min964.811-964.809=0.002
max964.896-964.892=0.004
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.848-0.797=0.050
σ0.028-0.067=-0.039
min0.799-0.699=0.100
max0.867-0.863=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.007=-0.001
min885.505-885.504=0.001
max885.518-885.521=-0.003
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.726-0.714=0.012
σ0.023-0.036=-0.013
min0.686-0.674=0.012
max0.740-0.746=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean4.244-4.243=0.001
σ0.087-0.080=0.007
min4.116-4.091=0.025
max4.480-4.489=-0.009
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean4.257-4.250=0.008
σ0.080-0.091=-0.010
min4.124-4.098=0.027
max4.517-4.585=-0.068
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.744-0.756=-0.012
σ0.027-0.019=0.008
min0.607-0.720=-0.113
max0.855-0.878=-0.023
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.701-0.717=-0.017
σ0.023-0.017=0.006
min0.586-0.671=-0.086
max0.797-0.797=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.426-295.780=-0.354
σ0.268-0.200=0.068
min295.280-295.631=-0.350
max296.172-296.337=-0.165
mean1913.000-1897.000=16.000
σ0.000
min1913.000-1897.000=16.000
max1913.000-1897.000=16.000
mean0.574-0.573=0.002
σ0.033-0.043=-0.010
min0.535-0.498=0.037
max0.635-0.617=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.399=-0.005
σ0.038-0.037=0.000
min285.350-285.350=-0.001
max285.434-285.446=-0.012
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.390-0.386=0.005
σ0.008-0.009=-0.001
min0.380-0.374=0.006
max0.397-0.400=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1295.787=-0.006
σ0.117-0.126=-0.008
min1295.655-1295.658=-0.003
max1295.926-1295.954=-0.028
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean1.898-1.925=-0.027
σ0.075-0.112=-0.037
min1.809-1.814=-0.005
max1.982-2.071=-0.089
iters=5
new-facts=6402
prior-facts=1
mean1539.897-1539.901=-0.005
σ6.868-6.856=0.012
min1536.643-1536.617=0.026
max1552.178-1552.162=0.017
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean2.230-2.245=-0.015
σ0.195-0.253=-0.058
min2.035-2.026=0.009
max2.472-2.648=-0.175
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.686=-0.002
σ0.063-0.069=-0.007
min1857.613-1857.594=0.019
max1857.770-1857.772=-0.002
mean1772.400-1765.200=7.200
σ135.579-128.245=7.335
min1643.000-1628.000=15.000
max1913.000-1897.000=16.000
mean3.130-3.037=0.093
σ0.373-0.195=0.178
min2.862-2.851=0.010
max3.785-3.326=0.460

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.231=0.007
σ0.376-0.320=0.056
min0.930-0.935=-0.005
max1.851-1.763=0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.705-445.706=-0.001
σ580.934-580.933=0.001
min155.236-155.237=-0.002
max1317.106-1317.106=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean0.526-0.545=-0.019
σ0.528-0.573=-0.045
min0.262-0.256=0.006
max1.319-1.404=-0.085
policies=20
mean1552.633-1552.657=-0.024
σ0.333-0.342=-0.008
min1552.401-1552.419=-0.018
max1553.128-1553.164=-0.036
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean2.590-2.599=-0.009
σ0.016-0.012=0.004
min2.571-2.588=-0.017
max2.609-2.615=-0.006
policies=200
mean15534.642-15534.733=-0.091
σ0.134-0.077=0.056
min15534.555-15534.669=-0.114
max15534.839-15534.837=0.002
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1628.000=15.000
σ0.000
min1643.000-1628.000=15.000
max1643.000-1628.000=15.000
mean26.082-26.124=-0.042
σ0.055-0.168=-0.113
min26.049-26.007=0.041
max26.163-26.367=-0.204