Compare commits

Home / Compare 44f740f0 .. d7200cee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.000
σ0.370-0.369=0.001
min53.914-53.918=-0.004
max55.107-55.104=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.141=-0.001
σ0.004-0.004=0.001
min0.134-0.137=-0.003
max0.149-0.147=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.006=-0.000
min43.387-43.387=-0.001
max43.404-43.406=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.120=0.002
σ0.004-0.001=0.003
min0.117-0.117=-0.000
max0.129-0.121=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.009=-0.002
σ1.179-1.205=-0.026
min1006.459-1006.433=0.027
max1011.942-1012.059=-0.117
mean1046.200-1051.550=-5.350
σ317.069-307.994=9.076
min570.000-577.000=-7.000
max1648.000-1644.000=4.000
mean1.574-1.551=0.023
σ0.140-0.070=0.071
min1.374-1.467=-0.093
max2.065-1.733=0.333

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.391-0.422=-0.031
σ0.120-0.153=-0.034
min0.328-0.330=-0.002
max0.604-0.694=-0.090
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.871-0.889=-0.018
σ0.087-0.108=-0.022
min0.803-0.813=-0.011
max1.023-1.079=-0.056
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.535-0.536=-0.000
σ0.054-0.050=0.005
min0.495-0.496=-0.001
max0.628-0.622=0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.842-0.845=-0.002
σ0.046-0.044=0.002
min0.804-0.812=-0.008
max0.920-0.920=-0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.840=-0.001
σ0.032-0.035=-0.003
min964.811-964.811=0.001
max964.891-964.897=-0.006
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.842-0.848=-0.006
σ0.030-0.021=0.009
min0.789-0.817=-0.028
max0.863-0.873=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.008=-0.004
min885.505-885.504=0.001
max885.516-885.523=-0.007
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.744-0.676=0.068
σ0.001-0.056=-0.054
min0.741-0.601=0.141
max0.745-0.749=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean4.213-4.267=-0.054
σ0.101-0.075=0.026
min4.060-4.142=-0.081
max4.589-4.587=0.003
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean4.209-4.244=-0.035
σ0.088-0.070=0.018
min4.018-4.092=-0.073
max4.546-4.578=-0.031
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.733-0.746=-0.013
σ0.028-0.031=-0.003
min0.698-0.551=0.147
max0.912-0.886=0.026
name=record_render_syntax_err.art
mean2.166-2.166=0.000
σ0.002-0.002=0.000
min2.165
max2.170-2.169=0.001
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.687-0.696=-0.008
σ0.014-0.014=-0.000
min0.662-0.668=-0.006
max0.753-0.764=-0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.088-297.020=0.068
σ0.200-0.283=-0.083
min296.898-296.749=0.150
max297.605-297.743=-0.139
mean1943.000-1951.000=-8.000
σ0.000
min1943.000-1951.000=-8.000
max1943.000-1951.000=-8.000
mean0.585-0.591=-0.007
σ0.022-0.031=-0.009
min0.542-0.554=-0.011
max0.612-0.661=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.826=-0.007
σ0.039-0.042=-0.003
min286.768-286.770=-0.003
max286.856-286.878=-0.023
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.395-0.404=-0.009
σ0.006-0.012=-0.007
min0.389-0.389=-0.000
max0.402-0.423=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1297.264-1297.245=0.019
σ0.110-0.058=0.052
min1297.105-1297.178=-0.073
max1297.401-1297.320=0.081
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean2.230-2.081=0.149
σ0.057-0.074=-0.017
min2.157-2.012=0.145
max2.317-2.176=0.141
iters=5
new-facts=6402
prior-facts=1
mean1541.372-1541.310=0.061
σ6.800-6.833=-0.032
min1538.217-1538.077=0.141
max1553.535-1553.529=0.005
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean2.319-2.210=0.108
σ0.257-0.159=0.097
min2.094-2.056=0.038
max2.729-2.409=0.320
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1859.116=0.007
σ0.065-0.081=-0.017
min1859.036-1859.007=0.029
max1859.189-1859.206=-0.017
mean1789.600-1791.600=-2.000
σ148.089-154.066=-5.977
min1648.000-1644.000=4.000
max1943.000-1951.000=-8.000
mean2.954-2.970=-0.016
σ0.079-0.068=0.012
min2.856-2.863=-0.007
max3.035-3.047=-0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-1.203=0.043
σ0.385-0.376=0.009
min0.936-0.930=0.006
max1.882-1.838=0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.002
σ581.372-581.372=-0.000
min158.133-158.135=-0.002
max1320.877-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean0.544-0.556=-0.012
σ0.549-0.576=-0.027
min0.261-0.261=-0.000
max1.367-1.420=-0.053
policies=20
mean1581.612-1581.626=-0.014
σ0.362-0.360=0.002
min1581.370-1581.382=-0.012
max1582.151-1582.161=-0.010
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean2.640-2.637=0.003
σ0.009-0.013=-0.004
min2.632-2.623=0.008
max2.651-2.653=-0.002
policies=200
mean15824.210-15824.146=0.063
σ0.139-0.182=-0.042
min15824.046-15823.995=0.052
max15824.373-15824.410=-0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1644.000=4.000
σ0.000
min1648.000-1644.000=4.000
max1648.000-1644.000=4.000
mean26.735-26.606=0.129
σ0.068-0.049=0.019
min26.678-26.561=0.118
max26.831-26.656=0.175