Compare commits

Home / Compare b7f2c954 .. 261a7164

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.368=0.002
min53.906-53.916=-0.010
max55.106-55.103=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.137-0.139=-0.002
σ0.005-0.004=0.001
min0.129-0.135=-0.005
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.007=-0.000
min43.384-43.385=-0.001
max43.401-43.406=-0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.122=-0.002
σ0.005-0.003=0.001
min0.114-0.119=-0.004
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.984=-0.004
σ0.913-0.855=0.058
min1006.504-1006.483=0.020
max1010.776-1010.507=0.269
mean1046.250-1047.200=-0.950
σ305.874-314.016=-8.142
min571.000-577.000=-6.000
max1636.000-1645.000=-9.000
mean1.571-1.534=0.037
σ0.122-0.082=0.040
min1.472-1.404=0.068
max1.933-1.798=0.135

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.419-0.430=-0.011
σ0.138-0.144=-0.006
min0.331-0.326=0.004
max0.662-0.684=-0.021
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.879-0.887=-0.008
σ0.092-0.091=0.000
min0.822-0.812=0.010
max1.040-1.046=-0.005
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.001=0.000
min1.522
max1.525
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.544-0.545=-0.001
σ0.053-0.054=-0.001
min0.497-0.496=0.001
max0.635-0.632=0.003
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.852-0.865=-0.013
σ0.043-0.033=0.010
min0.810-0.843=-0.034
max0.915-0.924=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.832=0.003
σ0.031-0.028=0.004
min964.810-964.810=0.000
max964.889-964.876=0.013
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.799-0.808=-0.010
σ0.058-0.048=0.010
min0.735-0.748=-0.013
max0.855-0.864=-0.009
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.004-0.007=-0.002
min885.508-885.504=0.004
max885.518-885.520=-0.002
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.710-0.686=0.025
σ0.024-0.057=-0.033
min0.674-0.608=0.065
max0.735-0.758=-0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean4.239-4.233=0.006
σ0.098-0.099=-0.000
min4.120-4.098=0.022
max4.851-4.633=0.218
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean4.217-4.236=-0.020
σ0.090-0.077=0.012
min4.056-4.113=-0.057
max4.477-4.536=-0.059
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.745-0.747=-0.003
σ0.021-0.019=0.002
min0.710-0.685=0.025
max0.873-0.851=0.022
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.703-0.706=-0.002
σ0.016-0.016=-0.000
min0.673-0.635=0.038
max0.788-0.764=0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.499-295.627=-0.128
σ0.215-0.258=-0.043
min295.260-295.377=-0.117
max296.043-296.311=-0.268
mean1887.000-1913.000=-26.000
σ0.000
min1887.000-1913.000=-26.000
max1887.000-1913.000=-26.000
mean0.558-0.575=-0.018
σ0.046-0.053=-0.007
min0.494-0.513=-0.019
max0.613-0.694=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.406=0.005
σ0.037-0.032=0.005
min285.362-285.365=-0.002
max285.449-285.441=0.008
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.388-0.391=-0.003
σ0.006-0.009=-0.003
min0.383-0.381=0.002
max0.396-0.401=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.795=0.001
σ0.111-0.114=-0.003
min1295.669-1295.666=0.003
max1295.921-1295.947=-0.025
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean1.898-1.978=-0.080
σ0.099-0.124=-0.024
min1.813-1.843=-0.030
max2.034-2.132=-0.099
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.936=-0.012
σ6.856-6.890=-0.033
min1536.695-1536.634=0.061
max1552.186-1552.255=-0.069
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean2.168-2.345=-0.178
σ0.136-0.207=-0.071
min2.009-2.102=-0.092
max2.349-2.618=-0.269
iters=5
new-facts=6402
prior-facts=6402
mean1857.701-1857.705=-0.003
σ0.058-0.059=-0.001
min1857.647-1857.642=0.005
max1857.787-1857.785=0.002
mean1769.000-1772.800=-3.800
σ120.584-134.715=-14.131
min1636.000-1645.000=-9.000
max1887.000-1913.000=-26.000
mean2.987-2.971=0.016
σ0.192-0.212=-0.020
min2.687-2.677=0.011
max3.204-3.277=-0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.323-1.344=-0.022
σ0.309-0.221=0.089
min1.100-1.107=-0.007
max1.853-1.702=0.151

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.935-580.934=0.000
min155.271-155.272=-0.002
max1317.142-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean0.531-0.534=-0.003
σ0.548-0.549=-0.002
min0.256-0.255=0.002
max1.353-1.358=-0.006
policies=20
mean1552.976-1552.990=-0.014
σ0.329-0.328=0.001
min1552.751-1552.767=-0.017
max1553.465-1553.478=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean2.598-2.590=0.009
σ0.013-0.024=-0.010
min2.584-2.569=0.015
max2.611-2.620=-0.009
policies=200
mean15537.982-15537.931=0.051
σ0.126-0.082=0.044
min15537.815-15537.839=-0.024
max15538.121-15538.012=0.109
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1645.000=-9.000
σ0.000
min1636.000-1645.000=-9.000
max1636.000-1645.000=-9.000
mean26.256-26.122=0.134
σ0.234-0.106=0.128
min26.096-26.029=0.067
max26.602-26.272=0.329