Compare commits

Home / Compare 8b618000 .. b453d18e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.368-0.369=-0.000
min53.909-53.909=-0.000
max55.104-55.105=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.141-0.140=0.001
σ0.004-0.003=0.001
min0.136-0.137=-0.000
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.000
σ0.005-0.006=-0.001
min43.388-43.384=0.004
max43.403-43.407=-0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.119=0.003
σ0.002-0.005=-0.003
min0.120-0.114=0.006
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1006.985=-0.002
σ0.858-0.851=0.007
min1006.481-1006.483=-0.002
max1010.525-1010.486=0.039
mean1055.850-1045.950=9.900
σ305.574-312.758=-7.184
min576.000-577.000=-1.000
max1456.000-1635.000=-179.000
mean1.541-1.538=0.003
σ0.080-0.094=-0.014
min1.470-1.459=0.011
max1.765-1.811=-0.046

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.418-0.412=0.006
σ0.129-0.121=0.008
min0.346-0.328=0.018
max0.648-0.626=0.022
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.872-0.916=-0.044
σ0.067-0.087=-0.020
min0.816-0.826=-0.010
max0.987-1.018=-0.031
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.540-0.534=0.006
σ0.050-0.056=-0.006
min0.508-0.492=0.015
max0.628-0.630=-0.002
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.851-0.859=-0.008
σ0.038-0.040=-0.002
min0.814-0.825=-0.011
max0.911-0.927=-0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.820-964.834=-0.014
σ0.027-0.030=-0.003
min964.802
max964.867-964.881=-0.014
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.756-0.848=-0.092
σ0.064-0.022=0.042
min0.677-0.808=-0.131
max0.843-0.859=-0.017
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.004
σ0.006-0.004=0.002
min885.504-885.508=-0.004
max885.518-885.519=-0.000
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.716-0.714=0.002
σ0.036-0.056=-0.020
min0.651-0.615=0.037
max0.737-0.747=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean4.221-4.154=0.067
σ0.076-0.174=-0.098
min4.104-3.503=0.601
max4.536-4.381=0.155
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean4.192-4.211=-0.019
σ0.082-0.075=0.007
min4.039-4.073=-0.034
max4.493-4.472=0.022
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.752-0.747=0.005
σ0.030-0.016=0.014
min0.714-0.720=-0.006
max0.938-0.853=0.084
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.707-0.710=-0.003
σ0.016-0.015=0.001
min0.676-0.676=-0.000
max0.787-0.788=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.661-295.622=0.038
σ0.249-0.213=0.036
min295.519-295.469=0.050
max296.347-296.176=0.171
mean2031.000-1912.000=119.000
σ0.000
min2031.000-1912.000=119.000
max2031.000-1912.000=119.000
mean0.578-0.576=0.002
σ0.035-0.061=-0.026
min0.510-0.497=0.013
max0.604-0.691=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.414-285.410=0.004
σ0.036-0.038=-0.003
min285.372-285.358=0.015
max285.452-285.449=0.003
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.391-0.392=-0.000
σ0.006-0.009=-0.003
min0.386-0.382=0.004
max0.401-0.403=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.799=-0.005
σ0.104-0.114=-0.010
min1295.680-1295.665=0.015
max1295.918-1295.945=-0.028
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean1.907-1.984=-0.077
σ0.125-0.265=-0.140
min1.750-1.795=-0.046
max2.043-2.444=-0.401
iters=5
new-facts=6402
prior-facts=1
mean1539.958-1539.934=0.024
σ6.867-6.868=-0.001
min1536.696-1536.619=0.077
max1552.239-1552.214=0.024
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean2.431-2.333=0.098
σ0.170-0.182=-0.012
min2.174-2.038=0.136
max2.644-2.488=0.156
iters=5
new-facts=6402
prior-facts=6402
mean1857.697-1857.710=-0.013
σ0.059-0.054=0.005
min1857.652-1857.653=-0.001
max1857.776-1857.783=-0.006
mean1741.800-1773.400=-31.600
σ226.927-135.129=91.798
min1456.000-1635.000=-179.000
max2031.000-1912.000=119.000
mean3.034-3.082=-0.048
σ0.217-0.300=-0.084
min2.841-2.851=-0.010
max3.383-3.584=-0.202

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.815-1.325=0.490
σ0.111-0.210=-0.099
min1.622-1.110=0.512
max1.894-1.676=0.218

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.740=-0.000
σ580.934-580.934=0.000
min155.271-155.271=-0.000
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean0.555-0.544=0.011
σ0.588-0.571=0.018
min0.256-0.257=-0.000
max1.438-1.401=0.037
policies=20
mean1552.984-1552.974=0.010
σ0.329-0.329=-0.000
min1552.754-1552.751=0.003
max1553.472-1553.463=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean2.581-2.590=-0.009
σ0.024-0.012=0.011
min2.558-2.578=-0.019
max2.611-2.602=0.008
policies=200
mean15538.030-15537.883=0.147
σ0.084-0.088=-0.004
min15537.967-15537.811=0.156
max15538.154-15537.999=0.155
mean9200.000
σ0.000
min9200.000
max9200.000
mean1456.000-1635.000=-179.000
σ0.000
min1456.000-1635.000=-179.000
max1456.000-1635.000=-179.000
mean26.091-26.132=-0.041
σ0.032-0.121=-0.089
min26.053-26.012=0.041
max26.129-26.301=-0.172