Compare commits

Home / Compare ce6d7a38 .. 443779e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-54.031=-0.326
σ0.366-0.369=-0.002
min53.558-53.886=-0.328
max54.747-55.080=-0.333
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.137-0.140=-0.003
σ0.003-0.004=-0.000
min0.132-0.137=-0.005
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.058-43.384=-0.326
σ0.006-0.007=-0.001
min43.048-43.374=-0.326
max43.066-43.395=-0.329
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.121-0.122=-0.001
σ0.004-0.004=-0.000
min0.114-0.116=-0.002
max0.128-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.110-1006.327=-1.217
σ0.879-0.897=-0.018
min1004.639-1005.841=-1.203
max1008.729-1010.051=-1.322
mean1059.350-1051.450=7.900
σ327.371-307.762=19.609
min552.000-566.000=-14.000
max1627.000-1636.000=-9.000
mean1.636-1.544=0.092
σ0.105-0.080=0.025
min1.456-1.473=-0.017
max1.889-1.820=0.069

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.443-0.418=0.025
σ0.185-0.140=0.045
min0.340-0.331=0.009
max0.773-0.666=0.107
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.921-0.869=0.052
σ0.186-0.088=0.098
min0.809-0.808=0.002
max1.251-1.022=0.230
name=heavy_item.art
mean1.521-1.522=-0.000
σ0.002-0.002=0.000
min1.520
max1.524
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.543-0.539=0.003
σ0.046-0.051=-0.004
min0.500-0.499=0.001
max0.615-0.627=-0.012
name=nested_use.art
mean2.355-2.356=-0.000
σ0.002-0.002=0.000
min2.355
max2.358
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.841-0.831=0.009
σ0.028-0.042=-0.015
min0.822-0.800=0.022
max0.888-0.901=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.553=-0.001
σ0.023-0.019=0.004
min963.533-963.532=0.001
max963.589-963.584=0.005
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.819-0.780=0.039
σ0.019-0.063=-0.044
min0.799-0.668=0.130
max0.849-0.826=0.024
name=cdr_enhanced_4k_loc.art
mean884.853-884.856=-0.003
σ0.009-0.004=0.005
min884.847-884.851=-0.004
max884.867-884.860=0.007
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.708-0.720=-0.012
σ0.061-0.029=0.032
min0.600-0.670=-0.070
max0.743-0.741=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.713-7.710=0.003
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean4.211-4.235=-0.024
σ0.080-0.090=-0.010
min4.083-4.095=-0.012
max4.514-4.569=-0.056
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean4.208-4.225=-0.018
σ0.071-0.074=-0.003
min4.059-4.115=-0.056
max4.435-4.471=-0.036
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.746-0.747=-0.001
σ0.019-0.017=0.002
min0.714-0.715=-0.001
max0.864-0.858=0.007
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.702-0.707=-0.004
σ0.014-0.041=-0.027
min0.670-0.506=0.164
max0.761-0.789=-0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.122-295.593=-1.471
σ0.232-0.261=-0.029
min293.936-295.378=-1.441
max294.744-296.305=-1.561
mean1938.000-1943.000=-5.000
σ0.000
min1938.000-1943.000=-5.000
max1938.000-1943.000=-5.000
mean0.559-0.594=-0.034
σ0.046-0.046=0.000
min0.495-0.535=-0.040
max0.648-0.701=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.496-285.247=-3.751
σ0.036-0.040=-0.004
min281.449-285.198=-3.750
max281.535-285.289=-3.754
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.395-0.385=0.010
σ0.007-0.011=-0.004
min0.387-0.380=0.007
max0.402-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1291.476-1295.194=-3.718
σ0.098-0.097=0.002
min1291.364-1295.082=-3.719
max1291.585-1295.296=-3.711
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean1.988-1.944=0.044
σ0.145-0.126=0.019
min1.815-1.809=0.006
max2.215-2.104=0.111
iters=5
new-facts=6402
prior-facts=1
mean1534.334-1538.093=-3.758
σ4.003-4.022=-0.019
min1532.322-1536.052=-3.730
max1541.487-1545.275=-3.788
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean2.178-2.289=-0.110
σ0.162-0.289=-0.128
min2.040-2.035=0.005
max2.391-2.626=-0.235
iters=5
new-facts=6402
prior-facts=6402
mean1853.355-1857.111=-3.756
σ0.050-0.067=-0.017
min1853.304-1857.039=-3.735
max1853.422-1857.202=-3.781
mean1790.600-1788.000=2.600
σ148.616-151.516=-2.899
min1627.000-1636.000=-9.000
max1938.000-1943.000=-5.000
mean3.143-3.004=0.139
σ0.276-0.117=0.159
min2.892-2.876=0.017
max3.616-3.110=0.505

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.425-1.358=0.066
σ0.265-0.277=-0.013
min1.249-1.101=0.148
max1.876-1.833=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-443.610=-1.181
σ577.065-577.064=0.000
min153.894-155.076=-1.182
max1308.026-1309.207=-1.180
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean0.536-0.534=0.002
σ0.554-0.557=-0.003
min0.258-0.250=0.008
max1.367-1.370=-0.003
policies=20
mean1539.233-1551.043=-11.810
σ0.335-0.332=0.003
min1539.001-1550.815=-11.813
max1539.731-1551.536=-11.805
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean2.600-2.595=0.005
σ0.032-0.012=0.020
min2.568-2.581=-0.013
max2.631-2.607=0.023
policies=200
mean15400.448-15518.468=-118.019
σ0.095-0.058=0.037
min15400.390-15518.395=-118.005
max15400.590-15518.525=-117.935
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1636.000=-9.000
σ0.000
min1627.000-1636.000=-9.000
max1627.000-1636.000=-9.000
mean26.039-26.156=-0.117
σ0.050-0.101=-0.050
min25.977-26.081=-0.104
max26.100-26.303=-0.203