Compare commits

Home / Compare cfeb474e .. 6e04f7e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.056=-0.010
σ0.368-0.369=-0.001
min53.901-53.913=-0.012
max55.092-55.106=-0.014
mean417.000-413.700=3.300
σ0.000-0.483=-0.483
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.139-0.137=0.002
σ0.004-0.003=0.001
min0.135-0.132=0.003
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.384-43.393=-0.009
σ0.007-0.007=-0.000
min43.374-43.381=-0.007
max43.393-43.407=-0.014
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.121=0.001
σ0.005-0.004=0.001
min0.116-0.116=0.001
max0.131-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.985-1006.976=0.008
σ0.845-0.893=-0.049
min1006.480-1006.503=-0.023
max1010.456-1010.685=-0.228
mean1047.650-1041.050=6.600
σ315.336-305.498=9.838
min575.000-574.000=1.000
max1648.000-1657.000=-9.000
mean1.543-1.556=-0.013
σ0.058-0.099=-0.041
min1.453-1.335=0.118
max1.653-1.801=-0.148

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.003-0.003=0.000
min0.882
max0.887
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.405-0.416=-0.011
σ0.149-0.129=0.020
min0.325-0.340=-0.015
max0.671-0.643=0.028
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=-0.000
min2.337
max2.342-2.344=-0.001
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.876-0.886=-0.009
σ0.084-0.081=0.003
min0.827-0.819=0.008
max1.025-1.026=-0.001
name=heavy_item.art
mean1.524-1.525=-0.001
σ0.002-0.001=0.001
min1.522-1.524=-0.001
max1.526
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.534-0.565=-0.031
σ0.051-0.060=-0.009
min0.493-0.507=-0.014
max0.618-0.634=-0.015
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.848-0.855=-0.007
σ0.046-0.049=-0.003
min0.802-0.810=-0.009
max0.925-0.935=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.829=0.002
σ0.025-0.025=-0.000
min964.802
max964.863-964.861=0.001
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.810-0.811=-0.000
σ0.034-0.032=0.002
min0.757-0.767=-0.011
max0.845-0.857=-0.012
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.001
σ0.006-0.005=0.001
min885.504-885.505=-0.001
max885.517-885.518=-0.001
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.729-0.700=0.029
σ0.026-0.050=-0.024
min0.683-0.621=0.062
max0.750-0.737=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean4.232-4.239=-0.007
σ0.099-0.112=-0.013
min4.094-4.092=0.003
max4.731-4.873=-0.142
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean4.197-4.201=-0.004
σ0.071-0.072=-0.001
min4.055-4.066=-0.011
max4.402-4.434=-0.032
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.744-0.692=0.052
σ0.017-0.086=-0.070
min0.708-0.509=0.199
max0.842-0.844=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.707-0.500=0.207
σ0.014-0.038=-0.024
min0.680-0.469=0.211
max0.784-0.851=-0.067

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.592-295.642=-0.050
σ0.229-0.190=0.039
min295.420-295.433=-0.014
max296.231-296.105=0.126
mean1904.000-2025.000=-121.000
σ0.000
min1904.000-2025.000=-121.000
max1904.000-2025.000=-121.000
mean0.588-0.525=0.063
σ0.054-0.035=0.019
min0.509-0.486=0.023
max0.691-0.589=0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.409=-0.002
σ0.037-0.037=-0.000
min285.359-285.362=-0.003
max285.447-285.450=-0.003
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.389-0.387=0.002
σ0.009-0.010=-0.001
min0.382-0.379=0.002
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.800-1295.794=0.006
σ0.111-0.100=0.010
min1295.676-1295.679=-0.003
max1295.934-1295.905=0.029
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean1.951-1.909=0.042
σ0.176-0.112=0.065
min1.815-1.800=0.015
max2.248-2.030=0.218
iters=5
new-facts=6402
prior-facts=1
mean1539.939-1539.948=-0.009
σ6.863-6.852=0.011
min1536.649-1536.658=-0.009
max1552.210-1552.198=0.012
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean2.353-2.366=-0.013
σ0.230-0.204=0.027
min2.025-2.104=-0.079
max2.619-2.607=0.012
iters=5
new-facts=6402
prior-facts=6402
mean1857.701-1857.706=-0.004
σ0.061-0.057=0.004
min1857.638-1857.639=-0.001
max1857.782-1857.771=0.011
mean1777.800-1788.400=-10.600
σ125.328-159.652=-34.324
min1648.000-1657.000=-9.000
max1904.000-2025.000=-121.000
mean3.009-3.098=-0.090
σ0.190-0.383=-0.193
min2.850-2.698=0.152
max3.337-3.705=-0.368

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.352-1.379=-0.027
σ0.291-0.291=0.000
min1.104-1.120=-0.016
max1.857-1.868=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.000
σ580.934-580.935=-0.001
min155.271-155.271=0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean0.550-0.548=0.002
σ0.582-0.562=0.020
min0.256-0.264=-0.008
max1.424-1.391=0.033
policies=20
mean1552.987-1552.987=-0.000
σ0.334-0.328=0.006
min1552.750-1552.768=-0.017
max1553.481-1553.476=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean2.589-2.589=-0.000
σ0.014-0.006=0.007
min2.576-2.583=-0.006
max2.603-2.595=0.008
policies=200
mean15538.052-15537.986=0.066
σ0.096-0.082=0.014
min15537.963-15537.871=0.091
max15538.171-15538.061=0.110
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1657.000=-9.000
σ0.000
min1648.000-1657.000=-9.000
max1648.000-1657.000=-9.000
mean26.172-26.149=0.023
σ0.097-0.182=-0.085
min26.070-26.042=0.028
max26.289-26.422=-0.132