Compare commits

Home / Compare e282b98f .. 22a7102c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.151-52.580=1.571
σ0.351-0.349=0.003
min54.013-52.437=1.576
max55.151-53.572=1.579
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.136=0.002
σ0.004-0.005=-0.001
min0.131-0.130=0.001
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.414-43.902=-0.488
σ0.007-0.006=0.001
min43.403-43.891=-0.488
max43.428-43.914=-0.486
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.122-0.123=-0.001
σ0.003-0.003=0.000
min0.120-0.121=-0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1007.033=-0.051
σ0.869-0.877=-0.009
min1006.485-1006.529=-0.044
max1010.576-1010.653=-0.076
mean1052.550-1052.300=0.250
σ319.788-312.526=7.262
min577.000-553.000=24.000
max1621.000-1516.000=105.000
mean1.540-1.552=-0.013
σ0.062-0.085=-0.023
min1.483-1.428=0.056
max1.729-1.812=-0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.419-0.414=0.005
σ0.133-0.134=-0.001
min0.336-0.340=-0.004
max0.654-0.650=0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.881-0.917=-0.036
σ0.084-0.087=-0.003
min0.824-0.826=-0.002
max1.028-1.044=-0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.536-0.535=0.000
σ0.053-0.050=0.003
min0.496-0.494=0.002
max0.628-0.617=0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.845-0.848=-0.003
σ0.038-0.035=0.002
min0.823-0.820=0.003
max0.912-0.908=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=-0.000
σ0.025-0.038=-0.013
min964.802
max964.863-964.898=-0.035
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.833-0.825=0.008
σ0.026-0.030=-0.005
min0.793-0.778=0.014
max0.851-0.863=-0.012
name=cdr_enhanced_4k_loc.art
mean885.513-885.511=0.002
σ0.007-0.007=0.001
min885.504
max885.520-885.518=0.002
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.714-0.703=0.011
σ0.027-0.037=-0.010
min0.680-0.674=0.006
max0.744-0.745=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean3.551-4.269=-0.717
σ0.077-0.083=-0.006
min3.434-4.106=-0.672
max3.856-4.557=-0.700
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean3.533-4.246=-0.713
σ0.068-0.078=-0.011
min3.416-4.131=-0.715
max3.773-4.517=-0.743
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.751-0.732=0.019
σ0.018-0.058=-0.040
min0.718-0.522=0.196
max0.853-0.858=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.715-0.708=0.007
σ0.015-0.015=-0.000
min0.678-0.684=-0.006
max0.792-0.786=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.594-295.607=-0.013
σ0.226-0.242=-0.016
min295.409-295.384=0.024
max296.212-296.259=-0.048
mean1913.000-1910.000=3.000
σ0.000
min1913.000-1910.000=3.000
max1913.000-1910.000=3.000
mean0.580-0.572=0.008
σ0.046-0.042=0.004
min0.497-0.500=-0.003
max0.673-0.636=0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.539=-0.127
σ0.040-0.039=0.001
min285.360-285.482=-0.122
max285.454-285.577=-0.124
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.387-0.404=-0.017
σ0.008-0.009=-0.000
min0.374-0.394=-0.020
max0.395-0.416=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1295.798-1295.905=-0.107
σ0.104-0.076=0.028
min1295.683-1295.806=-0.123
max1295.922-1295.985=-0.063
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean1.911-1.905=0.005
σ0.092-0.090=0.003
min1.815-1.800=0.015
max2.024-2.005=0.018
iters=5
new-facts=6402
prior-facts=1
mean1539.943-1540.066=-0.123
σ6.887-6.951=-0.064
min1536.659-1536.729=-0.071
max1552.257-1552.494=-0.238
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean2.377-2.332=0.046
σ0.255-0.356=-0.101
min2.110-2.054=0.056
max2.695-2.906=-0.211
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.837=-0.128
σ0.050-0.053=-0.004
min1857.662-1857.780=-0.119
max1857.780-1857.904=-0.124
mean1779.200-1752.800=26.400
σ138.272-170.080=-31.808
min1621.000-1516.000=105.000
max1913.000-1910.000=3.000
mean3.124-3.073=0.051
σ0.341-0.281=0.060
min2.885-2.854=0.031
max3.723-3.557=0.167

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.371-1.565=-0.194
σ0.245-0.345=-0.100
min1.119-1.035=0.084
max1.774-1.890=-0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.744-445.795=-0.051
σ580.934-580.934=0.000
min155.275-155.327=-0.051
max1317.145-1317.196=-0.051
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean0.567-0.530=0.037
σ0.614-0.544=0.070
min0.258-0.257=0.002
max1.488-1.346=0.142
policies=20
mean1553.016-1553.530=-0.513
σ0.332-0.329=0.003
min1552.789-1553.304=-0.515
max1553.510-1554.019=-0.509
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean2.591-2.588=0.002
σ0.011-0.016=-0.005
min2.576-2.571=0.005
max2.601-2.604=-0.003
policies=200
mean15538.280-15543.286=-5.005
σ0.044-0.110=-0.065
min15538.237-15543.141=-4.904
max15538.338-15543.377=-5.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1516.000=105.000
σ0.000
min1621.000-1516.000=105.000
max1621.000-1516.000=105.000
mean26.156-26.167=-0.011
σ0.093-0.047=0.046
min26.055-26.111=-0.056
max26.237-26.210=0.028