Compare commits

Home / Compare 67a0867c .. 20608888

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.368-0.370=-0.002
min53.869-53.872=-0.004
max55.061-55.067=-0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.141=-0.002
σ0.004-0.004=-0.000
min0.132-0.136=-0.004
max0.144-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.325-43.321=0.004
σ0.005-0.006=-0.001
min43.319-43.313=0.006
max43.333-43.335=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.125-0.122=0.002
σ0.005-0.004=0.001
min0.119-0.119=-0.000
max0.135-0.128=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.306=0.002
σ1.175-1.223=-0.048
min1005.764-1005.777=-0.013
max1011.227-1011.440=-0.213
mean1043.500-1047.700=-4.200
σ312.030-305.196=6.835
min595.000-593.000=2.000
max1633.000-1640.000=-7.000
mean1.554-1.572=-0.019
σ0.078-0.111=-0.032
min1.471-1.504=-0.033
max1.789-1.986=-0.197

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.407-0.411=-0.004
σ0.144-0.144=-0.000
min0.323-0.325=-0.002
max0.661-0.666=-0.005
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.906-0.893=0.013
σ0.103-0.094=0.009
min0.805-0.823=-0.019
max1.056-1.057=-0.002
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.534-0.543=-0.009
σ0.044-0.057=-0.013
min0.490-0.500=-0.011
max0.603-0.640=-0.037
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.834-0.849=-0.015
σ0.039-0.049=-0.010
min0.793-0.797=-0.004
max0.897-0.923=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.001
σ0.035-0.033=0.001
min964.087-964.087=-0.000
max964.172-964.170=0.003
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.795-0.818=-0.023
σ0.033-0.059=-0.026
min0.762-0.728=0.034
max0.846-0.862=-0.016
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=-0.000
σ0.008-0.008=0.000
min884.703-884.705=-0.001
max884.722-884.723=-0.001
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.714-0.710=0.005
σ0.025-0.035=-0.010
min0.683-0.653=0.029
max0.745-0.738=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean4.272-4.213=0.059
σ0.079-0.086=-0.007
min4.140-4.058=0.082
max4.525-4.737=-0.212
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean4.259-4.194=0.065
σ0.085-0.075=0.010
min4.108-4.067=0.041
max4.573-4.449=0.124
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.740-0.731=0.010
σ0.022-0.018=0.003
min0.708-0.704=0.005
max0.871-0.852=0.019
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.707-0.700=0.007
σ0.015-0.015=-0.000
min0.678-0.672=0.006
max0.777-0.788=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.314-296.180=0.135
σ0.239-0.217=0.022
min296.131-296.051=0.080
max296.931-296.778=0.153
mean1916.000-1901.000=15.000
σ0.000
min1916.000-1901.000=15.000
max1916.000-1901.000=15.000
mean0.581-0.588=-0.007
σ0.042-0.042=-0.000
min0.524-0.513=0.011
max0.684-0.673=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.698-284.689=0.009
σ0.029-0.035=-0.006
min284.665-284.641=0.024
max284.733-284.728=0.006
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.397-0.396=0.001
σ0.010-0.011=-0.001
min0.386-0.383=0.003
max0.407-0.404=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.077=-0.001
σ0.107-0.110=-0.003
min1294.962-1294.960=0.002
max1295.206-1295.215=-0.009
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean1.917-1.918=-0.001
σ0.097-0.100=-0.003
min1.817-1.812=0.005
max2.050-2.039=0.012
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.187=-0.002
σ6.869-6.848=0.021
min1535.935-1535.941=-0.006
max1551.469-1551.435=0.034
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean2.261-2.252=0.009
σ0.252-0.255=-0.003
min2.016-2.045=-0.029
max2.554-2.621=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.988=0.000
σ0.054-0.051=0.003
min1856.931-1856.944=-0.013
max1857.063-1857.068=-0.005
mean1773.200-1769.600=3.600
σ138.700-128.910=9.790
min1633.000-1640.000=-7.000
max1916.000-1901.000=15.000
mean3.088-3.056=0.031
σ0.296-0.276=0.020
min2.872-2.837=0.035
max3.599-3.538=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.191=0.036
σ0.343-0.285=0.057
min0.932-0.934=-0.002
max1.807-1.659=0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.784=0.001
σ581.211-581.212=-0.001
min157.178-157.177=0.001
max1319.602-1319.603=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean0.557-0.536=0.021
σ0.594-0.560=0.035
min0.260-0.253=0.007
max1.448-1.375=0.073
policies=20
mean1572.101-1572.083=0.018
σ0.349-0.356=-0.007
min1571.863-1571.844=0.019
max1572.620-1572.613=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean2.617-2.629=-0.011
σ0.020-0.025=-0.005
min2.589-2.601=-0.012
max2.632-2.661=-0.029
policies=200
mean15729.012-15728.982=0.030
σ0.053-0.141=-0.088
min15728.933-15728.829=0.104
max15729.047-15729.169=-0.122
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1640.000=-7.000
σ0.000
min1633.000-1640.000=-7.000
max1633.000-1640.000=-7.000
mean26.488-26.537=-0.048
σ0.111-0.027=0.084
min26.373-26.497=-0.125
max26.637-26.559=0.078