Compare commits

Home / Compare f9c05af8 .. 87d72065

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.002
σ0.370-0.369=0.001
min53.913-53.913=-0.000
max55.107-55.106=0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.139-0.142=-0.003
σ0.003-0.004=-0.000
min0.136-0.138=-0.002
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.007=-0.001
min43.381-43.376=0.005
max43.407-43.403=0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.123=-0.002
σ0.005-0.003=0.002
min0.114-0.120=-0.006
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.975-1006.974=0.001
σ0.900-0.891=0.009
min1006.495-1006.480=0.015
max1010.713-1010.675=0.038
mean1049.500-1046.700=2.800
σ305.871-303.755=2.116
min577.000
max1640.000-1660.000=-20.000
mean1.553-1.534=0.019
σ0.103-0.052=0.051
min1.460-1.477=-0.017
max1.827-1.623=0.204

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.002-0.003=-0.001
min0.882
max0.887-0.889=-0.002
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.417-0.425=-0.008
σ0.126-0.129=-0.004
min0.338-0.350=-0.012
max0.638-0.653=-0.015
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.002
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.869-0.878=-0.009
σ0.088-0.082=0.007
min0.820-0.818=0.002
max1.026-1.021=0.005
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.000
min1.522
max1.525-1.526=-0.001
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.530-0.542=-0.012
σ0.056-0.054=0.002
min0.476-0.500=-0.023
max0.623-0.632=-0.009
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.842-0.844=-0.002
σ0.037-0.026=0.011
min0.813-0.825=-0.011
max0.906-0.889=0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.833=-0.003
σ0.025-0.026=-0.001
min964.813-964.806=0.007
max964.872-964.875=-0.003
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.833-0.806=0.027
σ0.057-0.049=0.008
min0.732-0.730=0.002
max0.862-0.853=0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.003
σ0.009-0.006=0.003
min885.504-885.505=-0.001
max885.526-885.520=0.006
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.696-0.714=-0.018
σ0.025-0.056=-0.031
min0.666-0.617=0.049
max0.724-0.757=-0.033

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean4.189-4.234=-0.045
σ0.142-0.089=0.053
min3.510-4.079=-0.570
max4.494-4.659=-0.165
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean4.200-4.224=-0.023
σ0.071-0.077=-0.006
min4.072-4.060=0.013
max4.505-4.521=-0.016
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.712-0.745=-0.034
σ0.020-0.017=0.003
min0.681-0.715=-0.033
max0.863-0.855=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.695-0.714=-0.020
σ0.025-0.015=0.010
min0.598-0.680=-0.082
max0.793-0.787=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.571-295.722=-0.150
σ0.230-0.277=-0.047
min295.377-295.341=0.036
max296.163-296.399=-0.236
mean1906.000-1923.000=-17.000
σ0.000
min1906.000-1923.000=-17.000
max1906.000-1923.000=-17.000
mean0.585-0.569=0.017
σ0.059-0.045=0.014
min0.510-0.502=0.008
max0.720-0.655=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.410=-0.002
σ0.034-0.030=0.004
min285.366-285.374=-0.008
max285.444-285.441=0.003
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.399-0.389=0.010
σ0.014-0.010=0.005
min0.381-0.380=0.001
max0.419-0.400=0.019
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.795=-0.003
σ0.107-0.106=0.001
min1295.670-1295.674=-0.004
max1295.913-1295.919=-0.007
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean1.987-1.898=0.090
σ0.237-0.078=0.159
min1.807-1.811=-0.004
max2.388-1.996=0.392
iters=5
new-facts=6402
prior-facts=1
mean1539.935-1539.928=0.007
σ6.844-6.894=-0.051
min1536.636-1536.634=0.003
max1552.172-1552.255=-0.083
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean2.277-2.337=-0.060
σ0.224-0.212=0.012
min2.020-2.104=-0.083
max2.613-2.647=-0.034
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.706=-0.004
σ0.049-0.062=-0.013
min1857.655-1857.634=0.021
max1857.776-1857.783=-0.007
mean1773.000-1783.400=-10.400
σ130.453-132.741=-2.288
min1640.000-1660.000=-20.000
max1906.000-1923.000=-17.000
mean3.021-3.033=-0.013
σ0.295-0.134=0.161
min2.778-2.856=-0.078
max3.523-3.163=0.360

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.433-1.356=0.076
σ0.257-0.112=0.145
min1.257-1.269=-0.012
max1.878-1.539=0.339

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.738-445.741=-0.003
σ580.934-580.934=-0.000
min155.270-155.272=-0.003
max1317.140-1317.143=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean0.525-0.557=-0.032
σ0.534-0.595=-0.062
min0.257-0.258=-0.001
max1.326-1.450=-0.125
policies=20
mean1552.969-1552.987=-0.018
σ0.333-0.320=0.013
min1552.739-1552.764=-0.026
max1553.463-1553.462=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean2.595-2.584=0.011
σ0.026-0.020=0.006
min2.561-2.568=-0.007
max2.622-2.612=0.010
policies=200
mean15537.967-15538.074=-0.107
σ0.105-0.079=0.025
min15537.892-15537.974=-0.082
max15538.121-15538.169=-0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1660.000=-20.000
σ0.000
min1640.000-1660.000=-20.000
max1640.000-1660.000=-20.000
mean26.182-26.218=-0.036
σ0.017-0.144=-0.126
min26.160-26.083=0.077
max26.202-26.402=-0.200