Compare commits

Home / Compare e32a1ad4 .. fdea973b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.972=-0.000
σ0.369-0.369=0.000
min53.828-53.830=-0.002
max55.022-55.022=0.000
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.139-0.139=0.000
σ0.005-0.006=-0.000
min0.130-0.131=-0.001
max0.147-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.341-43.342=-0.001
σ0.007-0.007=0.001
min43.331-43.331=0.000
max43.357-43.356=0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.120-0.123=-0.003
σ0.004-0.004=-0.000
min0.116-0.117=-0.002
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.900-1016.897=0.003
σ1.165-1.148=0.016
min1016.350-1016.321=0.029
max1021.773-1021.697=0.076
mean1063.850-1061.450=2.400
σ318.728-317.596=1.132
min603.000-602.000=1.000
max1635.000-1627.000=8.000
mean1.612-1.578=0.033
σ0.072-0.099=-0.026
min1.541-1.485=0.056
max1.826-1.830=-0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.865-0.865=0.000
σ0.002
min0.864-0.864=0.000
max0.868-0.868=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.252-0.349=-0.098
σ0.021-0.032=-0.011
min0.231-0.326=-0.096
max0.287-0.404=-0.118
name=error_case.art
mean2.336-2.336=0.000
σ0.004
min2.333-2.333=0.000
max2.341-2.341=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.704-0.930=-0.226
σ0.178-0.156=0.022
min0.591-0.837=-0.246
max1.014-1.205=-0.191
name=heavy_item.art
mean1.522-1.521=0.000
σ0.002
min1.521-1.521=0.000
max1.525-1.524=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.408-0.539=-0.131
σ0.062-0.038=0.024
min0.367-0.500=-0.133
max0.515-0.601=-0.086
name=nested_use.art
mean2.358-2.358=0.000
σ0.002
min2.357-2.357=0.000
max2.361-2.361=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.605-0.850=-0.246
σ0.026-0.042=-0.016
min0.574-0.818=-0.244
max0.638-0.922=-0.284

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean961.167-961.167=0.000
σ0.007-0.009=-0.002
min961.163-961.156=0.007
max961.178-961.178=-0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.791-0.830=-0.039
σ0.048-0.017=0.031
min0.709-0.802=-0.093
max0.832-0.844=-0.012
name=cdr_enhanced_4k_loc.art
mean882.545-882.545=-0.000
σ0.039-0.040=-0.001
min882.519-882.519=0.000
max882.613-882.613=-0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.728-0.735=-0.007
σ0.030-0.005=0.025
min0.678-0.730=-0.052
max0.755-0.742=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.685-7.685=0.000
σ0.002-0.002=-0.000
min7.684-7.684=0.000
max7.688-7.688=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean3.413-4.142=-0.728
σ0.090-0.100=-0.010
min3.228-3.442=-0.215
max3.847-4.348=-0.501
name=record_render_large_syntax_err.art
mean7.634-7.634=-0.000
σ0.002-0.002=-0.000
min7.633-7.633=0.000
max7.637-7.638=-0.001
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean3.429-4.157=-0.728
σ0.101-0.084=0.017
min3.244-4.002=-0.758
max3.884-4.394=-0.510
name=record_render_success.art
mean2.281-2.281=0.000
σ0.002
min2.281-2.280=0.000
max2.284-2.284=0.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.520-0.713=-0.193
σ0.052-0.063=-0.011
min0.285-0.516=-0.230
max0.717-0.818=-0.101
name=record_render_syntax_err.art
mean2.157-2.156=0.000
σ0.002-0.002=0.000
min2.156-2.156=0.000
max2.161-2.160=0.001
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.495-0.694=-0.199
σ0.040-0.020=0.021
min0.281-0.661=-0.381
max0.604-0.820=-0.215

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.932-302.028=-0.095
σ0.263-0.204=0.059
min301.712-301.851=-0.138
max302.636-302.574=0.062
mean2035.000-2050.000=-15.000
σ0.000
min2035.000-2050.000=-15.000
max2035.000-2050.000=-15.000
mean0.596-0.594=0.002
σ0.015-0.016=-0.001
min0.558-0.550=0.007
max0.612-0.606=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.502-303.512=-0.010
σ0.071-0.050=0.021
min303.387-303.435=-0.047
max303.560-303.564=-0.004
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.394-0.390=0.004
σ0.005-0.001=0.004
min0.390-0.389=0.001
max0.402-0.392=0.010
iters=5
new-facts=1
prior-facts=6402
mean1326.058-1326.058=-0.000
σ0.107-0.108=-0.000
min1325.925-1325.922=0.003
max1326.200-1326.193=0.006
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean1.927-1.933=-0.006
σ0.082-0.097=-0.015
min1.843-1.830=0.013
max2.033-2.047=-0.014
iters=5
new-facts=6402
prior-facts=1
mean1564.115-1564.101=0.013
σ6.904-6.892=0.012
min1560.760-1560.788=-0.029
max1576.459-1576.424=0.035
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean2.310-2.247=0.064
σ0.236-0.181=0.055
min2.083-2.062=0.021
max2.592-2.487=0.105
iters=5
new-facts=6402
prior-facts=6402
mean1894.007-1894.006=0.001
σ0.072-0.078=-0.006
min1893.880-1893.870=0.010
max1894.049-1894.063=-0.015
mean1771.000-1792.000=-21.000
σ167.584-185.104=-17.520
min1635.000-1627.000=8.000
max2035.000-2050.000=-15.000
mean2.977-3.073=-0.096
σ0.152-0.128=0.024
min2.854-2.887=-0.033
max3.230-3.221=0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.188=0.024
σ0.338-0.380=-0.042
min0.925-0.909=0.016
max1.782-1.824=-0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.682-444.683=-0.001
σ575.126-575.126=0.000
min157.117-157.119=-0.002
max1307.370-1307.372=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean0.530-0.547=-0.018
σ0.527-0.564=-0.038
min0.261-0.262=-0.002
max1.320-1.394=-0.074
policies=20
mean1571.528-1571.518=0.010
σ0.386-0.359=0.027
min1571.268-1571.280=-0.011
max1572.102-1572.052=0.051
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean2.672-2.633=0.040
σ0.034-0.041=-0.006
min2.627-2.606=0.021
max2.704-2.693=0.011
policies=200
mean15723.266-15723.191=0.075
σ0.168-0.095=0.073
min15723.092-15723.122=-0.030
max15723.464-15723.331=0.132
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1627.000=8.000
σ0.000
min1635.000-1627.000=8.000
max1635.000-1627.000=8.000
mean26.613-26.411=0.202
σ0.086-0.092=-0.006
min26.519-26.310=0.210
max26.724-26.530=0.195