Compare commits

Home / Compare 27fd85fb .. 5156857f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=-0.000
σ0.369-0.372=-0.002
min53.872-53.870=0.001
max55.064-55.071=-0.007
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.138-0.139=-0.001
σ0.004-0.004=-0.000
min0.133-0.135=-0.003
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=-0.000
σ0.007-0.007=-0.000
min43.312-43.311=0.001
max43.333-43.337=-0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.122=0.000
σ0.004-0.004=0.000
min0.118-0.118=-0.000
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.305=0.004
σ1.170-1.171=-0.001
min1005.764-1005.767=-0.003
max1011.215-1011.211=0.004
mean1048.350-1048.750=-0.400
σ312.937-313.963=-1.025
min600.000-597.000=3.000
max1643.000-1644.000=-1.000
mean1.560-1.563=-0.003
σ0.096-0.077=0.019
min1.466-1.484=-0.018
max1.802-1.783=0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.411-0.420=-0.009
σ0.134-0.164=-0.030
min0.334-0.320=0.013
max0.649-0.710=-0.062
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.883-0.908=-0.025
σ0.097-0.146=-0.048
min0.826-0.813=0.013
max1.052-1.163=-0.112
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.002-0.002=-0.001
min1.522
max1.526-1.527=-0.001
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.537-0.551=-0.013
σ0.050-0.047=0.004
min0.492-0.518=-0.026
max0.621-0.628=-0.007
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=-0.001
min2.359
max2.363-2.364=-0.001
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.840-0.845=-0.005
σ0.036-0.036=0.000
min0.812-0.806=0.006
max0.901-0.902=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.111=0.004
σ0.034-0.022=0.011
min964.086-964.091=-0.005
max964.170-964.146=0.025
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.842-0.815=0.027
σ0.028-0.027=0.001
min0.793-0.770=0.023
max0.864-0.840=0.024
name=cdr_enhanced_4k_loc.art
mean884.712-884.713=-0.001
σ0.008-0.001=0.007
min884.705-884.712=-0.007
max884.724-884.714=0.009
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.667-0.699=-0.032
σ0.038-0.035=0.002
min0.633-0.653=-0.020
max0.731-0.734=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.002
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean3.505-3.459=0.046
σ0.078-0.084=-0.006
min3.356-3.319=0.037
max3.792-3.748=0.044
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.668=-0.002
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean3.509-3.456=0.053
σ0.068-0.072=-0.004
min3.303-3.340=-0.037
max3.706-3.772=-0.065
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.530-0.737=-0.207
σ0.014-0.018=-0.004
min0.501-0.644=-0.143
max0.609-0.826=-0.217
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.501-0.699=-0.199
σ0.012-0.015=-0.002
min0.477-0.669=-0.192
max0.554-0.770=-0.216

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.128-296.210=-0.081
σ0.257-0.186=0.070
min295.968-295.991=-0.023
max296.838-296.664=0.174
mean1919.000-1901.000=18.000
σ0.000
min1919.000-1901.000=18.000
max1919.000-1901.000=18.000
mean0.581-0.586=-0.005
σ0.060-0.031=0.029
min0.501-0.541=-0.040
max0.690-0.641=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.689-284.693=-0.004
σ0.043-0.035=0.009
min284.637-284.650=-0.012
max284.737-284.730=0.007
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.407-0.395=0.012
σ0.004-0.009=-0.006
min0.403-0.387=0.016
max0.411-0.405=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.068=0.016
σ0.113-0.108=0.005
min1294.956-1294.949=0.007
max1295.220-1295.224=-0.004
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean1.879-1.869=0.010
σ0.077-0.059=0.019
min1.777-1.826=-0.049
max1.959-1.968=-0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.211-1539.220=-0.010
σ6.906-6.868=0.038
min1535.947-1535.961=-0.013
max1551.561-1551.504=0.057
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.204-2.146=0.058
σ0.153-0.129=0.024
min2.048-2.014=0.035
max2.415-2.349=0.065
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.981=0.008
σ0.056-0.064=-0.008
min1856.939-1856.899=0.039
max1857.073-1857.065=0.008
mean1778.000-1771.200=6.800
σ136.686-124.502=12.184
min1643.000-1644.000=-1.000
max1919.000-1901.000=18.000
mean3.092-3.067=0.024
σ0.316-0.264=0.052
min2.851-2.846=0.005
max3.640-3.514=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.134=0.074
σ0.375-0.247=0.127
min0.937-0.933=0.004
max1.837-1.507=0.331

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.933-447.931=0.002
σ581.505-581.505=0.000
min157.179-157.176=0.003
max1320.191-1320.188=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.545-0.524=0.021
σ0.564-0.523=0.042
min0.259-0.259=-0.001
max1.392-1.308=0.084
policies=20
mean1572.119-1572.093=0.027
σ0.384-0.364=0.020
min1571.866-1571.849=0.017
max1572.691-1572.635=0.057
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.678-2.650=0.028
σ0.058-0.025=0.034
min2.611-2.628=-0.017
max2.753-2.682=0.071
policies=200
mean15729.055-15729.082=-0.027
σ0.065-0.115=-0.050
min15728.962-15729.000=-0.038
max15729.112-15729.249=-0.137
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean26.622-26.579=0.043
σ0.208-0.031=0.177
min26.452-26.552=-0.100
max26.921-26.616=0.304