Compare commits

Home / Compare 7661b9cb .. 61aef6b9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.001
σ0.370-0.371=-0.001
min53.869-53.872=-0.003
max55.068-55.068=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.135=0.005
σ0.005-0.005=0.000
min0.136-0.129=0.007
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.006=0.001
min43.308-43.311=-0.003
max43.333-43.334=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.122=-0.000
σ0.004-0.004=0.000
min0.117-0.118=-0.000
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.302-1006.310=-0.008
σ1.170-1.166=0.005
min1005.769-1005.751=0.018
max1011.205-1011.190=0.015
mean1047.450-1044.200=3.250
σ313.647-312.612=1.035
min597.000-596.000=1.000
max1644.000-1637.000=7.000
mean1.564-1.539=0.024
σ0.083-0.073=0.010
min1.477-1.446=0.031
max1.780-1.752=0.029

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.415-0.442=-0.026
σ0.147-0.161=-0.015
min0.333-0.322=0.011
max0.676-0.721=-0.045
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.882-0.921=-0.039
σ0.096-0.173=-0.077
min0.817-0.826=-0.009
max1.048-1.229=-0.181
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.542-0.536=0.006
σ0.054-0.051=0.003
min0.491-0.496=-0.005
max0.628-0.625=0.003
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.844-0.834=0.010
σ0.033-0.041=-0.008
min0.822-0.808=0.014
max0.901-0.903=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.002
σ0.035-0.033=0.002
min964.086-964.085=0.001
max964.173-964.169=0.005
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.842-0.813=0.028
σ0.018-0.021=-0.003
min0.817-0.793=0.024
max0.859-0.843=0.016
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.000
σ0.008-0.008=-0.000
min884.705-884.703=0.001
max884.723-884.722=0.001
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.688-0.690=-0.002
σ0.039-0.029=0.010
min0.640-0.663=-0.023
max0.732-0.732=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean4.270-4.275=-0.005
σ0.093-0.086=0.007
min4.123-4.127=-0.004
max4.549-4.805=-0.255
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.667-7.668=-0.001
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean4.234-4.266=-0.032
σ0.060-0.073=-0.013
min4.142-4.127=0.014
max4.402-4.510=-0.107
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.735-0.617=0.118
σ0.018-0.110=-0.092
min0.706-0.507=0.199
max0.855-0.913=-0.058
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.693-0.504=0.189
σ0.020-0.012=0.008
min0.567-0.483=0.084
max0.755-0.565=0.190

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.083-296.248=-0.165
σ0.208-0.202=0.006
min295.960-296.079=-0.119
max296.660-296.792=-0.132
mean1921.000-1915.000=6.000
σ0.000
min1921.000-1915.000=6.000
max1921.000-1915.000=6.000
mean0.588-0.571=0.017
σ0.046-0.058=-0.013
min0.510-0.504=0.007
max0.691-0.699=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.700=0.000
σ0.036-0.034=0.001
min284.655-284.656=-0.001
max284.742-284.736=0.006
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.398-0.399=-0.001
σ0.011-0.008=0.002
min0.385-0.387=-0.001
max0.410-0.406=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.078=0.002
σ0.110-0.115=-0.005
min1294.956-1294.962=-0.006
max1295.214-1295.218=-0.005
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean1.937-1.899=0.037
σ0.113-0.086=0.027
min1.807-1.807=0.000
max2.113-1.990=0.124
iters=5
new-facts=6402
prior-facts=1
mean1539.214-1539.185=0.028
σ6.860-6.855=0.005
min1535.912-1535.960=-0.048
max1551.479-1551.445=0.035
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean2.339-2.201=0.138
σ0.199-0.205=-0.006
min2.050-2.026=0.024
max2.545-2.456=0.089
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.980=0.006
σ0.055-0.066=-0.011
min1856.933-1856.897=0.036
max1857.066-1857.068=-0.002
mean1778.200-1773.200=5.000
σ138.017-137.252=0.765
min1644.000-1637.000=7.000
max1921.000-1915.000=6.000
mean3.060-3.029=0.031
σ0.260-0.218=0.042
min2.818-2.778=0.040
max3.499-3.373=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.197=-0.015
σ0.308-0.295=0.014
min0.923-0.938=-0.015
max1.562-1.684=-0.122

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.783=0.003
σ581.212-581.212=0.000
min157.178-157.173=0.005
max1319.605-1319.601=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean0.539-0.561=-0.022
σ0.559-0.592=-0.032
min0.249-0.263=-0.014
max1.378-1.448=-0.070
policies=20
mean1572.098-1572.085=0.012
σ0.352-0.351=0.001
min1571.864-1571.846=0.018
max1572.622-1572.607=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean2.628-2.622=0.006
σ0.013-0.011=0.002
min2.612-2.611=0.001
max2.642-2.635=0.007
policies=200
mean15729.097-15729.010=0.086
σ0.141-0.142=-0.001
min15728.929-15728.887=0.042
max15729.262-15729.174=0.088
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1637.000=7.000
σ0.000
min1644.000-1637.000=7.000
max1644.000-1637.000=7.000
mean26.452-26.458=-0.006
σ0.059-0.106=-0.047
min26.386-26.377=0.010
max26.504-26.607=-0.103