Compare commits

Home / Compare e4b0bbf9 .. 2f70aeef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.001
σ0.371-0.369=0.002
min53.872-53.870=0.002
max55.068-55.062=0.006
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.135-0.138=-0.003
σ0.005-0.003=0.002
min0.129-0.134=-0.004
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.006-0.007=-0.001
min43.311-43.311=0.000
max43.334-43.331=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.122=0.000
σ0.004-0.003=0.001
min0.118-0.119=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.310=0.000
σ1.166-1.177=-0.012
min1005.751-1005.760=-0.009
max1011.190-1011.240=-0.050
mean1044.200-1047.550=-3.350
σ312.612-312.976=-0.364
min596.000-597.000=-1.000
max1637.000-1645.000=-8.000
mean1.539-1.532=0.007
σ0.073-0.069=0.003
min1.446-1.468=-0.023
max1.752-1.700=0.052

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.442-0.443=-0.002
σ0.161-0.120=0.041
min0.322-0.349=-0.027
max0.721-0.650=0.072
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.921-0.919=0.001
σ0.173-0.092=0.081
min0.826-0.828=-0.002
max1.229-1.047=0.183
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.536-0.534=0.002
σ0.051-0.059=-0.008
min0.496-0.488=0.008
max0.625-0.634=-0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.834-0.838=-0.004
σ0.041-0.040=0.001
min0.808-0.805=0.002
max0.903-0.906=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.113=0.000
σ0.033-0.033=0.000
min964.085-964.085=0.000
max964.169-964.168=0.001
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.813-0.847=-0.034
σ0.021-0.022=-0.002
min0.793-0.809=-0.015
max0.843-0.864=-0.021
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=-0.000
σ0.008-0.007=0.000
min884.703-884.705=-0.001
max884.722-884.723=-0.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.690-0.685=0.005
σ0.029-0.072=-0.043
min0.663-0.585=0.078
max0.732-0.741=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean4.275-3.518=0.757
σ0.086-0.075=0.011
min4.127-3.381=0.747
max4.805-3.742=1.062
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=0.000
min7.662
max7.668-7.667=0.001
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean4.266-3.495=0.771
σ0.073-0.102=-0.029
min4.127-3.281=0.847
max4.510-3.762=0.748
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.617-0.531=0.087
σ0.110-0.013=0.097
min0.507-0.512=-0.006
max0.913-0.626=0.288
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.504-0.509=-0.005
σ0.012-0.015=-0.003
min0.483-0.457=0.027
max0.565-0.575=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.248-296.225=0.023
σ0.202-0.199=0.003
min296.079-296.088=-0.009
max296.792-296.740=0.052
mean1915.000-1916.000=-1.000
σ0.000
min1915.000-1916.000=-1.000
max1915.000-1916.000=-1.000
mean0.571-0.568=0.002
σ0.058-0.060=-0.002
min0.504-0.506=-0.002
max0.699-0.698=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.694=0.006
σ0.034-0.032=0.003
min284.656-284.652=0.004
max284.736-284.726=0.010
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.399-0.395=0.004
σ0.008-0.010=-0.001
min0.387-0.384=0.002
max0.406-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.078=-0.000
σ0.115-0.108=0.006
min1294.962-1294.960=0.002
max1295.218-1295.214=0.004
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean1.899-1.917=-0.017
σ0.086-0.117=-0.030
min1.807-1.783=0.024
max1.990-2.037=-0.047
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.182=0.004
σ6.855-6.832=0.022
min1535.960-1535.917=0.044
max1551.445-1551.401=0.044
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean2.201-2.265=-0.064
σ0.205-0.268=-0.063
min2.026-2.026=0.001
max2.456-2.689=-0.233
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.985=-0.005
σ0.066-0.067=-0.002
min1856.897-1856.899=-0.002
max1857.068-1857.072=-0.004
mean1773.200-1775.000=-1.800
σ137.252-136.057=1.195
min1637.000-1645.000=-8.000
max1915.000-1916.000=-1.000
mean3.029-3.022=0.008
σ0.218-0.170=0.048
min2.778-2.851=-0.072
max3.373-3.264=0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.194=0.002
σ0.295-0.284=0.010
min0.938-0.933=0.006
max1.684-1.659=0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.784=-0.000
σ581.212-581.212=0.000
min157.173-157.176=-0.003
max1319.601-1319.601=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.561-0.546=0.014
σ0.592-0.577=0.015
min0.263-0.254=0.009
max1.448-1.412=0.036
policies=20
mean1572.085-1572.085=-0.000
σ0.351-0.356=-0.005
min1571.846-1571.843=0.003
max1572.607-1572.615=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean2.622-2.627=-0.005
σ0.011-0.015=-0.004
min2.611-2.612=-0.002
max2.635-2.644=-0.009
policies=200
mean15729.010-15729.021=-0.011
σ0.142-0.117=0.025
min15728.887-15728.903=-0.016
max15729.174-15729.141=0.034
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean26.458-26.448=0.010
σ0.106-0.103=0.003
min26.377-26.388=-0.011
max26.607-26.603=0.004