Compare commits

Home / Compare f3fc2c86 .. 563169c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.031=0.001
σ0.369-0.369=-0.000
min53.885-53.887=-0.002
max55.081-55.081=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.001
min0.133-0.129=0.004
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.385-43.385=0.000
σ0.008-0.007=0.001
min43.377-43.375=0.002
max43.401-43.399=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.123-0.122=0.002
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.328-1006.331=-0.003
σ0.854-0.908=-0.054
min1005.835-1005.859=-0.025
max1009.861-1010.101=-0.240
mean1044.950-1048.450=-3.500
σ310.728-310.744=-0.016
min560.000-552.000=8.000
max1636.000-1646.000=-10.000
mean1.518-1.543=-0.025
σ0.065-0.093=-0.029
min1.411-1.460=-0.049
max1.656-1.820=-0.164

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886-0.887=-0.001
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.414-0.437=-0.023
σ0.130-0.126=0.004
min0.331-0.347=-0.016
max0.643-0.651=-0.008
name=error_case.art
mean2.334-2.335=-0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.871-0.876=-0.004
σ0.092-0.090=0.001
min0.803-0.815=-0.011
max1.030-1.034=-0.004
name=heavy_item.art
mean1.521-1.521=-0.000
σ0.001-0.001=-0.000
min1.520
max1.523
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.549-0.538=0.011
σ0.051-0.048=0.003
min0.518-0.508=0.010
max0.637-0.622=0.015
name=nested_use.art
mean2.357-2.356=0.000
σ0.003-0.002=0.000
min2.355
max2.360-2.358=0.002
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.843-0.844=-0.001
σ0.041-0.032=0.009
min0.805-0.822=-0.017
max0.910-0.899=0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.551=0.001
σ0.025-0.025=-0.000
min963.523
max963.583-963.583=-0.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.832-0.832=-0.000
σ0.036-0.028=0.008
min0.785-0.800=-0.014
max0.859-0.866=-0.006
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.007=-0.003
min884.851-884.847=0.004
max884.860-884.863=-0.003
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.705-0.726=-0.022
σ0.037-0.037=-0.001
min0.670-0.660=0.011
max0.748-0.750=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.709
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean4.223-4.216=0.007
σ0.098-0.084=0.014
min4.070-4.097=-0.027
max4.594-4.540=0.054
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean4.200-4.221=-0.021
σ0.095-0.078=0.016
min4.053-4.037=0.016
max4.736-4.463=0.272
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.752-0.744=0.008
σ0.017-0.015=0.002
min0.719-0.707=0.012
max0.858-0.834=0.025
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.714-0.705=0.009
σ0.014-0.016=-0.002
min0.688-0.681=0.006
max0.759-0.789=-0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.508-295.489=0.019
σ0.185-0.256=-0.071
min295.407-295.304=0.103
max296.024-296.201=-0.177
mean1945.000-1906.000=39.000
σ0.000
min1945.000-1906.000=39.000
max1945.000-1906.000=39.000
mean0.576-0.568=0.008
σ0.033-0.052=-0.018
min0.512-0.499=0.013
max0.622-0.637=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.248-285.248=-0.000
σ0.038-0.041=-0.003
min285.195-285.198=-0.003
max285.290-285.289=0.001
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.399-0.393=0.005
σ0.010-0.009=0.001
min0.383-0.384=-0.001
max0.411-0.401=0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.188-1295.203=-0.015
σ0.113-0.112=0.002
min1295.057-1295.077=-0.020
max1295.323-1295.327=-0.005
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean1.915-1.895=0.020
σ0.096-0.088=0.008
min1.809-1.812=-0.003
max2.018-2.022=-0.004
iters=5
new-facts=6402
prior-facts=1
mean1538.078-1538.081=-0.002
σ4.022-4.008=0.014
min1536.045-1536.108=-0.063
max1545.265-1545.243=0.022
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean2.255-2.188=0.067
σ0.185-0.132=0.053
min2.051-2.026=0.025
max2.476-2.316=0.160
iters=5
new-facts=6402
prior-facts=6402
mean1857.120-1857.112=0.008
σ0.064-0.052=0.012
min1857.049-1857.052=-0.003
max1857.179-1857.180=-0.001
mean1785.000-1776.000=9.000
σ154.989-128.792=26.196
min1636.000-1646.000=-10.000
max1945.000-1906.000=39.000
mean3.020-3.111=-0.092
σ0.225-0.377=-0.152
min2.768-2.853=-0.085
max3.298-3.769=-0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.389-1.366=0.024
σ0.270-0.263=0.008
min1.106-1.110=-0.004
max1.809-1.796=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.611=-0.000
σ577.065-577.065=-0.000
min155.076-155.075=0.001
max1309.208-1309.209=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean0.564-0.539=0.025
σ0.619-0.562=0.057
min0.253-0.258=-0.005
max1.492-1.382=0.109
policies=20
mean1551.045-1551.051=-0.006
σ0.322-0.340=-0.018
min1550.823-1550.821=0.002
max1551.523-1551.557=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean2.590-2.605=-0.015
σ0.013-0.012=0.001
min2.570-2.590=-0.019
max2.599-2.618=-0.019
policies=200
mean15518.481-15518.514=-0.032
σ0.134-0.060=0.074
min15518.366-15518.462=-0.095
max15518.671-15518.574=0.097
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1646.000=-10.000
σ0.000
min1636.000-1646.000=-10.000
max1636.000-1646.000=-10.000
mean26.102-26.177=-0.075
σ0.106-0.158=-0.052
min26.017-26.053=-0.036
max26.253-26.388=-0.135