Compare commits

Home / Compare 4aca6087 .. 3bc66610

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.013=0.002
σ0.371-0.367=0.004
min53.869-53.874=-0.005
max55.070-55.057=0.012
mean417.700-413.000=4.700
σ0.483-0.000=0.483
min417.000-413.000=4.000
max418.000-413.000=5.000
mean0.139-0.137=0.002
σ0.004-0.003=0.000
min0.136-0.134=0.001
max0.144-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.006-0.007=-0.000
min43.312-43.315=-0.003
max43.336-43.334=0.002
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.122-0.120=0.002
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.305=0.002
σ1.179-1.194=-0.014
min1005.768-1005.770=-0.002
max1011.242-1011.304=-0.062
mean1048.350-1035.800=12.550
σ313.433-310.381=3.052
min598.000-545.000=53.000
max1645.000-1503.000=142.000
mean1.548-1.556=-0.008
σ0.082-0.084=-0.002
min1.435-1.461=-0.026
max1.776-1.772=0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.411-0.411=0.000
σ0.137-0.117=0.020
min0.335-0.342=-0.007
max0.655-0.617=0.039
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.892-0.884=0.008
σ0.095-0.091=0.004
min0.829-0.821=0.008
max1.059-1.041=0.018
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.542-0.539=0.004
σ0.054-0.056=-0.002
min0.505-0.493=0.013
max0.634-0.635=-0.001
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.840-0.848=-0.008
σ0.027-0.036=-0.009
min0.823-0.816=0.006
max0.887-0.908=-0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.102=0.013
σ0.032-0.034=-0.002
min964.087-964.077=0.010
max964.167-964.163=0.004
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.803-0.823=-0.021
σ0.044-0.026=0.019
min0.749-0.789=-0.040
max0.851-0.851=-0.000
name=cdr_enhanced_4k_loc.art
mean884.711-884.710=0.002
σ0.008-0.006=0.002
min884.703
max884.722-884.717=0.005
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.722-0.700=0.022
σ0.027-0.048=-0.021
min0.683-0.633=0.050
max0.754-0.745=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean4.212-3.679=0.533
σ0.075-0.323=-0.248
min4.057-3.361=0.696
max4.461-4.531=-0.070
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean4.216-4.241=-0.025
σ0.074-0.094=-0.020
min4.085-4.091=-0.006
max4.461-4.521=-0.060
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.736-0.726=0.009
σ0.019-0.015=0.003
min0.704-0.697=0.007
max0.858-0.823=0.035
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.694-0.694=0.001
σ0.013-0.014=-0.001
min0.665-0.667=-0.002
max0.763-0.777=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.142-296.267=-0.125
σ0.222-0.157=0.065
min295.964-296.116=-0.152
max296.742-296.657=0.085
mean1903.000-1955.000=-52.000
σ0.000
min1903.000-1955.000=-52.000
max1903.000-1955.000=-52.000
mean0.583-0.574=0.009
σ0.049-0.037=0.012
min0.513-0.525=-0.012
max0.692-0.646=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.694=-0.003
σ0.039-0.045=-0.006
min284.642-284.630=0.012
max284.741-284.741=0.000
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.398-0.387=0.011
σ0.012-0.018=-0.007
min0.383-0.358=0.026
max0.409-0.403=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.107=-0.030
σ0.107-0.098=0.009
min1294.962-1294.997=-0.035
max1295.210-1295.244=-0.034
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean1.923-2.113=-0.190
σ0.101-0.088=0.013
min1.806-2.009=-0.203
max2.025-2.199=-0.174
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.257=-0.072
σ6.857-6.794=0.063
min1535.944-1536.111=-0.167
max1551.447-1551.409=0.038
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean2.253-2.448=-0.196
σ0.225-0.172=0.052
min2.042-2.264=-0.221
max2.509-2.661=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean1856.990-1856.986=0.004
σ0.052-0.065=-0.013
min1856.940-1856.912=0.028
max1857.063-1857.062=0.002
mean1772.000-1758.000=14.000
σ128.183-203.463=-75.279
min1645.000-1503.000=142.000
max1903.000-1955.000=-52.000
mean3.075-2.967=0.109
σ0.274-0.169=0.104
min2.871-2.777=0.094
max3.549-3.205=0.344

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.653=-0.448
σ0.288-0.239=0.049
min0.947-1.267=-0.320
max1.680-1.876=-0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.783=0.003
σ581.212-581.212=-0.001
min157.176-157.176=0.000
max1319.604-1319.602=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean0.519-0.557=-0.039
σ0.509-0.591=-0.082
min0.263-0.260=0.002
max1.282-1.444=-0.161
policies=20
mean1572.104-1572.081=0.024
σ0.360-0.355=0.005
min1571.858-1571.834=0.024
max1572.639-1572.607=0.032
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean2.630-2.625=0.005
σ0.009-0.026=-0.017
min2.622-2.608=0.014
max2.641-2.663=-0.022
policies=200
mean15729.098-15729.019=0.079
σ0.115-0.164=-0.049
min15729.011-15728.867=0.144
max15729.264-15729.233=0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1503.000=142.000
σ0.000
min1645.000-1503.000=142.000
max1645.000-1503.000=142.000
mean26.462-26.563=-0.101
σ0.051-0.075=-0.024
min26.422-26.475=-0.052
max26.529-26.634=-0.105