Compare commits

Home / Compare 22a7102c .. 22051d2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.126-54.151=-0.025
σ0.349-0.351=-0.002
min53.985-54.013=-0.028
max55.120-55.151=-0.031
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.136-0.131=0.005
max0.144-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.404-43.414=-0.010
σ0.006-0.007=-0.001
min43.397-43.403=-0.007
max43.415-43.428=-0.014
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.123-0.122=0.001
σ0.004-0.003=0.001
min0.118-0.120=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.337-1006.982=-0.645
σ0.874-0.869=0.005
min1005.837-1006.485=-0.648
max1009.956-1010.576=-0.620
mean1047.850-1052.550=-4.700
σ309.925-319.788=-9.863
min552.000-577.000=-25.000
max1641.000-1621.000=20.000
mean1.518-1.540=-0.022
σ0.079-0.062=0.018
min1.446-1.483=-0.038
max1.745-1.729=0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.414-0.419=-0.005
σ0.129-0.133=-0.003
min0.328-0.336=-0.008
max0.642-0.654=-0.012
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.872-0.881=-0.009
σ0.084-0.084=-0.000
min0.805-0.824=-0.019
max1.015-1.028=-0.013
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.528-0.536=-0.008
σ0.052-0.053=-0.001
min0.475-0.496=-0.022
max0.611-0.628=-0.017
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.835-0.845=-0.010
σ0.032-0.038=-0.006
min0.809-0.823=-0.014
max0.890-0.912=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.557-964.831=-1.274
σ0.034-0.025=0.008
min963.523-964.802=-1.279
max963.612-964.863=-1.251
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.845-0.833=0.012
σ0.018-0.026=-0.008
min0.815-0.793=0.022
max0.857-0.851=0.006
name=cdr_enhanced_4k_loc.art
mean884.856-885.513=-0.657
σ0.005-0.007=-0.002
min884.847-885.504=-0.657
max884.861-885.520=-0.658
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.723-0.714=0.009
σ0.030-0.027=0.003
min0.678-0.680=-0.002
max0.752-0.744=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.711-7.719=-0.008
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean3.514-3.551=-0.038
σ0.094-0.077=0.017
min3.386-3.434=-0.048
max3.838-3.856=-0.018
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean3.484-3.533=-0.049
σ0.075-0.068=0.008
min3.344-3.416=-0.072
max3.701-3.773=-0.072
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.747-0.751=-0.004
σ0.018-0.018=0.000
min0.718-0.718=0.000
max0.861-0.853=0.008
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.708-0.715=-0.007
σ0.015-0.015=-0.000
min0.683-0.678=0.005
max0.795-0.792=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.689-295.594=0.096
σ0.218-0.226=-0.008
min295.497-295.409=0.088
max296.240-296.212=0.029
mean1975.000-1913.000=62.000
σ0.000
min1975.000-1913.000=62.000
max1975.000-1913.000=62.000
mean0.567-0.580=-0.013
σ0.032-0.046=-0.013
min0.515-0.497=0.018
max0.617-0.673=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.412=-0.160
σ0.037-0.040=-0.003
min285.210-285.360=-0.150
max285.298-285.454=-0.156
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.396-0.387=0.009
σ0.011-0.008=0.003
min0.383-0.374=0.009
max0.408-0.395=0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.199-1295.798=-0.599
σ0.107-0.104=0.003
min1295.077-1295.683=-0.606
max1295.338-1295.922=-0.584
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean1.931-1.911=0.020
σ0.070-0.092=-0.022
min1.877-1.815=0.062
max2.049-2.024=0.025
iters=5
new-facts=6402
prior-facts=1
mean1538.119-1539.943=-1.824
σ4.035-6.887=-2.851
min1536.085-1536.659=-0.574
max1545.327-1552.257=-6.930
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean2.375-2.377=-0.002
σ0.301-0.255=0.046
min2.038-2.110=-0.072
max2.702-2.695=0.007
iters=5
new-facts=6402
prior-facts=6402
mean1857.132-1857.709=-0.577
σ0.083-0.050=0.034
min1857.035-1857.662=-0.626
max1857.230-1857.780=-0.550
mean1804.800-1779.200=25.600
σ167.153-138.272=28.881
min1641.000-1621.000=20.000
max1975.000-1913.000=62.000
mean3.206-3.124=0.082
σ0.380-0.341=0.040
min2.688-2.885=-0.196
max3.622-3.723=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.324-1.371=-0.047
σ0.248-0.245=0.003
min0.987-1.119=-0.132
max1.657-1.774=-0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.614-445.744=-2.130
σ577.065-580.934=-3.869
min155.079-155.275=-0.196
max1309.212-1317.145=-7.933
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean0.541-0.567=-0.027
σ0.563-0.614=-0.051
min0.257-0.258=-0.001
max1.385-1.488=-0.103
policies=20
mean1551.066-1553.016=-1.950
σ0.315-0.332=-0.017
min1550.849-1552.789=-1.939
max1551.534-1553.510=-1.975
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean2.577-2.591=-0.014
σ0.010-0.011=-0.001
min2.566-2.576=-0.010
max2.590-2.601=-0.012
policies=200
mean15518.755-15538.280=-19.525
σ0.156-0.044=0.111
min15518.638-15538.237=-19.599
max15518.968-15538.338=-19.370
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1621.000=20.000
σ0.000
min1641.000-1621.000=20.000
max1641.000-1621.000=20.000
mean26.310-26.156=0.154
σ0.306-0.093=0.213
min26.104-26.055=0.049
max26.762-26.237=0.524