Compare commits

Home / Compare 896a8eba .. d5174c8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.055=-0.023
σ0.369-0.369=0.000
min53.891-53.908=-0.017
max55.080-55.103=-0.023
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.140-0.138=0.002
σ0.003-0.004=-0.000
min0.137-0.132=0.005
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.010
σ0.006-0.006=-0.000
min43.375-43.386=-0.010
max43.397-43.402=-0.005
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.001
min0.119-0.115=0.004
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.979=-0.647
σ0.882-0.925=-0.043
min1005.836-1006.507=-0.671
max1009.981-1010.827=-0.846
mean1050.100-1055.650=-5.550
σ306.907-306.148=0.760
min584.000-576.000=8.000
max1648.000-1457.000=191.000
mean1.545-1.568=-0.023
σ0.076-0.135=-0.060
min1.381-1.469=-0.088
max1.651-2.021=-0.369

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.422-0.441=-0.018
σ0.135-0.126=0.009
min0.343-0.352=-0.009
max0.661-0.659=0.002
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.874-0.886=-0.012
σ0.092-0.097=-0.005
min0.822-0.826=-0.004
max1.036-1.058=-0.022
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.572-0.532=0.040
σ0.061-0.051=0.009
min0.509-0.482=0.027
max0.649-0.616=0.032
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean1.006-0.843=0.163
σ0.328-0.040=0.288
min0.820-0.816=0.004
max1.589-0.911=0.678

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.822=-1.270
σ0.024-0.026=-0.001
min963.523-964.802=-1.279
max963.582-964.864=-1.282
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.821-0.829=-0.009
σ0.044-0.032=0.013
min0.745-0.795=-0.051
max0.852-0.865=-0.012
name=cdr_enhanced_4k_loc.art
mean884.856-885.511=-0.655
σ0.005-0.006=-0.001
min884.847-885.504=-0.657
max884.861-885.518=-0.657
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.713-0.736=-0.023
σ0.039-0.008=0.031
min0.653-0.723=-0.070
max0.741-0.745=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.713-7.719=-0.006
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean3.536-3.535=0.000
σ0.092-0.084=0.008
min3.380-3.395=-0.015
max3.782-3.894=-0.113
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean4.155-3.523=0.631
σ0.272-0.064=0.208
min3.405-3.386=0.018
max4.541-3.734=0.807
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.747-0.540=0.208
σ0.018-0.015=0.002
min0.711-0.520=0.191
max0.863-0.638=0.224
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.716-0.506=0.210
σ0.018-0.016=0.002
min0.685-0.475=0.210
max0.826-0.569=0.257

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.599-295.628=-0.030
σ0.241-0.285=-0.045
min295.462-295.466=-0.004
max296.277-296.421=-0.144
mean1903.000-1905.000=-2.000
σ0.000
min1903.000-1905.000=-2.000
max1903.000-1905.000=-2.000
mean0.581-0.583=-0.002
σ0.043-0.046=-0.003
min0.533-0.500=0.033
max0.686-0.645=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.398=-0.146
σ0.038-0.030=0.008
min285.205-285.360=-0.155
max285.291-285.431=-0.140
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.391-0.403=-0.012
σ0.011-0.005=0.006
min0.380-0.396=-0.016
max0.406-0.410=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.200-1295.765=-0.565
σ0.114-0.069=0.045
min1295.077-1295.676=-0.599
max1295.342-1295.838=-0.496
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean1.930-1.913=0.017
σ0.105-0.102=0.003
min1.798-1.819=-0.022
max2.023-2.048=-0.025
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1539.992=-1.918
σ4.010-6.860=-2.850
min1536.032-1536.776=-0.744
max1545.238-1552.261=-7.022
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean2.262-2.503=-0.241
σ0.204-0.156=0.048
min2.006-2.248=-0.242
max2.508-2.645=-0.136
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.700=-0.590
σ0.054-0.051=0.003
min1857.053-1857.654=-0.602
max1857.183-1857.774=-0.591
mean1772.400-1744.600=27.800
σ127.688-171.144=-43.456
min1648.000-1505.000=143.000
max1903.000-1905.000=-2.000
mean3.053-3.058=-0.005
σ0.305-0.264=0.041
min2.838-2.869=-0.031
max3.578-3.524=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.759=-0.390
σ0.276-0.129=0.147
min1.102-1.608=-0.506
max1.823-1.917=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-445.741=-2.132
σ577.065-580.934=-3.869
min155.075-155.272=-0.198
max1309.206-1317.142=-7.936
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean0.548-0.542=0.007
σ0.569-0.558=0.012
min0.262-0.262=-0.000
max1.402-1.378=0.024
policies=20
mean1551.023-1552.986=-1.963
σ0.316-0.317=-0.001
min1550.806-1552.769=-1.963
max1551.493-1553.457=-1.964
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean2.582-2.572=0.011
σ0.015-0.017=-0.001
min2.571-2.557=0.014
max2.605-2.595=0.009
policies=200
mean15518.566-15538.060=-19.494
σ0.087-0.060=0.027
min15518.471-15538.014=-19.543
max15518.676-15538.147=-19.471
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1457.000=191.000
σ0.000
min1648.000-1457.000=191.000
max1648.000-1457.000=191.000
mean26.382-26.140=0.242
σ0.167-0.018=0.149
min26.255-26.118=0.138
max26.623-26.161=0.462