Compare commits

Home / Compare e2c07b6b .. 9dc30f5b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.054=-0.022
σ0.369-0.368=0.001
min53.891-53.908=-0.017
max55.080-55.100=-0.020
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.140-0.138=0.003
σ0.003-0.010=-0.006
min0.137-0.120=0.017
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.011
σ0.006-0.007=-0.000
min43.375-43.389=-0.014
max43.397-43.408=-0.011
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.122-0.121=0.000
σ0.003-0.004=-0.001
min0.119-0.115=0.004
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1007.003=-0.672
σ0.882-1.198=-0.316
min1005.836-1006.432=-0.596
max1009.981-1012.028=-2.047
mean1050.100-1054.050=-3.950
σ306.907-308.046=-1.139
min584.000-579.000=5.000
max1648.000-1646.000=2.000
mean1.545-1.518=0.027
σ0.076-0.060=0.016
min1.381-1.462=-0.081
max1.651-1.711=-0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.422-0.423=-0.001
σ0.135-0.146=-0.011
min0.343-0.346=-0.003
max0.661-0.683=-0.022
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.874-0.879=-0.004
σ0.092-0.092=-0.000
min0.822-0.804=0.018
max1.036-1.034=0.002
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.572-0.540=0.032
σ0.061-0.045=0.016
min0.509-0.493=0.016
max0.649-0.611=0.038
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean1.006-0.862=0.144
σ0.328-0.040=0.288
min0.820-0.827=-0.007
max1.589-0.931=0.658

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.838=-1.286
σ0.024-0.034=-0.010
min963.523-964.809=-1.287
max963.582-964.895=-1.313
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.821-0.827=-0.006
σ0.044-0.030=0.014
min0.745-0.795=-0.050
max0.852-0.862=-0.010
name=cdr_enhanced_4k_loc.art
mean884.856-885.512=-0.656
σ0.005-0.007=-0.001
min884.847-885.504=-0.657
max884.861-885.521=-0.660
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.713-0.718=-0.005
σ0.039-0.033=0.006
min0.653-0.676=-0.022
max0.741-0.746=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.713-7.721=-0.008
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean3.536-4.245=-0.710
σ0.092-0.089=0.003
min3.380-4.103=-0.723
max3.782-4.629=-0.847
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean4.155-4.249=-0.094
σ0.272-0.074=0.198
min3.405-4.135=-0.730
max4.541-4.549=-0.008
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.747-0.752=-0.005
σ0.018-0.016=0.002
min0.711-0.722=-0.011
max0.863-0.853=0.010
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.716-0.714=0.002
σ0.018-0.018=0.000
min0.685-0.640=0.044
max0.826-0.792=0.034

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.599-296.939=-1.340
σ0.241-0.246=-0.006
min295.462-296.771=-1.309
max296.277-297.619=-1.342
mean1903.000-2030.000=-127.000
σ0.000
min1903.000-2030.000=-127.000
max1903.000-2030.000=-127.000
mean0.581-0.545=0.036
σ0.043-0.037=0.007
min0.533-0.507=0.027
max0.686-0.584=0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-286.823=-1.571
σ0.038-0.040=-0.002
min285.205-286.768=-1.564
max285.291-286.865=-1.574
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.391-0.395=-0.004
σ0.011-0.007=0.004
min0.380-0.387=-0.008
max0.406-0.401=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.200-1297.253=-2.053
σ0.114-0.106=0.008
min1295.077-1297.095=-2.019
max1295.342-1297.373=-2.031
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean1.930-2.216=-0.286
σ0.105-0.109=-0.003
min1.798-2.053=-0.255
max2.023-2.336=-0.313
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1541.377=-3.302
σ4.010-6.793=-2.784
min1536.032-1538.225=-2.193
max1545.238-1553.528=-8.290
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean2.262-2.332=-0.070
σ0.204-0.260=-0.056
min2.006-2.140=-0.134
max2.508-2.777=-0.268
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1859.118=-2.008
σ0.054-0.065=-0.011
min1857.053-1859.024=-1.971
max1857.183-1859.190=-2.007
mean1772.400-1782.800=-10.400
σ127.688-167.096=-39.408
min1648.000-1646.000=2.000
max1903.000-2030.000=-127.000
mean3.053-2.898=0.155
σ0.305-0.100=0.205
min2.838-2.789=0.049
max3.578-3.035=0.543

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.257=0.112
σ0.276-0.322=-0.046
min1.102-0.946=0.156
max1.823-1.790=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-448.820=-5.211
σ577.065-581.372=-4.307
min155.075-158.130=-3.055
max1309.206-1320.878=-11.672
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean0.548-0.553=-0.004
σ0.569-0.578=-0.009
min0.262-0.260=0.001
max1.402-1.420=-0.018
policies=20
mean1551.023-1581.619=-30.597
σ0.316-0.360=-0.044
min1550.806-1581.379=-30.574
max1551.493-1582.155=-30.663
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean2.582-2.632=-0.049
σ0.015-0.017=-0.001
min2.571-2.613=-0.042
max2.605-2.652=-0.047
policies=200
mean15518.566-15824.145=-305.579
σ0.087-0.118=-0.032
min15518.471-15824.046=-305.575
max15518.676-15824.300=-305.624
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1646.000=2.000
σ0.000
min1648.000-1646.000=2.000
max1648.000-1646.000=2.000
mean26.382-26.655=-0.273
σ0.167-0.146=0.020
min26.255-26.516=-0.261
max26.623-26.817=-0.193