Compare commits

Home / Compare 3cc1fcc8 .. 635dea96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.036-54.055=-0.019
σ0.368-0.369=-0.001
min53.890-53.912=-0.023
max55.082-55.105=-0.023
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.149-0.140=0.009
σ0.009-0.004=0.006
min0.138-0.136=0.001
max0.162-0.146=0.016
cache=y
dps=1
iters=10
policies=100
mean43.384-43.392=-0.008
σ0.005-0.006=-0.001
min43.378-43.381=-0.003
max43.396-43.403=-0.007
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.123-0.119=0.004
σ0.004-0.004=0.000
min0.120-0.115=0.005
max0.130-0.124=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1007.005=-0.678
σ0.911-1.187=-0.276
min1005.867-1006.434=-0.567
max1010.118-1011.980=-1.862
mean1053.800-1054.650=-0.850
σ305.174-308.037=-2.863
min582.000-579.000=3.000
max1453.000-1647.000=-194.000
mean1.559-1.527=0.032
σ0.086-0.085=0.001
min1.477-1.334=0.143
max1.759-1.739=0.020

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.443-0.416=0.027
σ0.181-0.141=0.040
min0.352-0.330=0.022
max0.766-0.666=0.100
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.920-0.891=0.029
σ0.174-0.088=0.086
min0.818-0.818=0.000
max1.228-1.043=0.184
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.540-0.539=0.002
σ0.047-0.046=0.002
min0.499-0.498=0.001
max0.616-0.611=0.005
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.846-0.853=-0.007
σ0.037-0.033=0.005
min0.800-0.828=-0.029
max0.902-0.907=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-964.840=-1.296
σ0.025-0.035=-0.009
min963.523-964.810=-1.288
max963.585-964.897=-1.312
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.812-0.843=-0.030
σ0.044-0.019=0.025
min0.766-0.810=-0.043
max0.858-0.856=0.002
name=cdr_enhanced_4k_loc.art
mean884.853-885.512=-0.659
σ0.005-0.007=-0.002
min884.847-885.504=-0.657
max884.861-885.522=-0.662
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.726-0.667=0.059
σ0.027-0.043=-0.016
min0.679-0.625=0.054
max0.744-0.737=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.711-7.721=-0.011
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean4.249-4.263=-0.014
σ0.073-0.097=-0.024
min4.116-4.064=0.051
max4.550-4.670=-0.120
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean4.057-4.235=-0.179
σ0.312-0.065=0.247
min3.382-4.129=-0.746
max4.352-4.452=-0.100
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.748-0.737=0.011
σ0.026-0.020=0.006
min0.667-0.707=-0.040
max0.937-0.851=0.086
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.708-0.688=0.019
σ0.017-0.023=-0.006
min0.681-0.494=0.187
max0.819-0.757=0.062

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-296.873=-1.300
σ0.203-0.217=-0.013
min295.441-296.755=-1.313
max296.116-297.463=-1.347
mean1912.000-1902.000=10.000
σ0.000
min1912.000-1902.000=10.000
max1912.000-1902.000=10.000
mean0.588-0.565=0.023
σ0.028-0.052=-0.024
min0.518-0.502=0.015
max0.616-0.667=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-286.824=-1.580
σ0.040-0.042=-0.002
min285.193-286.771=-1.578
max285.286-286.870=-1.584
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.392-0.398=-0.005
σ0.011-0.006=0.005
min0.380-0.390=-0.010
max0.404-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.155-1297.221=-2.066
σ0.112-0.124=-0.011
min1295.074-1297.092=-2.018
max1295.342-1297.383=-2.042
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean1.973-1.904=0.068
σ0.219-0.082=0.137
min1.797-1.809=-0.012
max2.337-1.987=0.351
iters=5
new-facts=6402
prior-facts=1
mean1538.138-1541.315=-3.177
σ3.973-6.842=-2.870
min1536.239-1538.061=-1.823
max1545.242-1553.551=-8.309
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean2.334-2.244=0.090
σ0.276-0.203=0.073
min2.077-2.028=0.049
max2.761-2.508=0.252
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1859.113=-2.012
σ0.054-0.046=0.008
min1857.049-1859.069=-2.020
max1857.176-1859.173=-1.996
mean1749.000-1775.800=-26.800
σ176.634-125.308=51.325
min1499.000-1647.000=-148.000
max1912.000-1902.000=10.000
mean3.054-3.205=-0.150
σ0.274-0.407=-0.132
min2.863-2.776=0.088
max3.529-3.662=-0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.185=0.572
σ0.179-0.334=-0.155
min1.445-0.937=0.507
max1.906-1.734=0.172

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-448.822=-5.211
σ577.065-581.372=-4.307
min155.077-158.134=-3.057
max1309.208-1320.880=-11.672
mean96.250
σ8.500
min92.000
max109.000
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean0.539-0.566=-0.027
σ0.560-0.601=-0.041
min0.257-0.261=-0.004
max1.379-1.468=-0.089
policies=20
mean1551.052-1581.632=-30.579
σ0.342-0.364=-0.022
min1550.820-1581.387=-30.566
max1551.560-1582.172=-30.612
mean920.000
σ0.000
min920.000
max920.000
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean2.608-2.647=-0.039
σ0.040-0.007=0.033
min2.580-2.642=-0.062
max2.667-2.657=0.011
policies=200
mean15518.511-15824.149=-305.637
σ0.070-0.135=-0.065
min15518.449-15824.016=-305.567
max15518.606-15824.337=-305.731
mean9200.000
σ0.000
min9200.000
max9200.000
mean1453.000-1647.000=-194.000
σ0.000
min1453.000-1647.000=-194.000
max1453.000-1647.000=-194.000
mean26.174-26.640=-0.466
σ0.125-0.086=0.039
min26.042-26.542=-0.500
max26.287-26.745=-0.457