Compare commits

Home / Compare c71a215f .. b624f39a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.000
σ0.368-0.368=0.000
min53.913-53.918=-0.005
max55.103-55.102=0.001
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.140-0.140=0.000
σ0.004-0.005=-0.000
min0.134-0.133=0.001
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.007=-0.001
min43.382-43.387=-0.005
max43.404-43.408=-0.003
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.120-0.120=-0.000
σ0.004-0.003=0.001
min0.113-0.116=-0.003
max0.127-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.002=0.004
σ1.186-1.210=-0.024
min1006.437-1006.444=-0.007
max1011.970-1012.081=-0.111
mean1055.500-1052.900=2.600
σ307.787-308.059=-0.272
min581.000-578.000=3.000
max1647.000-1645.000=2.000
mean1.545-1.580=-0.035
σ0.080-0.120=-0.040
min1.458-1.482=-0.025
max1.777-1.907=-0.130

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.424-0.403=0.021
σ0.131-0.122=0.009
min0.347-0.325=0.022
max0.656-0.616=0.040
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.925-0.893=0.032
σ0.182-0.092=0.090
min0.812-0.810=0.002
max1.248-1.038=0.209
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.545-0.541=0.004
σ0.042-0.051=-0.009
min0.509-0.497=0.012
max0.616-0.627=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.851-0.843=0.008
σ0.037-0.045=-0.008
min0.810-0.808=0.001
max0.908-0.916=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.034-0.035=-0.001
min964.812-964.810=0.001
max964.896-964.897=-0.002
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.827-0.827=-0.000
σ0.038-0.032=0.006
min0.764-0.785=-0.022
max0.855-0.863=-0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.506-885.504=0.001
max885.524-885.522=0.002
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.725-0.712=0.013
σ0.026-0.033=-0.007
min0.682-0.675=0.006
max0.747-0.745=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean4.235-4.262=-0.027
σ0.085-0.089=-0.004
min4.090-4.097=-0.007
max4.715-4.700=0.015
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean4.231-4.220=0.011
σ0.075-0.073=0.002
min4.087-4.084=0.003
max4.503-4.531=-0.028
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.742-0.747=-0.004
σ0.019-0.021=-0.002
min0.712-0.715=-0.003
max0.851-0.866=-0.015
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.699-0.710=-0.011
σ0.014-0.017=-0.003
min0.670-0.675=-0.005
max0.765-0.815=-0.050

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.055-296.985=0.070
σ0.244-0.231=0.013
min296.883-296.807=0.077
max297.713-297.584=0.129
mean2036.000-1909.000=127.000
σ0.000
min2036.000-1909.000=127.000
max2036.000-1909.000=127.000
mean0.559-0.577=-0.018
σ0.035-0.035=-0.000
min0.513-0.505=0.008
max0.598-0.609=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.822=0.002
σ0.034-0.038=-0.004
min286.777-286.769=0.008
max286.860-286.865=-0.005
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.396-0.396=0.001
σ0.011-0.007=0.004
min0.386-0.388=-0.001
max0.411-0.402=0.009
iters=5
new-facts=1
prior-facts=6402
mean1297.222-1297.269=-0.047
σ0.058-0.084=-0.026
min1297.163-1297.155=0.008
max1297.288-1297.374=-0.087
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean2.030-2.261=-0.230
σ0.041-0.115=-0.074
min2.009-2.171=-0.163
max2.104-2.455=-0.351
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1541.368=-0.033
σ6.825-6.804=0.021
min1538.116-1538.212=-0.096
max1553.540-1553.537=0.002
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean2.276-2.310=-0.034
σ0.193-0.252=-0.059
min2.117-2.118=-0.001
max2.560-2.727=-0.167
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.111=0.006
σ0.078-0.066=0.012
min1859.003-1859.028=-0.025
max1859.194-1859.190=0.004
mean1790.800-1777.600=13.200
σ168.768-129.181=39.587
min1647.000-1645.000=2.000
max2036.000-1909.000=127.000
mean3.032-3.053=-0.021
σ0.056-0.241=-0.185
min2.982-2.806=0.176
max3.107-3.359=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.223=-0.036
σ0.289-0.323=-0.034
min0.933-0.942=-0.009
max1.658-1.754=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.001
σ581.372-581.372=0.000
min158.130-158.135=-0.005
max1320.880-1320.881=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean0.559-0.556=0.003
σ0.573-0.578=-0.005
min0.261-0.262=-0.002
max1.417-1.422=-0.005
policies=20
mean1581.626-1581.627=-0.002
σ0.353-0.366=-0.013
min1581.386-1581.388=-0.002
max1582.150-1582.173=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean2.631-2.651=-0.020
σ0.021-0.014=0.007
min2.603-2.636=-0.033
max2.650-2.669=-0.019
policies=200
mean15824.249-15824.162=0.087
σ0.104-0.100=0.004
min15824.164-15824.016=0.148
max15824.387-15824.244=0.143
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1645.000=2.000
σ0.000
min1647.000-1645.000=2.000
max1647.000-1645.000=2.000
mean26.707-26.712=-0.005
σ0.127-0.079=0.048
min26.610-26.629=-0.019
max26.894-26.800=0.095