Compare commits

Home / Compare 00c3c1d5 .. e802a2df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.056=-0.025
σ0.368-0.368=-0.001
min53.889-53.918=-0.030
max55.078-55.105=-0.026
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.140-0.146=-0.006
σ0.004-0.011=-0.008
min0.137-0.134=0.003
max0.146-0.168=-0.022
cache=y
dps=1
iters=10
policies=100
mean43.385-43.396=-0.012
σ0.006-0.009=-0.002
min43.374-43.387=-0.013
max43.394-43.410=-0.015
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.123-0.130=-0.007
σ0.004-0.011=-0.007
min0.119-0.116=0.003
max0.130-0.148=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.975=-0.648
σ0.903-0.943=-0.040
min1005.859-1006.508=-0.650
max1010.082-1010.905=-0.824
mean1054.400-1050.800=3.600
σ316.632-307.841=8.791
min563.000-575.000=-12.000
max1620.000-1643.000=-23.000
mean1.539-1.568=-0.028
σ0.075-0.156=-0.082
min1.478-1.460=0.018
max1.774-2.094=-0.320

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.414-0.414=-0.001
σ0.133-0.130=0.003
min0.339-0.337=0.003
max0.650-0.645=0.005
name=error_case.art
mean2.333-2.339=-0.006
σ0.003-0.003=0.000
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.872-0.886=-0.014
σ0.092-0.076=0.016
min0.803-0.845=-0.042
max1.031-1.020=0.010
name=heavy_item.art
mean1.521-1.523=-0.002
σ0.002-0.002=-0.000
min1.520-1.522=-0.002
max1.524-1.527=-0.003
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.533-0.538=-0.006
σ0.044-0.047=-0.003
min0.503-0.511=-0.008
max0.610-0.622=-0.012
name=nested_use.art
mean2.355-2.362=-0.007
σ0.002-0.002=-0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.829-0.844=-0.015
σ0.042-0.039=0.002
min0.802-0.813=-0.011
max0.900-0.913=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-964.830=-1.277
σ0.023-0.025=-0.002
min963.534-964.802=-1.267
max963.587-964.864=-1.276
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.850-0.814=0.036
σ0.013-0.029=-0.016
min0.827-0.771=0.057
max0.860-0.852=0.008
name=cdr_enhanced_4k_loc.art
mean884.854-885.514=-0.660
σ0.008-0.004=0.004
min884.848-885.508=-0.660
max884.867-885.518=-0.651
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.740-0.719=0.021
σ0.004-0.041=-0.036
min0.733-0.649=0.083
max0.744-0.752=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.709-7.719=-0.010
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean4.329-3.512=0.817
σ0.084-0.099=-0.014
min4.151-3.401=0.750
max4.652-4.129=0.523
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean4.299-4.157=0.143
σ0.084-0.244=-0.159
min4.146-3.453=0.693
max4.593-4.580=0.013
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.745-0.743=0.002
σ0.019-0.027=-0.008
min0.710-0.544=0.166
max0.882-0.852=0.030
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.707-0.707=-0.000
σ0.015-0.018=-0.003
min0.678-0.677=0.001
max0.787-0.801=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.583-295.456=0.127
σ0.204-0.232=-0.029
min295.412-295.275=0.137
max296.138-296.068=0.070
mean1944.000-1907.000=37.000
σ0.000
min1944.000-1907.000=37.000
max1944.000-1907.000=37.000
mean0.589-0.582=0.007
σ0.047-0.033=0.014
min0.508-0.531=-0.023
max0.673-0.613=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.253-285.411=-0.158
σ0.042-0.037=0.005
min285.200-285.356=-0.156
max285.301-285.445=-0.144
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.401-0.399=0.002
σ0.011-0.009=0.001
min0.388-0.391=-0.003
max0.410-0.411=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.794=-0.596
σ0.111-0.106=0.005
min1295.078-1295.668=-0.590
max1295.344-1295.924=-0.580
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean1.936-1.885=0.051
σ0.119-0.070=0.049
min1.803-1.816=-0.013
max2.058-1.978=0.080
iters=5
new-facts=6402
prior-facts=1
mean1538.159-1539.941=-1.781
σ4.019-6.907=-2.888
min1536.176-1536.623=-0.447
max1545.343-1552.291=-6.948
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean2.469-2.366=0.103
σ0.340-0.300=0.040
min2.012-2.067=-0.056
max2.871-2.678=0.192
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1857.707=-0.606
σ0.059-0.052=0.007
min1857.045-1857.654=-0.609
max1857.177-1857.777=-0.601
mean1778.000-1776.000=2.000
σ162.247-130.050=32.197
min1620.000-1643.000=-23.000
max1944.000-1907.000=37.000
mean2.958-3.021=-0.063
σ0.156-0.212=-0.056
min2.855-2.832=0.023
max3.229-3.365=-0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.434-1.362=0.072
σ0.285-0.278=0.007
min1.125-1.114=0.012
max1.877-1.840=0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-445.739=-2.129
σ577.065-580.933=-3.868
min155.077-155.272=-0.195
max1309.208-1317.139=-7.931
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.557-0.552=0.004
σ0.592-0.582=0.011
min0.259-0.260=-0.001
max1.445-1.425=0.020
policies=20
mean1551.040-1552.988=-1.948
σ0.316-0.324=-0.008
min1550.822-1552.767=-1.944
max1551.508-1553.469=-1.960
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean2.573-2.583=-0.009
σ0.008-0.016=-0.009
min2.564-2.571=-0.007
max2.582-2.607=-0.025
policies=200
mean15518.326-15537.963=-19.637
σ0.419-0.167=0.252
min15517.741-15537.833=-20.092
max15518.738-15538.203=-19.466
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean26.151-26.113=0.038
σ0.068-0.049=0.018
min26.093-26.064=0.029
max26.249-26.176=0.073