Compare commits

Home / Compare 123852de .. 06dcc858

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.043=0.002
σ0.368-0.369=-0.001
min53.900-53.903=-0.003
max55.093-55.092=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.139=0.001
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.385-43.383=0.002
σ0.007-0.005=0.001
min43.376-43.372=0.003
max43.395-43.393=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.123=-0.001
σ0.004-0.004=0.000
min0.117-0.119=-0.002
max0.130-0.131=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.979=0.002
σ0.872-0.877=-0.005
min1006.484-1006.481=0.003
max1010.590-1010.618=-0.028
mean1045.600-1045.700=-0.100
σ314.243-306.022=8.221
min575.000-576.000=-1.000
max1643.000-1661.000=-18.000
mean1.544-1.554=-0.010
σ0.076-0.065=0.011
min1.485-1.483=0.003
max1.793-1.737=0.056

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.414-0.436=-0.022
σ0.133-0.123=0.010
min0.324-0.353=-0.029
max0.649-0.650=-0.000
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.880-0.877=0.003
σ0.086-0.091=-0.005
min0.813-0.822=-0.009
max1.028-1.038=-0.010
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.531-0.536=-0.005
σ0.050-0.056=-0.005
min0.489-0.494=-0.005
max0.611-0.627=-0.016
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.837-0.842=-0.005
σ0.039-0.036=0.004
min0.791-0.814=-0.023
max0.893-0.904=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.836=-0.005
σ0.025-0.030=-0.005
min964.802-964.810=-0.009
max964.863-964.888=-0.025
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.813-0.822=-0.009
σ0.061-0.044=0.017
min0.709-0.752=-0.043
max0.852-0.855=-0.003
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.006-0.005=0.000
min885.504
max885.519-885.518=0.001
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.684-0.722=-0.038
σ0.036-0.033=0.003
min0.638-0.665=-0.027
max0.734-0.743=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean4.200-4.212=-0.013
σ0.096-0.081=0.014
min3.777-4.060=-0.284
max4.512-4.515=-0.003
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean4.153-4.191=-0.037
σ0.070-0.075=-0.005
min4.037-4.034=0.003
max4.456-4.496=-0.040
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.737-0.742=-0.005
σ0.018-0.016=0.002
min0.711-0.712=-0.001
max0.856-0.832=0.024
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.699-0.702=-0.003
σ0.014-0.017=-0.003
min0.668-0.663=0.005
max0.766-0.771=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.617-295.494=0.123
σ0.215-0.226=-0.012
min295.420-295.262=0.158
max296.203-295.982=0.221
mean1913.000-1902.000=11.000
σ0.000
min1913.000-1902.000=11.000
max1913.000-1902.000=11.000
mean0.589-0.579=0.010
σ0.051-0.046=0.004
min0.510-0.513=-0.003
max0.703-0.685=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-285.412=-0.008
σ0.034-0.031=0.003
min285.358-285.373=-0.015
max285.442-285.446=-0.004
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.388-0.393=-0.004
σ0.010-0.011=-0.000
min0.383-0.384=-0.001
max0.407-0.405=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.806-1295.792=0.015
σ0.124-0.101=0.022
min1295.679-1295.680=-0.001
max1295.973-1295.897=0.076
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean1.905-1.916=-0.011
σ0.071-0.090=-0.019
min1.828-1.817=0.011
max1.974-2.004=-0.031
iters=5
new-facts=6402
prior-facts=1
mean1539.931-1539.949=-0.018
σ6.916-6.885=0.031
min1536.561-1536.595=-0.034
max1552.297-1552.259=0.038
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean2.402-2.401=0.001
σ0.344-0.193=0.151
min2.018-2.132=-0.114
max2.869-2.598=0.272
iters=5
new-facts=6402
prior-facts=6402
mean1857.703-1857.702=0.001
σ0.055-0.055=0.000
min1857.650-1857.653=-0.003
max1857.779-1857.778=0.001
mean1779.000-1775.200=3.800
σ130.499-121.321=9.178
min1643.000-1661.000=-18.000
max1913.000-1902.000=11.000
mean3.071-3.071=0.001
σ0.191-0.239=-0.048
min2.853-2.873=-0.020
max3.274-3.482=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.434-1.330=0.104
σ0.272-0.373=-0.102
min1.096-0.935=0.161
max1.803-1.860=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.272-155.272=-0.001
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean0.539-0.538=0.001
σ0.565-0.550=0.015
min0.254-0.258=-0.005
max1.386-1.362=0.023
policies=20
mean1552.985-1552.991=-0.006
σ0.327-0.332=-0.005
min1552.753-1552.768=-0.014
max1553.470-1553.484=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean2.582-2.598=-0.016
σ0.013-0.017=-0.005
min2.567-2.573=-0.006
max2.597-2.613=-0.016
policies=200
mean15538.064-15538.049=0.014
σ0.053-0.111=-0.058
min15538.028-15537.960=0.069
max15538.141-15538.212=-0.071
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1661.000=-18.000
σ0.000
min1643.000-1661.000=-18.000
max1643.000-1661.000=-18.000
mean26.306-26.292=0.013
σ0.150-0.043=0.107
min26.145-26.252=-0.107
max26.499-26.346=0.153