Compare commits

Home / Compare fd7589a1 .. 7931e7f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.013=0.042
σ0.369-0.368=0.001
min53.914-53.872=0.041
max55.105-55.060=0.046
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.140-0.137=0.003
σ0.003-0.005=-0.002
min0.137-0.131=0.006
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.324=0.069
σ0.006-0.007=-0.001
min43.385-43.316=0.069
max43.403-43.338=0.065
mean418.000-420.000=-2.000
σ0.000
min418.000-420.000=-2.000
max418.000-420.000=-2.000
mean0.119-0.124=-0.005
σ0.003-0.004=-0.001
min0.115-0.121=-0.005
max0.121-0.130=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.311=0.693
σ1.198-1.170=0.028
min1006.445-1005.773=0.672
max1012.028-1011.209=0.820
mean1051.300-1049.400=1.900
σ307.917-313.462=-5.545
min576.000-600.000=-24.000
max1644.000-1643.000=1.000
mean1.534-1.591=-0.057
σ0.083-0.079=0.005
min1.395-1.515=-0.120
max1.777-1.820=-0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.424-0.412=0.012
σ0.150-0.129=0.020
min0.329-0.340=-0.011
max0.690-0.641=0.049
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.895-0.874=0.022
σ0.101-0.095=0.005
min0.833-0.808=0.025
max1.071-1.039=0.032
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.528-0.538=-0.010
σ0.052-0.053=-0.001
min0.487-0.498=-0.011
max0.617-0.630=-0.012
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.845-0.845=-0.000
σ0.039-0.032=0.006
min0.814-0.821=-0.007
max0.910-0.901=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.114=0.725
σ0.033-0.035=-0.002
min964.813-964.086=0.727
max964.894-964.172=0.723
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.820-0.838=-0.018
σ0.064-0.038=0.027
min0.708-0.771=-0.063
max0.860-0.860=-0.001
name=cdr_enhanced_4k_loc.art
mean885.512-884.711=0.801
σ0.007-0.007=-0.000
min885.505-884.703=0.802
max885.522-884.721=0.801
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.710-0.722=-0.012
σ0.044-0.033=0.011
min0.634-0.663=-0.030
max0.742-0.741=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.721-7.720=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean4.256-4.241=0.015
σ0.094-0.081=0.013
min4.096-4.116=-0.020
max4.728-4.583=0.145
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean4.238-4.255=-0.017
σ0.071-0.081=-0.010
min4.080-4.071=0.009
max4.420-4.516=-0.096
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.751-0.738=0.013
σ0.019-0.019=-0.000
min0.715-0.708=0.007
max0.837-0.856=-0.019
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.716-0.700=0.016
σ0.018-0.016=0.002
min0.680-0.672=0.007
max0.790-0.794=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.947-296.356=0.591
σ0.224-0.265=-0.041
min296.816-296.185=0.631
max297.561-297.086=0.475
mean1912.000-1908.000=4.000
σ0.000
min1912.000-1908.000=4.000
max1912.000-1908.000=4.000
mean0.588-0.569=0.018
σ0.028-0.054=-0.026
min0.539-0.506=0.033
max0.623-0.680=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-284.699=2.120
σ0.037-0.031=0.006
min286.775-284.670=2.105
max286.864-284.737=2.127
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.397-0.396=0.001
σ0.004-0.009=-0.005
min0.391-0.385=0.006
max0.402-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.234-1295.077=2.157
σ0.075-0.110=-0.034
min1297.142-1294.960=2.183
max1297.302-1295.214=2.088
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean2.053-1.901=0.152
σ0.042-0.090=-0.048
min2.006-1.805=0.201
max2.117-2.005=0.111
iters=5
new-facts=6402
prior-facts=1
mean1541.295-1539.187=2.107
σ6.843-6.840=0.002
min1538.049-1535.916=2.133
max1553.531-1551.420=2.110
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean2.138-2.263=-0.126
σ0.121-0.261=-0.140
min1.984-2.031=-0.047
max2.288-2.668=-0.380
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1856.984=2.128
σ0.086-0.055=0.031
min1858.991-1856.930=2.060
max1859.201-1857.059=2.142
mean1773.200-1775.400=-2.200
σ134.226-130.178=4.048
min1644.000-1643.000=1.000
max1912.000-1908.000=4.000
mean3.105-3.076=0.029
σ0.339-0.206=0.134
min2.738-2.850=-0.112
max3.602-3.366=0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.227-1.168=0.059
σ0.348-0.297=0.051
min0.934-0.918=0.015
max1.814-1.634=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-447.785=1.036
σ581.371-581.213=0.159
min158.135-157.176=0.958
max1320.879-1319.605=1.274
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean0.558-0.536=0.022
σ0.578-0.553=0.024
min0.268-0.258=0.010
max1.425-1.366=0.058
policies=20
mean1581.633-1572.091=9.542
σ0.365-0.347=0.017
min1581.388-1571.859=9.529
max1582.175-1572.608=9.567
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean2.650-2.628=0.022
σ0.036-0.006=0.030
min2.611-2.621=-0.010
max2.699-2.636=0.063
policies=200
mean15824.222-15729.037=95.185
σ0.049-0.115=-0.066
min15824.167-15728.962=95.205
max15824.284-15729.206=95.078
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1643.000=1.000
σ0.000
min1644.000-1643.000=1.000
max1644.000-1643.000=1.000
mean26.626-26.557=0.069
σ0.075-0.055=0.020
min26.549-26.505=0.044
max26.720-26.631=0.089