Compare commits

Home / Compare df8044a0 .. 87adedc7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.045=0.001
σ0.369-0.369=-0.001
min53.902-53.901=0.000
max55.094-55.095=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.138-0.138=-0.000
σ0.004-0.006=-0.002
min0.132-0.131=0.001
max0.143-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.382-43.383=-0.002
σ0.007-0.005=0.002
min43.370-43.375=-0.004
max43.393-43.390=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.124=-0.003
σ0.005-0.004=0.000
min0.113-0.120=-0.006
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.978=0.002
σ0.867-0.880=-0.013
min1006.506-1006.484=0.023
max1010.566-1010.628=-0.062
mean1045.550-1054.400=-8.850
σ314.582-315.195=-0.612
min576.000-574.000=2.000
max1643.000-1618.000=25.000
mean1.563-1.531=0.033
σ0.094-0.053=0.041
min1.495-1.424=0.071
max1.896-1.619=0.277

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.417-0.416=0.001
σ0.134-0.136=-0.002
min0.336-0.337=-0.001
max0.652-0.656=-0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.867-0.878=-0.011
σ0.089-0.093=-0.003
min0.803-0.806=-0.003
max1.022-1.039=-0.017
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.531-0.537=-0.006
σ0.049-0.042=0.007
min0.491-0.510=-0.019
max0.616-0.608=0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.833-0.841=-0.008
σ0.043-0.051=-0.008
min0.794-0.797=-0.004
max0.905-0.926=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.835=-0.002
σ0.027-0.034=-0.007
min964.812-964.802=0.010
max964.877-964.889=-0.012
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.829-0.825=0.004
σ0.022-0.016=0.006
min0.804-0.816=-0.012
max0.853-0.853=0.000
name=cdr_enhanced_4k_loc.art
mean885.511-885.513=-0.002
σ0.005-0.008=-0.003
min885.505-885.504=0.001
max885.515-885.522=-0.007
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.675-0.736=-0.061
σ0.054-0.006=0.048
min0.599-0.729=-0.129
max0.742-0.743=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean4.208-4.256=-0.048
σ0.096-0.138=-0.042
min4.064-4.082=-0.017
max4.560-5.206=-0.646
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean4.204-4.235=-0.031
σ0.074-0.085=-0.012
min4.049-4.062=-0.013
max4.520-4.496=0.024
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.741-0.734=0.008
σ0.016-0.019=-0.002
min0.710-0.701=0.009
max0.844-0.856=-0.012
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.703-0.700=0.003
σ0.019-0.019=0.000
min0.658-0.605=0.053
max0.805-0.773=0.032

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.712-295.555=0.157
σ0.213-0.254=-0.041
min295.519-295.308=0.211
max296.287-296.240=0.048
mean1909.000-1965.000=-56.000
σ0.000
min1909.000-1965.000=-56.000
max1909.000-1965.000=-56.000
mean0.577-0.537=0.040
σ0.049-0.031=0.019
min0.510-0.502=0.008
max0.680-0.579=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.408=0.005
σ0.036-0.037=-0.000
min285.373-285.357=0.016
max285.451-285.444=0.007
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.397-0.387=0.010
σ0.014-0.009=0.005
min0.381-0.380=0.001
max0.411-0.403=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.790-1295.794=-0.004
σ0.101-0.103=-0.002
min1295.670-1295.676=-0.005
max1295.899-1295.912=-0.013
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean1.938-1.903=0.036
σ0.144-0.090=0.055
min1.812-1.818=-0.006
max2.170-2.049=0.121
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.929=-0.005
σ6.890-6.883=0.007
min1536.613-1536.581=0.031
max1552.244-1552.236=0.008
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean2.309-2.274=0.035
σ0.275-0.247=0.028
min2.036-2.044=-0.008
max2.673-2.683=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.709=0.000
σ0.048-0.057=-0.009
min1857.660-1857.632=0.028
max1857.777-1857.774=0.003
mean1777.400-1765.200=12.200
σ130.571-140.484=-9.913
min1643.000-1618.000=25.000
max1909.000-1965.000=-56.000
mean3.114-2.941=0.172
σ0.370-0.086=0.285
min2.884-2.836=0.049
max3.772-3.070=0.702

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.440-1.344=0.096
σ0.206-0.257=-0.051
min1.263-1.102=0.162
max1.780-1.651=0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.002
σ580.934-580.934=0.001
min155.273-155.271=0.002
max1317.143-1317.139=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean0.544-0.534=0.010
σ0.560-0.555=0.004
min0.263-0.256=0.007
max1.383-1.367=0.016
policies=20
mean1552.987-1552.973=0.014
σ0.326-0.331=-0.005
min1552.764-1552.750=0.014
max1553.471-1553.465=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean2.589-2.588=0.001
σ0.007-0.027=-0.019
min2.581-2.558=0.022
max2.597-2.617=-0.021
policies=200
mean15538.051-15537.979=0.072
σ0.071-0.137=-0.067
min15537.986-15537.854=0.133
max15538.124-15538.119=0.005
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1618.000=25.000
σ0.000
min1643.000-1618.000=25.000
max1643.000-1618.000=25.000
mean26.186-26.192=-0.007
σ0.105-0.070=0.036
min26.109-26.133=-0.024
max26.340-26.283=0.058