Compare commits

Home / Compare bf362964 .. b6f8453e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.371-0.369=0.002
min53.872-53.876=-0.004
max55.070-55.065=0.004
mean415.000-416.900=-1.900
σ0.000-0.316=-0.316
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.000
min0.131-0.133=-0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.324-43.322=0.002
σ0.007-0.006=0.001
min43.309-43.314=-0.004
max43.333-43.337=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.123-0.120=0.003
σ0.010-0.003=0.007
min0.114-0.115=-0.001
max0.141-0.124=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.309=-0.002
σ1.185-1.162=0.023
min1005.768-1005.741=0.027
max1011.269-1011.177=0.092
mean1045.000-1044.400=0.600
σ311.721-312.550=-0.830
min597.000-577.000=20.000
max1634.000
mean1.549-1.564=-0.014
σ0.086-0.094=-0.008
min1.469-1.473=-0.003
max1.762-1.833=-0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.429-0.408=0.021
σ0.150-0.136=0.014
min0.329-0.327=0.002
max0.688-0.649=0.039
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.910-0.890=0.020
σ0.166-0.088=0.078
min0.822-0.838=-0.016
max1.204-1.047=0.157
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.544-0.544=0.000
σ0.060-0.054=0.006
min0.496-0.512=-0.016
max0.648-0.639=0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.844-0.850=-0.006
σ0.039-0.039=-0.000
min0.815-0.825=-0.010
max0.909-0.919=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111-964.115=-0.004
σ0.023-0.035=-0.012
min964.090-964.086=0.004
max964.146-964.173=-0.027
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.817-0.832=-0.015
σ0.041-0.043=-0.002
min0.750-0.765=-0.015
max0.859-0.867=-0.008
name=cdr_enhanced_4k_loc.art
mean884.714-884.711=0.002
σ0.002-0.008=-0.006
min884.712-884.703=0.009
max884.717-884.723=-0.006
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.725-0.683=0.042
σ0.029-0.073=-0.044
min0.680-0.595=0.085
max0.745-0.742=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1634.000
σ0.000
min1634.000
max1634.000
mean4.301-4.261=0.040
σ0.096-0.102=-0.007
min4.160-4.103=0.057
max4.937-4.732=0.205
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1634.000
σ0.000
min1634.000
max1634.000
mean4.280-4.211=0.070
σ0.119-0.086=0.033
min3.586-4.065=-0.479
max4.531-4.467=0.064
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.735-0.742=-0.007
σ0.017-0.020=-0.003
min0.705-0.719=-0.014
max0.840-0.895=-0.055
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.699-0.705=-0.006
σ0.014-0.016=-0.001
min0.669-0.671=-0.002
max0.781-0.791=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.382-296.324=0.058
σ0.224-0.165=0.060
min296.228-296.191=0.037
max297.006-296.751=0.254
mean1902.000-1899.000=3.000
σ0.000
min1902.000-1899.000=3.000
max1902.000-1899.000=3.000
mean0.576-0.603=-0.026
σ0.044-0.016=0.028
min0.513-0.574=-0.060
max0.657-0.635=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.694=0.002
σ0.040-0.038=0.002
min284.644-284.640=0.003
max284.742-284.732=0.011
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.407-0.398=0.009
σ0.003-0.009=-0.006
min0.404-0.389=0.015
max0.411-0.407=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.071=0.007
σ0.111-0.107=0.004
min1294.958-1294.946=0.013
max1295.220-1295.213=0.007
mean1634.000
σ0.000
min1634.000
max1634.000
mean1.918-2.008=-0.090
σ0.108-0.122=-0.014
min1.799-1.833=-0.034
max2.015-2.168=-0.153
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.206=-0.016
σ6.859-6.839=0.020
min1535.926-1535.958=-0.032
max1551.456-1551.437=0.019
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.257-2.155=0.102
σ0.275-0.139=0.137
min2.034-2.043=-0.009
max2.686-2.391=0.295
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.980=0.003
σ0.056-0.052=0.004
min1856.928-1856.936=-0.009
max1857.065-1857.058=0.006
mean1771.000-1779.600=-8.600
σ130.832-125.532=5.300
min1634.000
max1902.000-1899.000=3.000
mean3.051-2.987=0.065
σ0.244-0.099=0.146
min2.866-2.832=0.034
max3.469-3.107=0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.224=-0.101
σ0.214-0.212=0.002
min0.936-0.954=-0.018
max1.421-1.511=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.786=0.001
σ581.212-581.213=-0.000
min157.179-157.179=0.000
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.547-0.543=0.004
σ0.571-0.566=0.005
min0.259-0.254=0.005
max1.404-1.393=0.011
policies=20
mean1572.103-1572.103=-0.000
σ0.354-0.355=-0.001
min1571.863-1571.863=0.000
max1572.629-1572.630=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.630-2.631=-0.001
σ0.009-0.009=0.000
min2.624-2.622=0.001
max2.644-2.639=0.005
policies=200
mean15729.098-15729.033=0.064
σ0.109-0.047=0.062
min15729.028-15728.976=0.052
max15729.259-15729.077=0.183
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean26.472-26.501=-0.029
σ0.016-0.032=-0.016
min26.448-26.459=-0.011
max26.481-26.535=-0.054