Compare commits

Home / Compare 1df44324 .. d9898f9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.369-0.369=0.000
min53.911-53.911=0.001
max55.106-55.105=0.001
mean415.700-415.000=0.700
σ0.483-0.000=0.483
min415.000
max416.000-415.000=1.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.000
min0.134-0.136=-0.002
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.007=-0.001
min43.381-43.383=-0.002
max43.405-43.405=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.121=0.002
σ0.004-0.005=-0.001
min0.120-0.114=0.006
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.982=-0.006
σ0.933-0.856=0.077
min1006.504-1006.483=0.022
max1010.859-1010.517=0.342
mean1044.450-1043.150=1.300
σ304.153-314.018=-9.865
min580.000-574.000=6.000
max1598.000-1637.000=-39.000
mean1.580-1.528=0.052
σ0.141-0.093=0.048
min1.488-1.461=0.028
max2.098-1.794=0.304

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.419-0.406=0.013
σ0.139-0.112=0.027
min0.344-0.337=0.007
max0.666-0.606=0.060
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.342=-0.000
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.881-0.880=0.001
σ0.092-0.081=0.010
min0.819-0.821=-0.002
max1.038-1.022=0.015
name=heavy_item.art
mean1.524-1.523=0.000
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.528-0.536=-0.008
σ0.047-0.056=-0.009
min0.491-0.498=-0.007
max0.606-0.634=-0.028
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.852-0.848=0.003
σ0.041-0.043=-0.002
min0.821-0.814=0.007
max0.922-0.919=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.832=-0.000
σ0.040-0.028=0.011
min964.806-964.802=0.004
max964.901-964.873=0.028
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.807-0.832=-0.025
σ0.037-0.023=0.013
min0.772-0.808=-0.037
max0.859-0.861=-0.002
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.004
σ0.008-0.004=0.004
min885.504-885.508=-0.004
max885.523-885.519=0.004
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.709-0.704=0.005
σ0.041-0.035=0.006
min0.642-0.659=-0.017
max0.741-0.742=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.722=0.000
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean4.271-4.195=0.076
σ0.083-0.105=-0.022
min4.099-4.037=0.062
max4.591-4.808=-0.217
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean4.267-4.205=0.063
σ0.081-0.073=0.008
min4.134-4.054=0.080
max4.516-4.416=0.100
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.742-0.758=-0.015
σ0.018-0.019=-0.001
min0.712-0.696=0.015
max0.841-0.881=-0.040
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.663-0.713=-0.050
σ0.086-0.015=0.071
min0.489-0.684=-0.195
max0.841-0.799=0.042

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.526-295.512=0.014
σ0.279-0.244=0.035
min295.344-295.373=-0.029
max296.305-296.197=0.108
mean2005.000-2031.000=-26.000
σ0.000
min2005.000-2031.000=-26.000
max2005.000-2031.000=-26.000
mean0.532-0.562=-0.030
σ0.035-0.033=0.002
min0.497-0.513=-0.016
max0.587-0.603=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.412=-0.001
σ0.036-0.034=0.002
min285.359-285.369=-0.010
max285.445-285.448=-0.002
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.393-0.389=0.004
σ0.007-0.007=0.001
min0.385-0.383=0.003
max0.404-0.398=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.789-1295.792=-0.003
σ0.096-0.105=-0.010
min1295.671-1295.679=-0.007
max1295.887-1295.937=-0.050
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean1.863-1.884=-0.021
σ0.085-0.106=-0.022
min1.793-1.743=0.050
max1.968-1.997=-0.029
iters=5
new-facts=6402
prior-facts=1
mean1539.923-1539.917=0.005
σ6.881-6.894=-0.013
min1536.615-1536.596=0.019
max1552.227-1552.243=-0.017
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean2.233-2.255=-0.022
σ0.190-0.240=-0.050
min2.027-2.030=-0.002
max2.435-2.609=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean1857.735-1857.702=0.033
σ0.067-0.057=0.010
min1857.656-1857.648=0.008
max1857.801-1857.776=0.025
mean1735.600-1782.200=-46.600
σ175.657-170.873=4.783
min1598.000-1637.000=-39.000
max2005.000-2031.000=-26.000
mean2.866-3.024=-0.158
σ0.055-0.188=-0.134
min2.826-2.829=-0.003
max2.961-3.270=-0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.543-1.369=0.174
σ0.269-0.291=-0.022
min1.264-1.112=0.152
max1.841-1.868=-0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.935=-0.001
min155.272-155.270=0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean0.544-0.537=0.007
σ0.561-0.559=0.001
min0.262-0.253=0.009
max1.386-1.377=0.009
policies=20
mean1552.988-1552.986=0.002
σ0.323-0.320=0.003
min1552.767-1552.766=0.000
max1553.468-1553.462=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean2.580-2.579=0.001
σ0.017-0.025=-0.008
min2.567-2.549=0.018
max2.603-2.609=-0.006
policies=200
mean15537.945-15537.963=-0.018
σ0.148-0.167=-0.019
min15537.794-15537.840=-0.045
max15538.086-15538.207=-0.121
mean9200.000
σ0.000
min9200.000
max9200.000
mean1598.000-1637.000=-39.000
σ0.000
min1598.000-1637.000=-39.000
max1598.000-1637.000=-39.000
mean25.980-26.096=-0.115
σ0.081-0.114=-0.033
min25.898-25.981=-0.083
max26.085-26.253=-0.168