Compare commits

Home / Compare 8735e4ad .. 97e15224

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.002
σ0.367-0.370=-0.002
min53.913-53.918=-0.006
max55.100-55.109=-0.009
mean419.000
σ0.000
min419.000
max419.000
mean0.141-0.140=0.001
σ0.004-0.005=-0.001
min0.137-0.136=0.001
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.005-0.007=-0.002
min43.387-43.386=0.001
max43.403-43.410=-0.007
mean419.000
σ0.000
min419.000
max419.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.119-0.114=0.005
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.007=-0.002
σ1.187-1.196=-0.009
min1006.433-1006.434=-0.001
max1011.981-1012.019=-0.038
mean1055.100-1053.300=1.800
σ307.803-306.452=1.351
min580.000-578.000=2.000
max1647.000-1651.000=-4.000
mean1.531-1.554=-0.023
σ0.085-0.084=0.001
min1.393-1.473=-0.081
max1.786-1.750=0.036

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.412-0.412=-0.000
σ0.129-0.134=-0.006
min0.339-0.338=0.001
max0.640-0.651=-0.011
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.893-0.878=0.015
σ0.091-0.095=-0.003
min0.835-0.812=0.023
max1.052-1.043=0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.533-0.540=-0.008
σ0.048-0.041=0.007
min0.496-0.510=-0.014
max0.612-0.609=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.842-0.849=-0.006
σ0.035-0.042=-0.007
min0.823-0.814=0.009
max0.904-0.917=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.034-0.034=-0.000
min964.811-964.811=0.001
max964.895-964.895=0.000
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.824-0.832=-0.008
σ0.029-0.027=0.002
min0.779-0.799=-0.019
max0.853-0.860=-0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.007=-0.003
min885.504
max885.516-885.522=-0.006
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.714-0.721=-0.007
σ0.037-0.031=0.006
min0.653-0.682=-0.028
max0.741-0.750=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean3.480-4.215=-0.735
σ0.089-0.135=-0.046
min3.336-4.062=-0.726
max3.791-5.092=-1.301
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean3.480-4.185=-0.706
σ0.069-0.072=-0.002
min3.370-4.065=-0.695
max3.734-4.468=-0.735
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.735-0.744=-0.009
σ0.019-0.017=0.002
min0.652-0.709=-0.057
max0.841-0.845=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.693-0.697=-0.004
σ0.015-0.056=-0.041
min0.661-0.501=0.160
max0.778-0.769=0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.079-296.906=0.173
σ0.228-0.270=-0.041
min296.918-296.703=0.215
max297.713-297.636=0.077
mean2035.000-1924.000=111.000
σ0.000
min2035.000-1924.000=111.000
max2035.000-1924.000=111.000
mean0.556-0.591=-0.035
σ0.034-0.038=-0.004
min0.504-0.524=-0.020
max0.602-0.645=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.828=-0.002
σ0.038-0.028=0.009
min286.773-286.793=-0.020
max286.864-286.858=0.006
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.397-0.396=0.001
σ0.008-0.009=-0.001
min0.389-0.388=0.000
max0.407-0.410=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.267-1297.208=0.058
σ0.063-0.106=-0.042
min1297.192-1297.087=0.105
max1297.352-1297.331=0.021
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean2.091-1.939=0.151
σ0.073-0.114=-0.041
min2.020-1.808=0.212
max2.191-2.061=0.131
iters=5
new-facts=6402
prior-facts=1
mean1541.312-1541.401=-0.089
σ6.841-6.794=0.047
min1538.067-1538.132=-0.065
max1553.545-1553.549=-0.004
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean2.190-2.459=-0.269
σ0.105-0.244=-0.139
min2.098-2.060=0.039
max2.353-2.682=-0.329
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.120=-0.007
σ0.074-0.058=0.016
min1858.996-1859.069=-0.073
max1859.181-1859.199=-0.018
mean1784.200-1780.800=3.400
σ168.307-137.320=30.987
min1647.000-1651.000=-4.000
max2035.000-1924.000=111.000
mean2.949-2.969=-0.020
σ0.073-0.105=-0.032
min2.846-2.853=-0.007
max3.041-3.121=-0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.269-1.237=0.033
σ0.295-0.317=-0.022
min1.064-0.943=0.121
max1.778-1.762=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.000
σ581.372-581.372=0.000
min158.134-158.134=-0.000
max1320.879-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean0.558-0.544=0.014
σ0.585-0.559=0.026
min0.263-0.263=0.000
max1.436-1.383=0.053
policies=20
mean1581.628-1581.628=-0.000
σ0.357-0.354=0.003
min1581.388-1581.389=-0.001
max1582.160-1582.155=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean2.640-2.634=0.006
σ0.011-0.015=-0.003
min2.629-2.614=0.016
max2.655-2.647=0.008
policies=200
mean15824.146-15824.191=-0.045
σ0.188-0.063=0.125
min15823.991-15824.117=-0.126
max15824.420-15824.254=0.166
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1651.000=-4.000
σ0.000
min1647.000-1651.000=-4.000
max1647.000-1651.000=-4.000
mean26.608-26.611=-0.003
σ0.052-0.077=-0.024
min26.534-26.509=0.025
max26.654-26.689=-0.036