Compare commits

Home / Compare 3e94648a .. 5e67edf1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.369-0.370=-0.001
min53.911-53.904=0.007
max55.103-55.106=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.137-0.138=-0.001
σ0.006-0.005=0.001
min0.132-0.132=0.000
max0.151-0.149=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.007=-0.001
min43.382-43.384=-0.002
max43.404-43.407=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.122-0.123=-0.000
σ0.004-0.004=-0.000
min0.119-0.118=0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.001
σ1.191-1.185=0.006
min1006.430-1006.433=-0.003
max1011.998-1011.971=0.028
mean1045.950-1043.700=2.250
σ316.414-305.592=10.822
min588.000-589.000=-1.000
max1647.000-1630.000=17.000
mean1.528-1.549=-0.021
σ0.067-0.096=-0.029
min1.402-1.454=-0.052
max1.695-1.797=-0.102

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.419-0.417=0.002
σ0.143-0.128=0.015
min0.326-0.350=-0.024
max0.672-0.645=0.027
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.882-0.884=-0.002
σ0.097-0.093=0.003
min0.813-0.822=-0.009
max1.052-1.048=0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.543-0.561=-0.018
σ0.049-0.066=-0.017
min0.496-0.495=0.001
max0.624-0.640=-0.017
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364-2.364=0.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.853-0.852=0.001
σ0.043-0.045=-0.002
min0.825-0.814=0.011
max0.929-0.926=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.019-0.033=-0.014
min964.824-964.812=0.011
max964.870-964.894=-0.024
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.848-0.823=0.025
σ0.018-0.033=-0.015
min0.816-0.783=0.033
max0.863-0.855=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.000
min885.506-885.504=0.001
max885.523-885.522=0.001
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.738-0.733=0.006
σ0.004-0.010=-0.006
min0.733-0.718=0.014
max0.744-0.743=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.721=0.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean4.263-4.182=0.081
σ0.088-0.068=0.020
min4.112-4.063=0.049
max4.604-4.409=0.195
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean4.223-4.178=0.044
σ0.088-0.123=-0.035
min4.076-3.296=0.781
max4.543-4.552=-0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.751-0.751=0.000
σ0.022-0.028=-0.006
min0.632-0.711=-0.079
max0.867-0.935=-0.068
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.717-0.710=0.007
σ0.017-0.028=-0.011
min0.671-0.507=0.165
max0.788-0.800=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.888-296.744=0.144
σ0.196-0.206=-0.010
min296.758-296.614=0.144
max297.414-297.317=0.097
mean1952.000-1956.000=-4.000
σ0.000
min1952.000-1956.000=-4.000
max1952.000-1956.000=-4.000
mean0.541-0.582=-0.041
σ0.027-0.038=-0.011
min0.504-0.510=-0.007
max0.578-0.636=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.829-286.819=0.010
σ0.028-0.036=-0.009
min286.798-286.769=0.029
max286.861-286.855=0.007
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.396-0.395=0.001
σ0.007-0.006=0.001
min0.388-0.388=0.000
max0.404-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.239-1297.253=-0.013
σ0.077-0.079=-0.002
min1297.153-1297.166=-0.013
max1297.335-1297.343=-0.009
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.120-2.102=0.018
σ0.063-0.077=-0.014
min2.024-2.004=0.020
max2.177-2.195=-0.018
iters=5
new-facts=6402
prior-facts=1
mean1541.341-1541.306=0.035
σ6.825-6.832=-0.007
min1538.089-1538.072=0.016
max1553.546-1553.523=0.024
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.322-2.162=0.160
σ0.141-0.071=0.070
min2.153-2.062=0.091
max2.489-2.248=0.241
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.111=0.003
σ0.070-0.081=-0.012
min1859.003-1858.989=0.014
max1859.181-1859.185=-0.004
mean1778.800-1789.400=-10.600
σ114.362-163.199=-48.837
min1647.000-1630.000=17.000
max1952.000-1956.000=-4.000
mean2.978-2.996=-0.018
σ0.160-0.113=0.047
min2.864-2.858=0.006
max3.251-3.150=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.159-1.251=-0.092
σ0.313-0.309=0.005
min0.922-1.060=-0.137
max1.669-1.785=-0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.000
σ581.372-581.372=-0.000
min158.133-158.133=0.000
max1320.879-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.567-0.556=0.011
σ0.595-0.584=0.012
min0.265-0.261=0.004
max1.460-1.432=0.028
policies=20
mean1581.589-1581.615=-0.026
σ0.298-0.355=-0.057
min1581.378-1581.374=0.004
max1582.030-1582.143=-0.113
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.635-2.635=0.000
σ0.012-0.014=-0.002
min2.618-2.621=-0.003
max2.645-2.653=-0.008
policies=200
mean15824.158-15824.040=0.118
σ0.106-0.174=-0.068
min15824.012-15823.871=0.142
max15824.260-15824.283=-0.024
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean26.592-26.609=-0.017
σ0.052-0.057=-0.005
min26.552-26.554=-0.002
max26.666-26.658=0.008