Compare commits

Home / Compare 68f2014c .. 94e37810

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.014=-0.001
σ0.369-0.368=0.001
min53.865-53.877=-0.011
max55.062-55.062=0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.139=-0.001
σ0.006-0.004=0.002
min0.129-0.135=-0.006
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.006-0.007=-0.001
min43.316-43.317=-0.001
max43.333-43.339=-0.006
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.120-0.121=-0.001
σ0.005-0.004=0.001
min0.110-0.115=-0.005
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.306=0.000
σ1.168-1.171=-0.002
min1005.774-1005.741=0.033
max1011.188-1011.207=-0.020
mean1054.350-1053.250=1.100
σ319.373-304.168=15.204
min597.000-600.000=-3.000
max1621.000-1643.000=-22.000
mean1.573-1.551=0.022
σ0.134-0.074=0.060
min1.483-1.433=0.049
max2.059-1.762=0.297

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.413-0.420=-0.007
σ0.140-0.144=-0.003
min0.330-0.335=-0.005
max0.662-0.674=-0.011
name=error_case.art
mean2.339-2.337=0.002
σ0.003-0.003=0.000
min2.336
max2.343-2.341=0.002
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.884-0.885=-0.001
σ0.104-0.119=-0.014
min0.821-0.807=0.014
max1.067-1.090=-0.024
name=heavy_item.art
mean1.523-1.523=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.543-0.536=0.007
σ0.052-0.043=0.009
min0.500-0.495=0.005
max0.622-0.606=0.016
name=nested_use.art
mean2.360-2.360=0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.854-0.830=0.023
σ0.049-0.034=0.015
min0.814-0.781=0.033
max0.935-0.874=0.060

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112-964.114=-0.002
σ0.031-0.035=-0.003
min964.086-964.087=-0.001
max964.165-964.171=-0.007
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.847-0.801=0.046
σ0.024-0.058=-0.034
min0.805-0.723=0.082
max0.866-0.865=0.000
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.001
σ0.005-0.007=-0.002
min884.703
max884.717-884.721=-0.005
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.684-0.736=-0.052
σ0.037-0.007=0.031
min0.638-0.728=-0.090
max0.723-0.746=-0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.720-7.719=0.001
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean4.259-4.256=0.002
σ0.099-0.084=0.015
min4.077-4.120=-0.043
max4.569-4.497=0.072
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean3.600-4.245=-0.645
σ0.225-0.095=0.129
min3.360-4.101=-0.740
max4.485-4.571=-0.086
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.732-0.737=-0.005
σ0.026-0.031=-0.004
min0.538-0.646=-0.107
max0.836-0.923=-0.086
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.701-0.695=0.005
σ0.018-0.017=0.001
min0.665-0.668=-0.003
max0.777-0.782=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.251-296.412=-0.162
σ0.241-0.208=0.033
min296.091-296.248=-0.158
max296.918-296.965=-0.047
mean1899.000-1913.000=-14.000
σ0.000
min1899.000-1913.000=-14.000
max1899.000-1913.000=-14.000
mean0.575-0.569=0.007
σ0.038-0.055=-0.017
min0.529-0.511=0.018
max0.655-0.685=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.691-284.698=-0.006
σ0.041-0.038=0.003
min284.636-284.652=-0.016
max284.738-284.745=-0.006
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.397-0.396=0.001
σ0.011-0.016=-0.005
min0.385-0.373=0.012
max0.407-0.409=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1295.075=-0.004
σ0.105-0.106=-0.001
min1294.951-1294.963=-0.012
max1295.202-1295.201=0.000
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean1.892-1.912=-0.020
σ0.111-0.113=-0.002
min1.719-1.793=-0.074
max1.998-2.071=-0.073
iters=5
new-facts=6402
prior-facts=1
mean1539.201-1539.182=0.019
σ6.832-6.850=-0.019
min1535.953-1535.925=0.028
max1551.419-1551.433=-0.014
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean2.158-2.256=-0.097
σ0.133-0.237=-0.104
min2.022-2.032=-0.010
max2.369-2.602=-0.233
iters=5
new-facts=6402
prior-facts=6402
mean1856.966-1856.990=-0.024
σ0.077-0.056=0.021
min1856.884-1856.931=-0.046
max1857.073-1857.073=0.000
mean1777.600-1780.400=-2.800
σ128.995-132.075=-3.080
min1621.000-1643.000=-22.000
max1899.000-1913.000=-14.000
mean3.013-3.017=-0.004
σ0.227-0.179=0.047
min2.859-2.876=-0.017
max3.407-3.309=0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.304-1.241=0.063
σ0.314-0.247=0.068
min0.932-1.063=-0.131
max1.675-1.664=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.785=0.000
σ581.212-581.212=-0.000
min157.178-157.176=0.002
max1319.604-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean0.534-0.531=0.003
σ0.540-0.532=0.008
min0.261-0.263=-0.001
max1.344-1.329=0.015
policies=20
mean1572.093-1572.101=-0.008
σ0.355-0.352=0.003
min1571.854-1571.863=-0.009
max1572.620-1572.624=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean2.636-2.622=0.014
σ0.014-0.019=-0.005
min2.616-2.597=0.020
max2.647-2.637=0.009
policies=200
mean15728.884-15729.062=-0.178
σ0.123-0.110=0.013
min15728.774-15728.932=-0.159
max15729.018-15729.198=-0.180
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1643.000=-22.000
σ0.000
min1621.000-1643.000=-22.000
max1621.000-1643.000=-22.000
mean26.509-26.488=0.020
σ0.040-0.051=-0.011
min26.479-26.412=0.067
max26.565-26.522=0.043