Compare commits

Home / Compare c1fc6e24 .. 8d2b06e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.014=0.040
σ0.369-0.367=0.001
min53.912-53.867=0.046
max55.103-55.059=0.044
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.129-0.131=-0.002
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.006=0.000
min43.387-43.315=0.073
max43.407-43.331=0.076
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.001
min0.115-0.114=0.001
max0.125-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1006.310=0.691
σ1.213-1.168=0.045
min1006.447-1005.766=0.682
max1012.093-1011.200=0.893
mean1049.700-1044.400=5.300
σ307.867-313.809=-5.942
min574.000-594.000=-20.000
max1641.000
mean1.552-1.562=-0.010
σ0.080-0.072=0.008
min1.404-1.479=-0.076
max1.781-1.769=0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.415-0.402=0.013
σ0.142-0.129=0.013
min0.332-0.319=0.013
max0.666-0.628=0.038
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.881-0.881=0.000
σ0.095-0.106=-0.011
min0.806-0.821=-0.015
max1.045-1.068=-0.023
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.532-0.547=-0.014
σ0.051-0.040=0.011
min0.480-0.511=-0.031
max0.611-0.613=-0.001
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.855-0.831=0.024
σ0.042-0.042=-0.000
min0.813-0.792=0.022
max0.921-0.898=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.115=0.721
σ0.030-0.035=-0.005
min964.809-964.086=0.724
max964.885-964.172=0.714
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.826-0.814=0.012
σ0.036-0.019=0.018
min0.787-0.791=-0.004
max0.869-0.838=0.031
name=cdr_enhanced_4k_loc.art
mean885.512-884.712=0.800
σ0.005-0.007=-0.002
min885.505-884.705=0.801
max885.517-884.722=0.796
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.740-0.709=0.031
σ0.011-0.041=-0.030
min0.732-0.655=0.077
max0.760-0.745=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.721-7.718=0.004
mean1641.000
σ0.000
min1641.000
max1641.000
mean4.210-4.206=0.004
σ0.081-0.094=-0.013
min4.083-4.066=0.017
max4.603-4.624=-0.021
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.667=0.000
mean1641.000
σ0.000
min1641.000
max1641.000
mean4.212-4.187=0.025
σ0.081-0.074=0.007
min4.073-4.038=0.035
max4.499-4.474=0.025
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.678-0.739=-0.060
σ0.088-0.018=0.070
min0.510-0.705=-0.195
max0.844-0.852=-0.008
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.498-0.698=-0.201
σ0.042-0.026=0.017
min0.283-0.511=-0.228
max0.652-0.782=-0.130

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.933-296.140=0.793
σ0.232-0.210=0.022
min296.722-295.956=0.765
max297.552-296.700=0.852
mean1938.000-1896.000=42.000
σ0.000
min1938.000-1896.000=42.000
max1938.000-1896.000=42.000
mean0.570-0.573=-0.003
σ0.052-0.051=0.001
min0.505-0.505=0.000
max0.683-0.687=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-284.702=2.122
σ0.037-0.028=0.009
min286.774-284.673=2.101
max286.861-284.737=2.124
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.394-0.395=-0.001
σ0.005-0.009=-0.004
min0.388-0.385=0.003
max0.401-0.407=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.265-1295.079=2.186
σ0.092-0.103=-0.011
min1297.131-1294.962=2.169
max1297.373-1295.202=2.171
mean1641.000
σ0.000
min1641.000
max1641.000
mean2.282-1.900=0.382
σ0.139-0.086=0.053
min2.133-1.801=0.332
max2.485-1.978=0.506
iters=5
new-facts=6402
prior-facts=1
mean1541.389-1539.223=2.166
σ6.841-6.875=-0.034
min1538.210-1535.964=2.246
max1553.626-1551.520=2.106
mean1641.000
σ0.000
min1641.000
max1641.000
mean2.308-2.152=0.156
σ0.234-0.139=0.095
min2.147-2.050=0.097
max2.704-2.395=0.309
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1856.982=2.135
σ0.064-0.061=0.004
min1859.040-1856.916=2.124
max1859.200-1857.062=2.138
mean1786.800-1766.800=20.000
σ147.955-123.777=24.178
min1641.000
max1938.000-1896.000=42.000
mean3.059-3.026=0.033
σ0.184-0.263=-0.079
min2.887-2.795=0.092
max3.355-3.456=-0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.304-1.208=0.096
σ0.358-0.227=0.132
min0.936-0.940=-0.004
max1.828-1.536=0.292

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.968-447.933=1.035
σ581.664-581.505=0.158
min158.134-157.178=0.956
max1321.463-1320.191=1.273
mean96.250
σ8.500
min92.000
max109.000
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.551-0.542=0.009
σ0.580-0.564=0.016
min0.257-0.258=-0.001
max1.421-1.388=0.033
policies=20
mean1581.630-1572.101=9.529
σ0.363-0.349=0.014
min1581.386-1571.865=9.521
max1582.170-1572.621=9.549
mean920.000
σ0.000
min920.000
max920.000
mean1641.000
σ0.000
min1641.000
max1641.000
mean2.642-2.628=0.014
σ0.012-0.016=-0.004
min2.627-2.610=0.016
max2.656-2.650=0.006
policies=200
mean15824.169-15729.077=95.093
σ0.115-0.095=0.020
min15824.081-15728.976=95.105
max15824.327-15729.197=95.130
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000
σ0.000
min1641.000
max1641.000
mean26.753-26.560=0.192
σ0.095-0.192=-0.097
min26.670-26.350=0.320
max26.880-26.815=0.065