Compare commits

Home / Compare 1210a0c8 .. f5b6888a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.370-0.371=-0.002
min53.866-53.867=-0.001
max55.068-55.071=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.140-0.141=-0.002
σ0.005-0.008=-0.003
min0.135-0.135=-0.000
max0.146-0.162=-0.016
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=-0.000
σ0.006-0.007=-0.001
min43.312-43.313=-0.000
max43.335-43.336=-0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.000
min0.119-0.118=0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.302-1006.309=-0.008
σ1.141-1.177=-0.037
min1005.768-1005.768=-0.000
max1011.076-1011.243=-0.167
mean1041.350-1048.600=-7.250
σ313.986-313.882=0.104
min567.000-597.000=-30.000
max1635.000-1646.000=-11.000
mean1.557-1.565=-0.008
σ0.070-0.084=-0.014
min1.483-1.491=-0.008
max1.789-1.814=-0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.416-0.410=0.006
σ0.126-0.109=0.017
min0.322-0.347=-0.025
max0.637-0.604=0.034
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.889-0.896=-0.007
σ0.093-0.090=0.003
min0.823-0.837=-0.013
max1.053-1.054=-0.001
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.539-0.546=-0.007
σ0.048-0.058=-0.010
min0.499-0.499=-0.001
max0.621-0.646=-0.025
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.850-0.852=-0.002
σ0.031-0.043=-0.011
min0.818-0.815=0.003
max0.902-0.923=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.000
σ0.026-0.021=0.005
min964.095-964.094=0.000
max964.158-964.148=0.010
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.824-0.853=-0.029
σ0.029-0.005=0.024
min0.782-0.847=-0.066
max0.859-0.861=-0.003
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.001
σ0.008-0.008=0.000
min884.703
max884.723-884.723=0.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.721-0.700=0.021
σ0.031-0.042=-0.011
min0.667-0.641=0.026
max0.741-0.737=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean3.508-4.191=-0.684
σ0.064-0.088=-0.024
min3.355-4.063=-0.709
max3.721-4.540=-0.819
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean3.484-4.154=-0.670
σ0.066-0.066=-0.000
min3.357-4.038=-0.682
max3.692-4.400=-0.708
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.523-0.736=-0.213
σ0.022-0.019=0.003
min0.361-0.699=-0.338
max0.620-0.847=-0.226
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.495-0.696=-0.201
σ0.011-0.020=-0.009
min0.476-0.579=-0.103
max0.560-0.759=-0.199

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.273-296.235=0.037
σ0.174-0.248=-0.074
min296.075-296.094=-0.019
max296.653-296.934=-0.281
mean1903.000-1901.000=2.000
σ0.000
min1903.000-1901.000=2.000
max1903.000-1901.000=2.000
mean0.577-0.591=-0.014
σ0.050-0.049=0.001
min0.510-0.513=-0.002
max0.671-0.706=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-284.697=-0.007
σ0.034-0.040=-0.006
min284.642-284.644=-0.001
max284.721-284.741=-0.020
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.394-0.397=-0.002
σ0.010-0.010=-0.000
min0.385-0.385=-0.000
max0.407-0.404=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.081=-0.002
σ0.113-0.111=0.002
min1294.954-1294.960=-0.006
max1295.219-1295.218=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean1.937-1.887=0.050
σ0.123-0.091=0.031
min1.791-1.795=-0.004
max2.060-2.001=0.058
iters=5
new-facts=6402
prior-facts=1
mean1539.181-1539.178=0.003
σ6.838-6.852=-0.015
min1535.888-1535.937=-0.049
max1551.409-1551.433=-0.024
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.258-2.223=0.035
σ0.249-0.237=0.012
min2.021-2.026=-0.005
max2.646-2.566=0.079
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.978=0.006
σ0.055-0.063=-0.008
min1856.934-1856.901=0.033
max1857.063-1857.067=-0.004
mean1770.600-1771.000=-0.400
σ130.447-127.399=3.048
min1635.000-1646.000=-11.000
max1903.000-1901.000=2.000
mean3.054-3.022=0.032
σ0.230-0.273=-0.043
min2.876-2.796=0.080
max3.448-3.484=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.150=0.030
σ0.320-0.252=0.068
min0.931-0.938=-0.008
max1.698-1.537=0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.000
σ581.212-581.212=-0.000
min157.178-157.178=-0.000
max1319.605-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.549-0.547=0.002
σ0.573-0.571=0.002
min0.261-0.261=0.000
max1.408-1.403=0.004
policies=20
mean1572.106-1572.098=0.007
σ0.358-0.344=0.014
min1571.864-1571.861=0.003
max1572.639-1572.610=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.636-2.626=0.010
σ0.011-0.009=0.002
min2.625-2.617=0.008
max2.646-2.635=0.011
policies=200
mean15729.059-15729.096=-0.037
σ0.051-0.092=-0.041
min15729.002-15729.033=-0.031
max15729.123-15729.233=-0.110
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean26.526-26.533=-0.007
σ0.135-0.072=0.063
min26.367-26.450=-0.083
max26.693-26.624=0.069