Compare commits

Home / Compare ab70d010 .. d7ad2c8d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.013=0.002
σ0.371-0.367=0.004
min53.867-53.874=-0.007
max55.071-55.057=0.014
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.141-0.137=0.004
σ0.008-0.003=0.005
min0.135-0.134=0.001
max0.162-0.144=0.018
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.007=0.000
min43.313-43.315=-0.002
max43.336-43.334=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.000
min0.118-0.115=0.004
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.305=0.004
σ1.177-1.194=-0.016
min1005.768-1005.770=-0.003
max1011.243-1011.304=-0.061
mean1048.600-1035.800=12.800
σ313.882-310.381=3.500
min597.000-545.000=52.000
max1646.000-1503.000=143.000
mean1.565-1.556=0.010
σ0.084-0.084=-0.000
min1.491-1.461=0.030
max1.814-1.772=0.042

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.410-0.411=-0.001
σ0.109-0.117=-0.008
min0.347-0.342=0.004
max0.604-0.617=-0.013
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.896-0.884=0.012
σ0.090-0.091=-0.000
min0.837-0.821=0.016
max1.054-1.041=0.013
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.546-0.539=0.007
σ0.058-0.056=0.002
min0.499-0.493=0.007
max0.646-0.635=0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.852-0.848=0.004
σ0.043-0.036=0.007
min0.815-0.816=-0.001
max0.923-0.908=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.102=0.013
σ0.021-0.034=-0.013
min964.094-964.077=0.017
max964.148-964.163=-0.014
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.853-0.823=0.030
σ0.005-0.026=-0.021
min0.847-0.789=0.059
max0.861-0.851=0.010
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.008-0.006=0.002
min884.703
max884.723-884.717=0.006
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.700-0.700=0.000
σ0.042-0.048=-0.006
min0.641-0.633=0.008
max0.737-0.745=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean4.191-3.679=0.513
σ0.088-0.323=-0.235
min4.063-3.361=0.703
max4.540-4.531=0.009
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean4.154-4.241=-0.087
σ0.066-0.094=-0.028
min4.038-4.091=-0.052
max4.400-4.521=-0.121
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.736-0.726=0.010
σ0.019-0.015=0.004
min0.699-0.697=0.002
max0.847-0.823=0.023
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.696-0.694=0.002
σ0.020-0.014=0.006
min0.579-0.667=-0.088
max0.759-0.777=-0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.235-296.267=-0.032
σ0.248-0.157=0.091
min296.094-296.116=-0.022
max296.934-296.657=0.277
mean1901.000-1955.000=-54.000
σ0.000
min1901.000-1955.000=-54.000
max1901.000-1955.000=-54.000
mean0.591-0.574=0.017
σ0.049-0.037=0.013
min0.513-0.525=-0.013
max0.706-0.646=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.694=0.003
σ0.040-0.045=-0.005
min284.644-284.630=0.014
max284.741-284.741=0.000
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.397-0.387=0.010
σ0.010-0.018=-0.008
min0.385-0.358=0.027
max0.404-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.107=-0.025
σ0.111-0.098=0.013
min1294.960-1294.997=-0.036
max1295.218-1295.244=-0.026
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean1.887-2.113=-0.226
σ0.091-0.088=0.004
min1.795-2.009=-0.214
max2.001-2.199=-0.198
iters=5
new-facts=6402
prior-facts=1
mean1539.178-1539.257=-0.079
σ6.852-6.794=0.058
min1535.937-1536.111=-0.174
max1551.433-1551.409=0.025
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean2.223-2.448=-0.225
σ0.237-0.172=0.064
min2.026-2.264=-0.238
max2.566-2.661=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean1856.978-1856.986=-0.008
σ0.063-0.065=-0.002
min1856.901-1856.912=-0.010
max1857.067-1857.062=0.005
mean1771.000-1758.000=13.000
σ127.399-203.463=-76.064
min1646.000-1503.000=143.000
max1901.000-1955.000=-54.000
mean3.022-2.967=0.056
σ0.273-0.169=0.104
min2.796-2.777=0.019
max3.484-3.205=0.279

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.150-1.653=-0.503
σ0.252-0.239=0.013
min0.938-1.267=-0.329
max1.537-1.876=-0.339

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.783=0.003
σ581.212-581.212=0.000
min157.178-157.176=0.002
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean0.547-0.557=-0.010
σ0.571-0.591=-0.020
min0.261-0.260=0.000
max1.403-1.444=-0.040
policies=20
mean1572.098-1572.081=0.018
σ0.344-0.355=-0.010
min1571.861-1571.834=0.027
max1572.610-1572.607=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean2.626-2.625=0.001
σ0.009-0.026=-0.016
min2.617-2.608=0.009
max2.635-2.663=-0.028
policies=200
mean15729.096-15729.019=0.078
σ0.092-0.164=-0.072
min15729.033-15728.867=0.166
max15729.233-15729.233=-0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1503.000=143.000
σ0.000
min1646.000-1503.000=143.000
max1646.000-1503.000=143.000
mean26.533-26.563=-0.029
σ0.072-0.075=-0.003
min26.450-26.475=-0.024
max26.624-26.634=-0.010