Compare commits

Home / Compare 968ad740 .. c54704bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.706=-0.001
σ0.369-0.367=0.001
min53.562-53.565=-0.003
max54.753-54.751=0.002
mean414.000-416.700=-2.700
σ0.000-0.483=-0.483
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.140-0.140=0.001
σ0.004-0.003=0.001
min0.134-0.136=-0.002
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.057-43.059=-0.002
σ0.007-0.006=0.000
min43.046-43.048=-0.002
max43.068-43.067=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.118-0.123=-0.005
σ0.004-0.004=0.000
min0.113-0.118=-0.005
max0.125-0.129=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.105=0.001
σ0.882-0.888=-0.006
min1004.630-1004.637=-0.007
max1008.758-1008.782=-0.024
mean1047.450-1055.100=-7.650
σ298.391-321.597=-23.206
min573.000-553.000=20.000
max1472.000-1632.000=-160.000
mean1.615-1.628=-0.014
σ0.057-0.090=-0.033
min1.553-1.556=-0.003
max1.736-1.879=-0.143

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.419-0.418=0.001
σ0.132-0.135=-0.004
min0.341-0.335=0.007
max0.653-0.658=-0.005
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.888-0.878=0.011
σ0.090-0.086=0.004
min0.816-0.830=-0.014
max1.045-1.031=0.014
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.534-0.542=-0.008
σ0.049-0.057=-0.007
min0.499-0.485=0.014
max0.615-0.636=-0.021
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.841-0.840=0.001
σ0.034-0.039=-0.006
min0.802-0.808=-0.007
max0.894-0.904=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-963.554=-0.011
σ0.024-0.026=-0.002
min963.523-963.535=-0.012
max963.581-963.599=-0.018
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.800-0.827=-0.026
σ0.047-0.039=0.007
min0.746-0.773=-0.027
max0.851-0.860=-0.009
name=cdr_enhanced_4k_loc.art
mean884.853-884.853=-0.000
σ0.007-0.008=-0.001
min884.847
max884.863-884.866=-0.004
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.723-0.713=0.011
σ0.051-0.065=-0.015
min0.633-0.596=0.037
max0.749-0.746=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.712=-0.003
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean4.295-4.266=0.029
σ0.135-0.067=0.068
min4.128-4.148=-0.020
max5.402-4.538=0.863
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean4.279-4.265=0.014
σ0.068-0.069=-0.001
min4.128-4.144=-0.017
max4.452-4.636=-0.183
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.745-0.745=-0.000
σ0.019-0.016=0.002
min0.722-0.717=0.004
max0.865-0.863=0.002
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.704-0.703=0.001
σ0.013-0.016=-0.002
min0.674-0.678=-0.003
max0.764-0.803=-0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.393-294.342=0.050
σ0.236-0.279=-0.043
min294.189-294.065=0.125
max295.035-295.075=-0.040
mean1908.000-1974.000=-66.000
σ0.000
min1908.000-1974.000=-66.000
max1908.000-1974.000=-66.000
mean0.565-0.570=-0.004
σ0.039-0.067=-0.028
min0.502-0.495=0.008
max0.624-0.717=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.496-281.493=0.003
σ0.039-0.036=0.002
min281.448-281.453=-0.005
max281.536-281.529=0.006
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.393-0.379=0.014
σ0.008-0.001=0.007
min0.384-0.378=0.006
max0.403-0.380=0.023
iters=5
new-facts=1
prior-facts=6402
mean1291.485-1291.479=0.006
σ0.111-0.117=-0.005
min1291.364-1291.352=0.013
max1291.618-1291.646=-0.028
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean1.901-1.928=-0.027
σ0.070-0.109=-0.038
min1.835-1.788=0.047
max2.004-2.046=-0.042
iters=5
new-facts=6402
prior-facts=1
mean1534.341-1534.344=-0.003
σ3.993-4.031=-0.038
min1532.309-1532.322=-0.013
max1541.473-1541.543=-0.070
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean2.290-2.349=-0.059
σ0.164-0.263=-0.099
min2.028-2.093=-0.065
max2.453-2.705=-0.252
iters=5
new-facts=6402
prior-facts=6402
mean1853.356-1853.374=-0.018
σ0.052-0.078=-0.026
min1853.307-1853.284=0.023
max1853.430-1853.469=-0.039
mean1751.400-1802.800=-51.400
σ166.300-168.869=-2.569
min1517.000-1632.000=-115.000
max1908.000-1974.000=-66.000
mean3.093-3.253=-0.160
σ0.252-0.334=-0.082
min2.895-2.892=0.003
max3.526-3.656=-0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.694-1.424=0.269
σ0.108-0.305=-0.196
min1.527-1.102=0.426
max1.808-1.873=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=0.000
σ577.064-577.063=0.001
min153.896-153.895=0.001
max1308.025-1308.024=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean0.554-0.521=0.033
σ0.586-0.515=0.071
min0.257-0.261=-0.003
max1.432-1.293=0.140
policies=20
mean1539.222-1539.224=-0.003
σ0.316-0.321=-0.004
min1539.000-1538.999=0.001
max1539.691-1539.700=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean2.566-2.573=-0.008
σ0.018-0.016=0.002
min2.544-2.554=-0.010
max2.583-2.589=-0.005
policies=200
mean15400.335-15400.365=-0.030
σ0.128-0.085=0.043
min15400.207-15400.270=-0.064
max15400.485-15400.467=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1472.000-1632.000=-160.000
σ0.000
min1472.000-1632.000=-160.000
max1472.000-1632.000=-160.000
mean26.036-25.961=0.075
σ0.029-0.075=-0.046
min26.000-25.862=0.139
max26.070-26.035=0.035