Compare commits

Home / Compare 397f1371 .. 92a49110

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.126-54.127=-0.001
σ0.350-0.349=0.001
min53.985-53.984=0.001
max55.121-55.118=0.003
mean418.000-415.700=2.300
σ0.000-0.483=-0.483
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.140-0.143=-0.004
σ0.004-0.008=-0.004
min0.137-0.135=0.001
max0.147-0.158=-0.011
cache=y
dps=1
iters=10
policies=100
mean43.403-43.403=0.001
σ0.006-0.007=-0.001
min43.395-43.394=0.001
max43.411-43.419=-0.008
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.120=0.000
σ0.005-0.004=0.000
min0.114-0.116=-0.002
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.335-1006.332=0.004
σ0.873-0.892=-0.019
min1005.837-1005.834=0.003
max1009.946-1010.036=-0.090
mean1049.850-1056.650=-6.800
σ310.455-316.535=-6.080
min566.000
max1641.000-1622.000=19.000
mean1.522-1.529=-0.006
σ0.066-0.061=0.005
min1.452-1.457=-0.005
max1.644-1.640=0.003

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=0.000
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.428-0.413=0.015
σ0.134-0.101=0.033
min0.339-0.343=-0.005
max0.665-0.592=0.074
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.882-0.875=0.007
σ0.090-0.062=0.028
min0.822-0.829=-0.007
max1.040-0.981=0.059
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.544-0.533=0.011
σ0.054-0.055=-0.001
min0.500-0.488=0.012
max0.636-0.624=0.012
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.844-0.841=0.003
σ0.036-0.030=0.006
min0.815-0.806=0.008
max0.901-0.887=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=0.001
σ0.025-0.024=0.001
min963.535-963.524=0.011
max963.592-963.583=0.008
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.853-0.817=0.036
σ0.027-0.055=-0.028
min0.805-0.723=0.083
max0.871-0.860=0.010
name=cdr_enhanced_4k_loc.art
mean884.854-884.855=-0.002
σ0.007-0.009=-0.002
min884.848-884.847=0.001
max884.864-884.867=-0.003
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.730-0.704=0.026
σ0.030-0.029=0.001
min0.690-0.672=0.018
max0.769-0.745=0.024

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.712=-0.000
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean4.293-4.246=0.047
σ0.098-0.090=0.008
min4.102-4.085=0.018
max4.781-4.703=0.078
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean4.290-4.241=0.049
σ0.114-0.078=0.037
min4.133-4.122=0.011
max5.016-4.570=0.445
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.763-0.755=0.008
σ0.016-0.032=-0.016
min0.730-0.612=0.118
max0.850-0.915=-0.066
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.532-0.715=-0.183
σ0.037-0.015=0.021
min0.503-0.681=-0.178
max0.790-0.799=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.533-295.432=0.101
σ0.190-0.192=-0.002
min295.353-295.142=0.211
max295.967-295.843=0.124
mean1913.000
σ0.000
min1913.000
max1913.000
mean0.568-0.550=0.017
σ0.061-0.034=0.027
min0.509-0.499=0.010
max0.700-0.590=0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.254-285.252=0.002
σ0.039-0.039=-0.001
min285.201-285.202=-0.000
max285.296-285.294=0.002
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.401-0.403=-0.003
σ0.006-0.013=-0.006
min0.392-0.390=0.002
max0.410-0.416=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.199-1295.199=-0.000
σ0.105-0.099=0.006
min1295.084-1295.088=-0.004
max1295.327-1295.313=0.014
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean1.911-1.904=0.007
σ0.102-0.071=0.031
min1.800-1.829=-0.030
max2.034-1.989=0.045
iters=5
new-facts=6402
prior-facts=1
mean1538.128-1538.085=0.042
σ4.015-4.027=-0.011
min1536.143-1536.079=0.063
max1545.303-1545.282=0.021
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean2.362-2.281=0.080
σ0.267-0.265=0.002
min2.041-2.069=-0.028
max2.618-2.672=-0.054
iters=5
new-facts=6402
prior-facts=6402
mean1857.111-1857.111=0.000
σ0.055-0.053=0.002
min1857.052-1857.061=-0.008
max1857.183-1857.186=-0.003
mean1779.800-1768.200=11.600
σ132.602-139.906=-7.304
min1641.000-1622.000=19.000
max1913.000
mean3.094-3.093=0.001
σ0.319-0.287=0.032
min2.865-2.869=-0.004
max3.653-3.593=0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.430-1.404=0.026
σ0.235-0.305=-0.071
min1.128-1.115=0.013
max1.719-1.864=-0.145

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.613-443.613=-0.000
σ577.065-577.065=0.000
min155.080-155.080=-0.000
max1309.211-1309.211=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean0.551-0.544=0.007
σ0.584-0.566=0.018
min0.253-0.258=-0.006
max1.426-1.393=0.033
policies=20
mean1551.076-1551.071=0.005
σ0.337-0.330=0.007
min1550.848-1550.842=0.005
max1551.576-1551.561=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean2.603-2.596=0.008
σ0.022-0.011=0.011
min2.580-2.588=-0.008
max2.632-2.612=0.020
policies=200
mean15518.809-15518.754=0.055
σ0.096-0.080=0.017
min15518.728-15518.672=0.057
max15518.928-15518.838=0.090
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1622.000=19.000
σ0.000
min1641.000-1622.000=19.000
max1641.000-1622.000=19.000
mean26.170-26.268=-0.097
σ0.209-0.088=0.120
min25.984-26.191=-0.207
max26.469-26.395=0.074