Compare commits

Home / Compare c22867cd .. 397f1371

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.127-54.126=0.001
σ0.349-0.350=-0.002
min53.984-53.989=-0.005
max55.118-55.123=-0.004
mean415.700-414.000=1.700
σ0.483-0.000=0.483
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.143-0.139=0.004
σ0.008-0.005=0.003
min0.135-0.133=0.002
max0.158-0.148=0.011
cache=y
dps=1
iters=10
policies=100
mean43.403-43.404=-0.002
σ0.007-0.007=-0.000
min43.394-43.396=-0.001
max43.419-43.420=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.120-0.121=-0.001
σ0.004-0.004=0.000
min0.116-0.117=-0.001
max0.127-0.132=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.332-1006.335=-0.003
σ0.892-0.882=0.009
min1005.834-1005.835=-0.001
max1010.036-1009.993=0.042
mean1056.650-1050.550=6.100
σ316.535-307.904=8.631
min566.000-574.000=-8.000
max1622.000-1650.000=-28.000
mean1.529-1.547=-0.018
σ0.061-0.084=-0.023
min1.457-1.461=-0.004
max1.640-1.803=-0.163

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881
max0.886-0.887=-0.001
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.413-0.434=-0.021
σ0.101-0.132=-0.031
min0.343-0.366=-0.022
max0.592-0.670=-0.079
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.875-0.895=-0.020
σ0.062-0.093=-0.031
min0.829-0.847=-0.018
max0.981-1.060=-0.079
name=heavy_item.art
mean1.521-1.522=-0.000
σ0.002-0.002=-0.000
min1.520
max1.524-1.524=-0.000
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.533-0.551=-0.018
σ0.055-0.040=0.014
min0.488-0.521=-0.034
max0.624-0.621=0.004
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.841-0.856=-0.015
σ0.030-0.041=-0.011
min0.806-0.824=-0.017
max0.887-0.926=-0.039

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=-0.000
σ0.024-0.025=-0.001
min963.524-963.523=0.001
max963.583-963.582=0.001
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.817-0.836=-0.019
σ0.055-0.027=0.028
min0.723-0.803=-0.081
max0.860-0.860=0.000
name=cdr_enhanced_4k_loc.art
mean884.855-884.856=-0.001
σ0.009-0.005=0.003
min884.847-884.848=-0.001
max884.867-884.862=0.005
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.704-0.728=-0.024
σ0.029-0.032=-0.003
min0.672-0.674=-0.001
max0.745-0.757=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.710=0.002
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean4.246-3.556=0.690
σ0.090-0.092=-0.002
min4.085-3.410=0.674
max4.703-3.999=0.704
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean4.241-3.530=0.711
σ0.078-0.086=-0.008
min4.122-3.419=0.703
max4.570-4.123=0.448
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.755-0.544=0.211
σ0.032-0.014=0.018
min0.612-0.521=0.092
max0.915-0.637=0.278
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.715-0.444=0.271
σ0.015-0.112=-0.097
min0.681-0.276=0.406
max0.799-0.794=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.432-295.361=0.071
σ0.192-0.348=-0.156
min295.142-295.007=0.135
max295.843-296.248=-0.405
mean1913.000-1912.000=1.000
σ0.000
min1913.000-1912.000=1.000
max1913.000-1912.000=1.000
mean0.550-0.567=-0.017
σ0.034-0.050=-0.016
min0.499-0.515=-0.016
max0.590-0.675=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.252=-0.001
σ0.039-0.038=0.002
min285.202-285.212=-0.010
max285.294-285.293=0.001
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.403-0.406=-0.002
σ0.013-0.012=0.001
min0.390-0.393=-0.004
max0.416-0.419=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.199-1295.203=-0.004
σ0.099-0.110=-0.010
min1295.088-1295.082=0.006
max1295.313-1295.337=-0.024
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean1.904-1.905=-0.001
σ0.071-0.081=-0.010
min1.829-1.814=0.015
max1.989-1.976=0.013
iters=5
new-facts=6402
prior-facts=1
mean1538.085-1538.086=-0.001
σ4.027-4.051=-0.024
min1536.079-1536.044=0.035
max1545.282-1545.324=-0.042
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean2.281-2.266=0.015
σ0.265-0.203=0.062
min2.069-2.011=0.058
max2.672-2.450=0.221
iters=5
new-facts=6402
prior-facts=6402
mean1857.111-1857.114=-0.004
σ0.053-0.054=-0.001
min1857.061-1857.056=0.005
max1857.186-1857.185=0.001
mean1768.200-1780.800=-12.600
σ139.906-130.035=9.871
min1622.000-1650.000=-28.000
max1913.000-1912.000=1.000
mean3.093-3.095=-0.002
σ0.287-0.272=0.015
min2.869-2.872=-0.002
max3.593-3.562=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.404-1.351=0.053
σ0.305-0.250=0.055
min1.115-1.124=-0.010
max1.864-1.780=0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.613-443.611=0.002
σ577.065-577.065=0.000
min155.080-155.077=0.003
max1309.211-1309.208=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean0.544-0.542=0.002
σ0.566-0.551=0.014
min0.258-0.261=-0.002
max1.393-1.369=0.024
policies=20
mean1551.071-1551.058=0.013
σ0.330-0.344=-0.013
min1550.842-1550.829=0.013
max1551.561-1551.570=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean2.596-2.618=-0.022
σ0.011-0.014=-0.003
min2.588-2.603=-0.015
max2.612-2.636=-0.024
policies=200
mean15518.754-15518.713=0.041
σ0.080-0.155=-0.075
min15518.672-15518.612=0.060
max15518.838-15518.943=-0.105
mean9200.000
σ0.000
min9200.000
max9200.000
mean1622.000-1650.000=-28.000
σ0.000
min1622.000-1650.000=-28.000
max1622.000-1650.000=-28.000
mean26.268-26.345=-0.077
σ0.088-0.047=0.041
min26.191-26.296=-0.104
max26.395-26.405=-0.010