Compare commits

Home / Compare a8298489 .. 081538d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.030-54.032=-0.001
σ0.370-0.367=0.002
min53.887-53.889=-0.001
max55.082-55.077=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.136-0.139=-0.002
σ0.006-0.004=0.003
min0.130-0.136=-0.005
max0.150-0.144=0.005
cache=y
dps=1
iters=10
policies=100
mean43.382-43.384=-0.002
σ0.006-0.006=0.000
min43.373-43.378=-0.005
max43.391-43.393=-0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.119-0.122=-0.004
σ0.004-0.004=0.001
min0.113-0.118=-0.005
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.330-1006.327=0.003
σ0.883-0.891=-0.008
min1005.846-1005.857=-0.012
max1009.995-1010.029=-0.034
mean1049.750-1043.600=6.150
σ317.891-307.244=10.647
min546.000-548.000=-2.000
max1650.000-1601.000=49.000
mean1.558-1.564=-0.006
σ0.079-0.092=-0.013
min1.465-1.481=-0.016
max1.792-1.807=-0.015

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.002=0.001
min0.881
max0.888-0.886=0.003
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.418-0.431=-0.013
σ0.128-0.127=0.000
min0.340-0.347=-0.007
max0.644-0.653=-0.009
name=error_case.art
mean2.335-2.333=0.001
σ0.003-0.003=0.000
min2.332
max2.339-2.337=0.002
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.895-0.905=-0.009
σ0.082-0.117=-0.035
min0.846-0.824=0.022
max1.041-1.109=-0.068
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.544-0.553=-0.008
σ0.053-0.041=0.013
min0.505-0.522=-0.017
max0.635-0.621=0.015
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.849-0.866=-0.017
σ0.045-0.029=0.016
min0.815-0.835=-0.020
max0.926-0.905=0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.557=-0.003
σ0.029-0.034=-0.005
min963.523
max963.596-963.610=-0.015
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.853-0.845=0.009
σ0.015-0.014=0.001
min0.828-0.826=0.002
max0.866-0.864=0.003
name=cdr_enhanced_4k_loc.art
mean884.857-884.855=0.001
σ0.004-0.005=-0.001
min884.851-884.847=0.004
max884.861-884.860=0.002
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.677-0.742=-0.064
σ0.040-0.002=0.038
min0.640-0.740=-0.100
max0.731-0.744=-0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.709=0.001
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean4.278-3.545=0.734
σ0.087-0.086=0.002
min4.107-3.367=0.739
max4.675-3.905=0.770
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean4.249-3.500=0.748
σ0.074-0.063=0.012
min4.142-3.360=0.782
max4.559-3.737=0.822
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.753-0.760=-0.006
σ0.027-0.018=0.009
min0.564-0.721=-0.156
max0.891-0.858=0.033
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.723-0.723=0.000
σ0.017-0.016=0.001
min0.694-0.687=0.007
max0.818-0.787=0.031

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.512-295.441=0.071
σ0.193-0.242=-0.049
min295.313-295.267=0.046
max296.017-296.113=-0.095
mean1896.000-1908.000=-12.000
σ0.000
min1896.000-1908.000=-12.000
max1896.000-1908.000=-12.000
mean0.575-0.573=0.001
σ0.047-0.050=-0.004
min0.504-0.497=0.007
max0.655-0.628=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-285.256=-0.011
σ0.039-0.038=0.000
min285.195-285.206=-0.011
max285.286-285.294=-0.008
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.393-0.393=0.000
σ0.011-0.011=-0.000
min0.380-0.381=-0.001
max0.404-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.193-1295.184=0.009
σ0.106-0.091=0.015
min1295.078-1295.082=-0.004
max1295.342-1295.277=0.065
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean1.887-1.981=-0.094
σ0.076-0.222=-0.145
min1.802-1.810=-0.008
max1.979-2.350=-0.371
iters=5
new-facts=6402
prior-facts=1
mean1538.096-1538.081=0.015
σ4.069-4.024=0.046
min1536.027-1536.026=0.002
max1545.365-1545.269=0.095
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean2.336-2.312=0.024
σ0.377-0.260=0.117
min2.021-2.047=-0.025
max2.898-2.674=0.225
iters=5
new-facts=6402
prior-facts=6402
mean1857.107-1857.109=-0.002
σ0.051-0.054=-0.003
min1857.057-1857.055=0.002
max1857.177-1857.185=-0.008
mean1768.200-1768.600=-0.400
σ121.816-141.719=-19.903
min1650.000-1601.000=49.000
max1896.000-1908.000=-12.000
mean3.043-3.078=-0.035
σ0.190-0.282=-0.091
min2.855-2.858=-0.003
max3.363-3.555=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.348-1.329=0.019
σ0.203-0.355=-0.152
min1.110-0.944=0.166
max1.659-1.671=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.608-443.610=-0.002
σ577.066-577.065=0.000
min155.072-155.074=-0.002
max1309.206-1309.207=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean0.531-0.535=-0.004
σ0.547-0.558=-0.011
min0.257-0.255=0.002
max1.351-1.371=-0.020
policies=20
mean1551.027-1551.027=-0.000
σ0.327-0.314=0.013
min1550.804-1550.811=-0.007
max1551.513-1551.493=0.020
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean2.587-2.576=0.010
σ0.016-0.025=-0.009
min2.564-2.560=0.003
max2.599-2.613=-0.014
policies=200
mean15518.500-15518.381=0.119
σ0.083-0.202=-0.118
min15518.383-15518.102=0.281
max15518.571-15518.581=-0.010
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1601.000=49.000
σ0.000
min1650.000-1601.000=49.000
max1650.000-1601.000=49.000
mean26.214-26.110=0.104
σ0.225-0.121=0.104
min25.996-26.004=-0.007
max26.443-26.281=0.162