Compare commits

Home / Compare a39df534 .. 9ad4b8e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.369=0.001
min53.909-53.913=-0.005
max55.106-55.104=0.002
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.136-0.141=-0.005
σ0.005-0.004=0.002
min0.132-0.136=-0.004
max0.146-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.395-43.392=0.003
σ0.004-0.007=-0.003
min43.390-43.382=0.008
max43.402-43.404=-0.002
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.123-0.121=0.002
σ0.004-0.004=0.000
min0.119-0.117=0.003
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.014-1007.006=0.008
σ1.175-1.188=-0.013
min1006.428-1006.432=-0.004
max1011.918-1011.982=-0.064
mean1050.450-1059.200=-8.750
σ308.921-306.966=1.955
min574.000-581.000=-7.000
max1647.000-1625.000=22.000
mean1.532-1.532=-0.000
σ0.075-0.074=0.000
min1.468-1.475=-0.007
max1.760-1.779=-0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.420-0.406=0.014
σ0.152-0.106=0.047
min0.326-0.334=-0.008
max0.690-0.590=0.100
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.886-0.885=0.001
σ0.096-0.086=0.009
min0.830-0.816=0.015
max1.056-1.035=0.021
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.545-0.547=-0.003
σ0.053-0.050=0.003
min0.492-0.508=-0.015
max0.632-0.629=0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.859-0.854=0.006
σ0.046-0.040=0.005
min0.819-0.821=-0.002
max0.937-0.921=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.036-0.034=0.002
min964.811-964.811=-0.000
max964.899-964.895=0.004
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.819-0.843=-0.023
σ0.088-0.018=0.070
min0.662-0.818=-0.155
max0.863-0.862=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.000
min885.504
max885.522-885.520=0.001
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.693-0.726=-0.033
σ0.041-0.018=0.023
min0.645-0.698=-0.053
max0.739-0.742=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.002
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean4.231-4.288=-0.057
σ0.086-0.091=-0.005
min4.089-4.114=-0.025
max4.616-4.544=0.072
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean4.253-4.172=0.082
σ0.081-0.276=-0.195
min4.086-3.430=0.656
max4.487-4.515=-0.028
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.746-0.748=-0.002
σ0.018-0.016=0.002
min0.708-0.716=-0.009
max0.853-0.819=0.034
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.705-0.713=-0.007
σ0.015-0.017=-0.002
min0.674-0.639=0.035
max0.781-0.780=0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.870-296.934=-0.065
σ0.229-0.222=0.007
min296.687-296.595=0.091
max297.493-297.330=0.164
mean1951.000-1908.000=43.000
σ0.000
min1951.000-1908.000=43.000
max1951.000-1908.000=43.000
mean0.590-0.599=-0.009
σ0.038-0.040=-0.002
min0.510-0.528=-0.017
max0.662-0.687=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.824=-0.005
σ0.034-0.035=-0.001
min286.772-286.775=-0.003
max286.860-286.859=0.001
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.391-0.397=-0.006
σ0.002-0.006=-0.004
min0.388-0.390=-0.002
max0.393-0.402=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1297.228-1297.290=-0.062
σ0.073-0.081=-0.008
min1297.166-1297.199=-0.033
max1297.330-1297.410=-0.080
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean2.077-2.234=-0.156
σ0.062-0.018=0.044
min1.992-2.211=-0.219
max2.143-2.258=-0.115
iters=5
new-facts=6402
prior-facts=1
mean1541.345-1541.337=0.009
σ6.816-6.825=-0.009
min1538.162-1538.118=0.044
max1553.536-1553.543=-0.007
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean2.277-2.220=0.057
σ0.282-0.108=0.174
min2.055-2.124=-0.069
max2.728-2.402=0.326
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.117=-0.006
σ0.083-0.066=0.017
min1858.993-1859.028=-0.035
max1859.190-1859.199=-0.009
mean1793.000-1770.400=22.600
σ152.591-134.849=17.742
min1647.000-1625.000=22.000
max1951.000-1908.000=43.000
mean3.006-3.165=-0.159
σ0.141-0.359=-0.218
min2.869-2.867=0.002
max3.218-3.737=-0.519

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.243=-0.056
σ0.335-0.368=-0.033
min0.913-0.946=-0.034
max1.686-1.871=-0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.820=0.002
σ581.372-581.372=-0.001
min158.135-158.132=0.003
max1320.879-1320.878=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean0.529-0.559=-0.029
σ0.532-0.578=-0.046
min0.254-0.267=-0.013
max1.327-1.425=-0.098
policies=20
mean1581.628-1581.615=0.013
σ0.358-0.367=-0.009
min1581.384-1581.370=0.014
max1582.160-1582.161=-0.000
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean2.645-2.646=-0.001
σ0.017-0.011=0.006
min2.630-2.633=-0.003
max2.660-2.657=0.004
policies=200
mean15824.265-15824.192=0.073
σ0.135-0.150=-0.015
min15824.158-15823.994=0.163
max15824.443-15824.357=0.086
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1625.000=22.000
σ0.000
min1647.000-1625.000=22.000
max1647.000-1625.000=22.000
mean26.583-26.668=-0.085
σ0.038-0.042=-0.004
min26.542-26.625=-0.084
max26.630-26.723=-0.092