Compare commits

Home / Compare 723b9047 .. 55a01783

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.041-54.042=-0.001
σ0.368-0.370=-0.002
min53.896-53.894=0.002
max55.089-55.094=-0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.139-0.141=-0.002
σ0.003-0.005=-0.001
min0.136-0.137=-0.001
max0.146-0.150=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.396-43.393=0.003
σ0.007-0.006=0.001
min43.385-43.384=0.001
max43.410-43.401=0.009
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.124-0.121=0.003
σ0.006-0.005=0.001
min0.120-0.114=0.006
max0.139-0.129=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.331=0.001
σ0.896-0.881=0.015
min1005.838-1005.842=-0.004
max1010.051-1009.981=0.071
mean1044.400-1049.600=-5.200
σ305.094-307.607=-2.513
min574.000-573.000=1.000
max1660.000-1649.000=11.000
mean1.552-1.542=0.010
σ0.077-0.059=0.017
min1.463-1.484=-0.021
max1.760-1.674=0.086

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.431-0.426=0.005
σ0.132-0.134=-0.002
min0.341-0.352=-0.011
max0.653-0.663=-0.011
name=error_case.art
mean2.334-2.333=0.000
σ0.002-0.003=-0.000
min2.332
max2.337
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.883-0.890=-0.007
σ0.093-0.096=-0.003
min0.820-0.818=0.002
max1.045-1.052=-0.008
name=heavy_item.art
mean1.522-1.521=0.000
σ0.002-0.002=-0.000
min1.520
max1.524
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.578-0.542=0.036
σ0.063-0.058=0.004
min0.524-0.488=0.036
max0.662-0.637=0.025
name=nested_use.art
mean2.356-2.355=0.000
σ0.002-0.002=-0.000
min2.355
max2.358
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.887-0.838=0.049
σ0.067-0.040=0.027
min0.813-0.808=0.005
max0.975-0.909=0.066

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.555-963.551=0.004
σ0.030-0.025=0.005
min963.523
max963.598-963.584=0.014
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.824-0.829=-0.005
σ0.033-0.040=-0.007
min0.775-0.764=0.011
max0.860-0.862=-0.002
name=cdr_enhanced_4k_loc.art
mean884.855-884.856=-0.001
σ0.005-0.005=-0.000
min884.847-884.848=-0.001
max884.860-884.860=-0.001
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.711-0.666=0.046
σ0.040-0.047=-0.008
min0.649-0.612=0.037
max0.742-0.736=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.709=0.001
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean3.542-4.233=-0.691
σ0.081-0.068=0.014
min3.377-4.124=-0.747
max3.772-4.605=-0.833
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.659=-0.001
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean3.516-4.213=-0.697
σ0.078-0.061=0.016
min3.289-4.086=-0.797
max3.806-4.547=-0.740
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.549-0.745=-0.196
σ0.019-0.018=0.001
min0.517-0.714=-0.197
max0.665-0.871=-0.206
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.518-0.703=-0.185
σ0.019-0.038=-0.020
min0.496-0.504=-0.008
max0.646-0.790=-0.144

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.543-295.404=0.139
σ0.287-0.169=0.117
min295.287-295.217=0.070
max296.311-295.782=0.529
mean1914.000-1937.000=-23.000
σ0.000
min1914.000-1937.000=-23.000
max1914.000-1937.000=-23.000
mean0.579-0.574=0.005
σ0.055-0.060=-0.005
min0.499-0.504=-0.005
max0.694-0.715=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.243-285.250=-0.007
σ0.039-0.037=0.002
min285.193-285.199=-0.007
max285.283-285.289=-0.006
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.391-0.387=0.004
σ0.009-0.009=0.000
min0.383-0.380=0.003
max0.400-0.397=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.193-1295.195=-0.002
σ0.107-0.109=-0.002
min1295.073-1295.076=-0.002
max1295.317-1295.324=-0.007
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean1.969-1.928=0.042
σ0.195-0.094=0.100
min1.811-1.826=-0.015
max2.288-2.031=0.257
iters=5
new-facts=6402
prior-facts=1
mean1539.348-1539.357=-0.009
σ6.866-6.849=0.017
min1536.052-1536.105=-0.054
max1551.625-1551.605=0.020
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean2.259-2.202=0.057
σ0.197-0.208=-0.012
min2.043-2.019=0.024
max2.477-2.507=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean1857.108-1857.103=0.006
σ0.051-0.062=-0.011
min1857.059-1857.039=0.019
max1857.180-1857.176=0.003
mean1780.600-1787.800=-7.200
σ127.804-144.469=-16.665
min1660.000-1649.000=11.000
max1914.000-1937.000=-23.000
mean3.112-2.964=0.148
σ0.382-0.084=0.298
min2.861-2.831=0.030
max3.787-3.035=0.752

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.345-1.375=-0.030
σ0.282-0.263=0.019
min1.107-1.108=-0.001
max1.832-1.757=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.290-445.290=-0.001
σ580.425-580.424=0.000
min155.073-155.077=-0.004
max1315.927-1315.927=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean0.534-0.535=-0.000
σ0.538-0.547=-0.009
min0.261-0.256=0.005
max1.341-1.355=-0.014
policies=20
mean1551.037-1551.040=-0.003
σ0.325-0.316=0.009
min1550.815-1550.826=-0.011
max1551.520-1551.509=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean2.591-2.574=0.017
σ0.008-0.021=-0.012
min2.583-2.549=0.034
max2.601-2.595=0.006
policies=200
mean15518.481-15518.570=-0.089
σ0.071-0.073=-0.002
min15518.380-15518.499=-0.120
max15518.537-15518.669=-0.132
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1649.000=11.000
σ0.000
min1660.000-1649.000=11.000
max1660.000-1649.000=11.000
mean26.089-26.174=-0.085
σ0.151-0.115=0.036
min25.939-26.072=-0.133
max26.281-26.322=-0.041