Compare commits

Home / Compare f43265e9 .. 3e8a32a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.343-54.343=-0.000
σ0.369-0.369=0.001
min54.205-54.200=0.006
max55.394-55.392=0.002
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.138-0.141=-0.003
σ0.004-0.003=0.001
min0.134-0.138=-0.004
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.629-43.628=0.001
σ0.009-0.008=0.000
min43.621-43.615=0.006
max43.650-43.643=0.006
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.124-0.119=0.005
σ0.003-0.004=-0.001
min0.121-0.115=0.006
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.329-1008.329=-0.001
σ0.876-0.869=0.008
min1007.832-1007.834=-0.002
max1011.964-1011.926=0.037
mean1047.550-1053.050=-5.500
σ303.784-316.641=-12.857
min558.000-574.000=-16.000
max1477.000-1521.000=-44.000
mean1.539-1.552=-0.013
σ0.069-0.084=-0.015
min1.472-1.465=0.008
max1.764-1.763=0.001

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.412-0.414=-0.002
σ0.140-0.135=0.005
min0.335-0.339=-0.005
max0.659-0.655=0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.898-0.872=0.026
σ0.094-0.093=0.001
min0.830-0.810=0.019
max1.059-1.033=0.026
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.546-0.536=0.010
σ0.056-0.050=0.007
min0.507-0.493=0.013
max0.640-0.613=0.028
name=nested_use.art
mean2.361-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.872-0.821=0.051
σ0.042-0.052=-0.010
min0.845-0.775=0.070
max0.945-0.908=0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.822=-0.000
σ0.032-0.024=0.008
min964.802
max964.877-964.860=0.017
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.839-0.784=0.055
σ0.029-0.080=-0.051
min0.798-0.672=0.126
max0.863-0.865=-0.002
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=0.000
σ0.006-0.007=-0.000
min885.504
max885.519-885.518=0.002
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.728-0.699=0.030
σ0.031-0.026=0.005
min0.675-0.667=0.008
max0.750-0.724=0.026

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean4.264-4.208=0.056
σ0.081-0.083=-0.002
min4.134-4.067=0.067
max4.498-4.613=-0.115
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean4.238-4.234=0.005
σ0.087-0.084=0.002
min4.085-4.097=-0.013
max4.641-4.523=0.118
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.753-0.744=0.009
σ0.023-0.019=0.004
min0.665-0.708=-0.043
max0.851-0.862=-0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.707-0.703=0.004
σ0.026-0.014=0.012
min0.504-0.673=-0.169
max0.789-0.770=0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.916-296.883=0.033
σ0.238-0.235=0.003
min296.700-296.692=0.008
max297.484-297.510=-0.025
mean1982.000-2045.000=-63.000
σ0.000
min1982.000-2045.000=-63.000
max1982.000-2045.000=-63.000
mean0.548-0.568=-0.020
σ0.025-0.024=0.001
min0.519-0.541=-0.023
max0.586-0.601=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean288.981-288.976=0.006
σ0.034-0.040=-0.005
min288.936-288.923=0.013
max289.017-289.019=-0.003
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.403-0.393=0.010
σ0.010-0.009=0.000
min0.396-0.383=0.013
max0.419-0.404=0.015
iters=5
new-facts=1
prior-facts=6402
mean1299.358-1299.285=0.073
σ0.061-0.123=-0.063
min1299.287-1299.192=0.095
max1299.425-1299.492=-0.066
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean2.125-1.904=0.221
σ0.073-0.179=-0.106
min2.025-1.797=0.228
max2.208-2.216=-0.007
iters=5
new-facts=6402
prior-facts=1
mean1543.517-1543.528=-0.011
σ6.871-6.867=0.004
min1540.218-1540.267=-0.049
max1555.803-1555.808=-0.005
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean2.324-2.295=0.029
σ0.195-0.174=0.021
min2.153-2.107=0.045
max2.621-2.548=0.073
iters=5
new-facts=6402
prior-facts=6402
mean1861.256-1861.282=-0.026
σ0.084-0.051=0.032
min1861.125-1861.222=-0.097
max1861.338-1861.337=0.000
mean1775.600-1732.800=42.800
σ215.744-219.210=-3.467
min1493.000-1521.000=-28.000
max1982.000-2045.000=-63.000
mean3.283-2.894=0.389
σ0.397-0.052=0.346
min2.879-2.842=0.037
max3.839-2.959=0.880

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.790-1.707=0.083
σ0.141-0.222=-0.081
min1.607-1.315=0.292
max1.998-1.845=0.153

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.339-447.341=-0.002
σ580.935-580.935=0.000
min156.870-156.872=-0.002
max1318.741-1318.743=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean0.547-0.534=0.013
σ0.576-0.554=0.022
min0.257-0.254=0.003
max1.411-1.365=0.045
policies=20
mean1568.990-1569.012=-0.023
σ0.339-0.343=-0.004
min1568.759-1568.776=-0.017
max1569.494-1569.521=-0.028
mean920.000
σ0.000
min920.000
max920.000
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean2.609-2.604=0.005
σ0.020-0.021=-0.001
min2.583-2.579=0.004
max2.632-2.625=0.007
policies=200
mean15698.132-15698.224=-0.092
σ0.105-0.106=-0.001
min15698.002-15698.137=-0.135
max15698.232-15698.374=-0.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1477.000-1521.000=-44.000
σ0.000
min1477.000-1521.000=-44.000
max1477.000-1521.000=-44.000
mean26.443-26.305=0.137
σ0.121-0.087=0.035
min26.358-26.233=0.124
max26.618-26.424=0.194