Compare commits

Home / Compare cb04f63b .. f4a166ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.000
σ0.369-0.369=-0.001
min53.870-53.872=-0.002
max55.062-55.064=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.138-0.136=0.002
σ0.003-0.005=-0.002
min0.134-0.130=0.004
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.008=-0.001
min43.311-43.309=0.002
max43.331-43.336=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.122-0.121=0.001
σ0.003-0.002=0.001
min0.119-0.119=-0.000
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.309=0.001
σ1.177-1.167=0.010
min1005.760-1005.768=-0.007
max1011.240-1011.194=0.046
mean1047.550-1045.850=1.700
σ312.976-313.898=-0.922
min597.000-595.000=2.000
max1645.000-1641.000=4.000
mean1.532-1.547=-0.015
σ0.069-0.098=-0.029
min1.468-1.459=0.009
max1.700-1.781=-0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.443-0.409=0.034
σ0.120-0.144=-0.024
min0.349-0.320=0.029
max0.650-0.663=-0.014
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.919-0.887=0.032
σ0.092-0.097=-0.006
min0.828-0.820=0.008
max1.047-1.056=-0.010
name=heavy_item.art
mean1.524-1.523=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.534-0.555=-0.021
σ0.059-0.054=0.005
min0.488-0.510=-0.022
max0.634-0.646=-0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.838-0.852=-0.014
σ0.040-0.036=0.004
min0.805-0.826=-0.021
max0.906-0.913=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.115=-0.001
σ0.033-0.029=0.004
min964.085-964.094=-0.009
max964.168-964.163=0.005
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.847-0.852=-0.005
σ0.022-0.004=0.018
min0.809-0.845=-0.036
max0.864-0.856=0.008
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.000
σ0.007-0.008=-0.000
min884.705-884.703=0.001
max884.723-884.723=0.000
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.685-0.710=-0.026
σ0.072-0.029=0.043
min0.585-0.681=-0.095
max0.741-0.740=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean3.518-4.214=-0.696
σ0.075-0.081=-0.006
min3.381-4.030=-0.649
max3.742-4.518=-0.776
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.667-7.669=-0.001
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean3.495-3.533=-0.039
σ0.102-0.198=-0.096
min3.281-3.354=-0.073
max3.762-4.276=-0.514
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.531-0.737=-0.206
σ0.013-0.018=-0.005
min0.512-0.707=-0.194
max0.626-0.842=-0.217
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.509-0.690=-0.182
σ0.015-0.014=0.000
min0.457-0.655=-0.199
max0.575-0.753=-0.178

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.225-296.453=-0.228
σ0.199-0.242=-0.043
min296.088-296.208=-0.120
max296.740-297.100=-0.359
mean1916.000-1953.000=-37.000
σ0.000
min1916.000-1953.000=-37.000
max1916.000-1953.000=-37.000
mean0.568-0.589=-0.021
σ0.060-0.035=0.026
min0.506-0.539=-0.033
max0.698-0.665=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.694=0.000
σ0.032-0.037=-0.005
min284.652-284.642=0.010
max284.726-284.734=-0.009
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.395-0.398=-0.003
σ0.010-0.007=0.003
min0.384-0.385=-0.001
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.075=0.003
σ0.108-0.103=0.005
min1294.960-1294.960=-0.000
max1295.214-1295.206=0.009
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean1.917-1.920=-0.003
σ0.117-0.117=-0.000
min1.783-1.791=-0.009
max2.037-2.048=-0.012
iters=5
new-facts=6402
prior-facts=1
mean1539.182-1539.211=-0.029
σ6.832-6.828=0.004
min1535.917-1535.919=-0.002
max1551.401-1551.420=-0.019
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean2.265-2.362=-0.097
σ0.268-0.244=0.024
min2.026-2.052=-0.027
max2.689-2.692=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.983=0.003
σ0.067-0.061=0.006
min1856.899-1856.930=-0.031
max1857.072-1857.069=0.003
mean1775.000-1791.200=-16.200
σ136.057-156.538=-20.481
min1645.000-1641.000=4.000
max1916.000-1953.000=-37.000
mean3.022-2.937=0.085
σ0.170-0.153=0.017
min2.851-2.822=0.028
max3.264-3.185=0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.181=0.013
σ0.284-0.208=0.076
min0.933-0.927=0.006
max1.659-1.459=0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.003
σ581.212-581.212=-0.001
min157.176-157.179=-0.003
max1319.601-1319.605=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean0.546-0.538=0.009
σ0.577-0.558=0.019
min0.254-0.255=-0.002
max1.412-1.374=0.038
policies=20
mean1572.085-1572.099=-0.013
σ0.356-0.344=0.012
min1571.843-1571.864=-0.021
max1572.615-1572.610=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean2.627-2.621=0.006
σ0.015-0.023=-0.008
min2.612-2.595=0.017
max2.644-2.651=-0.007
policies=200
mean15729.021-15729.091=-0.070
σ0.117-0.120=-0.003
min15728.903-15728.986=-0.083
max15729.141-15729.262=-0.121
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1641.000=4.000
σ0.000
min1645.000-1641.000=4.000
max1645.000-1641.000=4.000
mean26.448-26.528=-0.080
σ0.103-0.212=-0.109
min26.388-26.349=0.039
max26.603-26.776=-0.173