Compare commits

Home / Compare b9c3d05b .. 285c8ca9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.964=0.090
σ0.371-0.371=-0.000
min53.908-53.821=0.087
max55.108-55.019=0.089
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.139=0.000
σ0.006-0.004=0.002
min0.130-0.132=-0.002
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.007=-0.001
min43.386-43.311=0.074
max43.401-43.335=0.066
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.123-0.119=0.004
σ0.004-0.004=0.000
min0.119-0.115=0.004
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.515=0.492
σ1.189-1.172=0.017
min1006.434-1005.976=0.458
max1011.987-1011.420=0.566
mean1055.100-1048.200=6.900
σ314.791-313.696=1.095
min585.000-597.000=-12.000
max1618.000-1643.000=-25.000
mean1.530-1.564=-0.034
σ0.053-0.087=-0.034
min1.459-1.485=-0.026
max1.631-1.811=-0.180

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.447-0.418=0.030
σ0.147-0.137=0.010
min0.362-0.330=0.032
max0.705-0.660=0.044
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.940-0.875=0.065
σ0.214-0.092=0.123
min0.827-0.817=0.010
max1.322-1.037=0.286
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.554-0.543=0.011
σ0.057-0.045=0.012
min0.487-0.503=-0.015
max0.615-0.618=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.868-0.841=0.027
σ0.039-0.045=-0.006
min0.843-0.795=0.048
max0.936-0.912=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.838=0.002
σ0.035-0.032=0.003
min964.810-964.811=-0.001
max964.898-964.893=0.005
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.810-0.839=-0.029
σ0.060-0.025=0.035
min0.727-0.808=-0.081
max0.861-0.859=0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.005=0.003
min885.506-885.504=0.001
max885.525-885.516=0.008
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.696-0.735=-0.039
σ0.039-0.007=0.031
min0.648-0.728=-0.081
max0.751-0.746=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.723=-0.002
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean4.281-3.539=0.742
σ0.080-0.093=-0.014
min4.132-3.403=0.729
max4.671-4.056=0.615
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean4.262-3.520=0.741
σ0.117-0.065=0.052
min4.096-3.401=0.695
max5.012-3.716=1.296
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.750-0.741=0.009
σ0.017-0.022=-0.005
min0.711-0.661=0.051
max0.863-0.852=0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.703-0.543=0.161
σ0.015-0.080=-0.065
min0.674-0.478=0.196
max0.780-0.785=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.935-296.262=0.674
σ0.246-0.182=0.064
min296.719-296.090=0.630
max297.559-296.742=0.817
mean2032.000-1919.000=113.000
σ0.000
min2032.000-1919.000=113.000
max2032.000-1919.000=113.000
mean0.577-0.561=0.016
σ0.020-0.039=-0.018
min0.537-0.511=0.026
max0.595-0.629=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-285.029=1.789
σ0.039-0.039=0.000
min286.767-284.973=1.795
max286.858-285.072=1.786
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.396-0.393=0.002
σ0.005-0.008=-0.002
min0.388-0.385=0.003
max0.400-0.401=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.211-1295.382=1.829
σ0.121-0.105=0.015
min1297.088-1295.299=1.789
max1297.363-1295.555=1.808
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean1.879-1.953=-0.074
σ0.094-0.171=-0.077
min1.804-1.820=-0.015
max2.017-2.240=-0.224
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1539.580=1.755
σ6.843-6.783=0.060
min1538.054-1536.434=1.620
max1553.573-1551.712=1.860
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean2.230-2.316=-0.086
σ0.156-0.242=-0.086
min2.119-2.115=0.004
max2.489-2.729=-0.240
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1857.331=1.792
σ0.065-0.062=0.003
min1859.032-1857.261=1.772
max1859.199-1857.408=1.791
mean1763.000-1775.400=-12.400
σ178.827-138.567=40.260
min1618.000-1643.000=-25.000
max2032.000-1919.000=113.000
mean2.891-3.045=-0.154
σ0.145-0.114=0.032
min2.777-2.900=-0.123
max3.143-3.152=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.261=-0.033
σ0.363-0.254=0.109
min0.932-0.924=0.008
max1.843-1.629=0.213

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.191=0.630
σ581.372-581.332=0.040
min158.131-157.523=0.608
max1320.880-1320.189=0.691
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.533-0.538=-0.006
σ0.538-0.542=-0.005
min0.260-0.255=0.005
max1.339-1.352=-0.013
policies=20
mean1581.621-1575.563=6.058
σ0.340-0.373=-0.034
min1581.390-1575.314=6.076
max1582.126-1576.118=6.007
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean2.608-2.645=-0.037
σ0.014-0.020=-0.006
min2.591-2.625=-0.034
max2.623-2.672=-0.048
policies=200
mean15824.268-15763.636=60.632
σ0.067-0.117=-0.050
min15824.218-15763.486=60.732
max15824.366-15763.746=60.620
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean26.573-26.616=-0.043
σ0.048-0.151=-0.102
min26.517-26.438=0.080
max26.630-26.807=-0.177