Compare commits

Home / Compare 14d932c4 .. 698b54ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.003
σ0.368-0.370=-0.002
min53.920-53.904=0.016
max55.104-55.106=-0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.140-0.138=0.002
σ0.005-0.005=-0.001
min0.132-0.132=0.001
max0.149-0.149=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.007=-0.001
min43.384-43.384=0.000
max43.405-43.407=-0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.120-0.123=-0.002
σ0.001-0.004=-0.002
min0.118-0.118=0.000
max0.122-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.002=0.003
σ1.190-1.185=0.005
min1006.439-1006.433=0.007
max1011.993-1011.971=0.022
mean1046.700-1043.700=3.000
σ314.138-305.592=8.546
min572.000-589.000=-17.000
max1640.000-1630.000=10.000
mean1.555-1.549=0.006
σ0.078-0.096=-0.018
min1.470-1.454=0.017
max1.757-1.797=-0.041

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.408-0.417=-0.009
σ0.126-0.128=-0.002
min0.330-0.350=-0.020
max0.632-0.645=-0.013
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.883-0.884=-0.001
σ0.093-0.093=-0.001
min0.812-0.822=-0.010
max1.044-1.048=-0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.539-0.561=-0.022
σ0.045-0.066=-0.020
min0.506-0.495=0.011
max0.612-0.640=-0.029
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.854-0.852=0.003
σ0.041-0.045=-0.004
min0.820-0.814=0.006
max0.926-0.926=-0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.840=-0.002
σ0.037-0.033=0.004
min964.807-964.812=-0.005
max964.898-964.894=0.003
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.791-0.823=-0.032
σ0.044-0.033=0.010
min0.732-0.783=-0.050
max0.849-0.855=-0.006
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.001-0.007=-0.006
min885.513-885.504=0.009
max885.515-885.522=-0.007
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.701-0.733=-0.031
σ0.046-0.010=0.036
min0.626-0.718=-0.092
max0.736-0.743=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean4.186-4.182=0.003
σ0.093-0.068=0.025
min4.011-4.063=-0.052
max4.528-4.409=0.119
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean4.166-4.178=-0.012
σ0.065-0.123=-0.058
min4.044-3.296=0.748
max4.370-4.552=-0.182
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.737-0.751=-0.014
σ0.021-0.028=-0.007
min0.705-0.711=-0.006
max0.842-0.935=-0.093
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.700-0.710=-0.011
σ0.014-0.028=-0.015
min0.664-0.507=0.158
max0.746-0.800=-0.053

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.995-296.744=0.251
σ0.238-0.206=0.032
min296.822-296.614=0.208
max297.650-297.317=0.333
mean2055.000-1956.000=99.000
σ0.000
min2055.000-1956.000=99.000
max2055.000-1956.000=99.000
mean0.559-0.582=-0.022
σ0.030-0.038=-0.008
min0.517-0.510=0.006
max0.588-0.636=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.819=0.000
σ0.037-0.036=0.000
min286.773-286.769=0.003
max286.858-286.855=0.004
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.396-0.395=0.001
σ0.006-0.006=-0.000
min0.390-0.388=0.002
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1297.213-1297.253=-0.039
σ0.073-0.079=-0.006
min1297.133-1297.166=-0.034
max1297.301-1297.343=-0.042
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean2.051-2.102=-0.051
σ0.047-0.077=-0.030
min2.000-2.004=-0.004
max2.124-2.195=-0.071
iters=5
new-facts=6402
prior-facts=1
mean1541.353-1541.306=0.047
σ6.814-6.832=-0.017
min1538.165-1538.072=0.093
max1553.540-1553.523=0.017
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean2.301-2.162=0.139
σ0.240-0.071=0.169
min2.140-2.062=0.077
max2.699-2.248=0.452
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.111=0.004
σ0.085-0.081=0.003
min1858.987-1858.989=-0.002
max1859.199-1859.185=0.014
mean1795.400-1789.400=6.000
σ179.485-163.199=16.286
min1640.000-1630.000=10.000
max2055.000-1956.000=99.000
mean2.948-2.996=-0.049
σ0.152-0.113=0.039
min2.767-2.858=-0.092
max3.119-3.150=-0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.251=-0.070
σ0.285-0.309=-0.023
min0.935-1.060=-0.124
max1.584-1.785=-0.201

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.372=-0.000
min158.132-158.133=-0.001
max1320.878-1320.879=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean0.553-0.556=-0.003
σ0.582-0.584=-0.002
min0.258-0.261=-0.003
max1.426-1.432=-0.006
policies=20
mean1581.616-1581.615=0.001
σ0.357-0.355=0.002
min1581.374-1581.374=0.000
max1582.147-1582.143=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean2.629-2.635=-0.006
σ0.007-0.014=-0.007
min2.622-2.621=0.001
max2.636-2.653=-0.018
policies=200
mean15824.230-15824.040=0.190
σ0.105-0.174=-0.069
min15824.151-15823.871=0.280
max15824.381-15824.283=0.098
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1630.000=10.000
σ0.000
min1640.000-1630.000=10.000
max1640.000-1630.000=10.000
mean26.644-26.609=0.035
σ0.034-0.057=-0.023
min26.593-26.554=0.039
max26.665-26.658=0.007