Compare commits

Home / Compare d282d976 .. 92209326

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.964=-0.000
σ0.369-0.370=-0.001
min53.828-53.826=0.002
max55.014-55.018=-0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.138-0.140=-0.002
σ0.005-0.005=0.000
min0.131-0.132=-0.001
max0.146-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.005=0.002
min43.314-43.314=0.000
max43.337-43.335=0.002
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.120-0.122=-0.002
σ0.004-0.004=-0.000
min0.115-0.114=0.001
max0.125-0.131=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.519-1006.515=0.004
σ1.163-1.173=-0.010
min1005.947-1005.949=-0.001
max1011.384-1011.427=-0.044
mean1050.550-1044.000=6.550
σ311.794-314.923=-3.129
min577.000-547.000=30.000
max1646.000-1524.000=122.000
mean1.557-1.546=0.011
σ0.085-0.068=0.017
min1.463-1.468=-0.004
max1.777-1.692=0.085

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.420-0.418=0.002
σ0.135-0.150=-0.014
min0.323-0.327=-0.004
max0.649-0.684=-0.036
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.866-0.881=-0.015
σ0.087-0.098=-0.011
min0.808-0.824=-0.015
max1.020-1.052=-0.032
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.529-0.532=-0.003
σ0.054-0.049=0.005
min0.482-0.493=-0.011
max0.621-0.617=0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.839-0.842=-0.003
σ0.037-0.042=-0.005
min0.811-0.805=0.006
max0.903-0.911=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.825=0.015
σ0.034-0.032=0.001
min964.811-964.809=0.002
max964.895-964.883=0.012
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.829-0.752=0.077
σ0.039-0.048=-0.010
min0.767-0.679=0.088
max0.859-0.808=0.051
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.008=-0.001
min885.506-885.504=0.001
max885.521-885.522=-0.001
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.678-0.699=-0.020
σ0.047-0.038=0.009
min0.614-0.652=-0.038
max0.747-0.738=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean3.540-4.237=-0.697
σ0.090-0.080=0.010
min3.422-4.085=-0.663
max4.016-4.526=-0.511
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.669=0.002
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean3.538-4.231=-0.694
σ0.074-0.051=0.024
min3.395-4.093=-0.697
max3.886-4.335=-0.448
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.736-0.732=0.004
σ0.016-0.019=-0.003
min0.711-0.699=0.012
max0.823-0.848=-0.026
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.702-0.693=0.009
σ0.018-0.013=0.005
min0.649-0.666=-0.017
max0.762-0.769=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.366-296.452=-0.086
σ0.150-0.225=-0.075
min296.237-296.299=-0.062
max296.762-297.065=-0.303
mean2021.000-2027.000=-6.000
σ0.000
min2021.000-2027.000=-6.000
max2021.000-2027.000=-6.000
mean0.537-0.563=-0.026
σ0.032-0.024=0.008
min0.502-0.514=-0.013
max0.587-0.587=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-285.025=0.001
σ0.036-0.035=0.001
min284.979-284.976=0.003
max285.062-285.061=0.001
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.399-0.400=-0.001
σ0.009-0.008=0.001
min0.385-0.390=-0.006
max0.407-0.411=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.418-1295.415=0.003
σ0.102-0.111=-0.009
min1295.299-1295.283=0.016
max1295.539-1295.552=-0.012
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean1.891-1.868=0.023
σ0.072-0.054=0.018
min1.819-1.816=0.004
max1.986-1.947=0.039
iters=5
new-facts=6402
prior-facts=1
mean1539.521-1539.530=-0.009
σ6.853-6.842=0.010
min1536.227-1536.231=-0.004
max1551.774-1551.766=0.008
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean2.336-2.297=0.040
σ0.300-0.261=0.039
min2.044-2.041=0.003
max2.700-2.689=0.011
iters=5
new-facts=6402
prior-facts=6402
mean1857.328-1857.335=-0.007
σ0.053-0.052=0.001
min1857.267-1857.276=-0.008
max1857.400-1857.401=-0.001
mean1776.400-1738.800=37.600
σ164.506-209.880=-45.374
min1646.000-1524.000=122.000
max2021.000-2027.000=-6.000
mean2.865-2.897=-0.032
σ0.093-0.056=0.037
min2.714-2.825=-0.110
max2.942-2.956=-0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.216-1.636=-0.420
σ0.325-0.267=0.059
min0.932-1.268=-0.337
max1.759-1.910=-0.151

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-448.190=0.001
σ581.331-581.332=-0.001
min157.523-157.522=0.001
max1320.187-1320.187=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean0.558-0.533=0.026
σ0.582-0.535=0.047
min0.262-0.259=0.003
max1.431-1.335=0.096
policies=20
mean1575.560-1575.556=0.005
σ0.356-0.359=-0.003
min1575.318-1575.311=0.007
max1576.090-1576.089=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean2.635-2.636=-0.001
σ0.016-0.024=-0.008
min2.621-2.616=0.005
max2.653-2.670=-0.017
policies=200
mean15763.640-15763.677=-0.037
σ0.072-0.127=-0.055
min15763.577-15763.524=0.052
max15763.739-15763.836=-0.097
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1524.000=122.000
σ0.000
min1646.000-1524.000=122.000
max1646.000-1524.000=122.000
mean26.642-26.631=0.011
σ0.223-0.079=0.144
min26.504-26.536=-0.032
max26.974-26.712=0.263