Compare commits

Home / Compare cad92f58 .. 4a6ec7b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.056=-0.011
σ0.369-0.368=0.001
min53.900-53.914=-0.015
max55.094-55.102=-0.008
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.000
min0.131-0.136=-0.005
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.393=-0.008
σ0.007-0.007=-0.000
min43.373-43.379=-0.006
max43.396-43.405=-0.008
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.120=0.001
σ0.005-0.005=0.000
min0.114-0.116=-0.002
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.981=-0.003
σ0.876-0.872=0.004
min1006.514-1006.481=0.033
max1010.612-1010.591=0.021
mean1051.500-1043.350=8.150
σ319.918-302.522=17.397
min575.000-572.000=3.000
max1620.000-1631.000=-11.000
mean1.558-1.537=0.021
σ0.115-0.084=0.031
min1.476-1.455=0.021
max2.005-1.824=0.180

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.435-0.436=-0.001
σ0.183-0.178=0.005
min0.331-0.345=-0.014
max0.758-0.753=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.900-0.920=-0.021
σ0.143-0.147=-0.003
min0.811-0.845=-0.034
max1.153-1.182=-0.029
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.541-0.533=0.008
σ0.050-0.057=-0.008
min0.494-0.483=0.010
max0.624-0.627=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.852-0.842=0.010
σ0.041-0.040=0.000
min0.811-0.812=-0.001
max0.915-0.911=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.831=0.004
σ0.030-0.024=0.006
min964.810-964.806=0.004
max964.884-964.861=0.024
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.795-0.756=0.039
σ0.079-0.035=0.043
min0.704-0.717=-0.012
max0.855-0.796=0.059
name=cdr_enhanced_4k_loc.art
mean885.513
σ0.004-0.006=-0.002
min885.508-885.504=0.004
max885.518-885.518=-0.000
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.712-0.731=-0.018
σ0.029-0.009=0.021
min0.669-0.721=-0.052
max0.747-0.740=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean4.217-4.225=-0.008
σ0.091-0.093=-0.002
min4.087-4.084=0.003
max4.691-4.550=0.141
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean4.211-4.245=-0.034
σ0.078-0.103=-0.026
min4.069-4.066=0.003
max4.442-4.614=-0.173
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.735-0.732=0.004
σ0.017-0.029=-0.013
min0.705-0.703=0.002
max0.846-0.913=-0.068
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.698-0.513=0.186
σ0.014-0.048=-0.034
min0.664-0.479=0.185
max0.766-0.806=-0.040

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-295.415=0.159
σ0.218-0.205=0.013
min295.439-295.192=0.247
max296.173-295.873=0.300
mean2033.000-1907.000=126.000
σ0.000
min2033.000-1907.000=126.000
max2033.000-1907.000=126.000
mean0.538-0.579=-0.041
σ0.035-0.051=-0.016
min0.496-0.497=-0.001
max0.575-0.675=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.409=0.001
σ0.036-0.031=0.005
min285.365-285.367=-0.002
max285.445-285.451=-0.006
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.389-0.389=0.000
σ0.008-0.005=0.003
min0.382-0.383=-0.001
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.807=-0.012
σ0.107-0.124=-0.017
min1295.677-1295.675=0.003
max1295.919-1295.977=-0.057
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean1.911-1.917=-0.006
σ0.126-0.105=0.021
min1.800-1.795=0.006
max2.062-2.043=0.019
iters=5
new-facts=6402
prior-facts=1
mean1539.963-1539.916=0.047
σ6.839-6.853=-0.014
min1536.686-1536.650=0.036
max1552.192-1552.172=0.021
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean2.408-2.213=0.194
σ0.166-0.226=-0.060
min2.142-2.018=0.124
max2.590-2.562=0.028
iters=5
new-facts=6402
prior-facts=6402
mean1857.704-1857.710=-0.006
σ0.058-0.058=0.001
min1857.646-1857.640=0.006
max1857.782-1857.783=-0.002
mean1777.800-1771.000=6.800
σ178.887-132.575=46.313
min1620.000-1631.000=-11.000
max2033.000-1907.000=126.000
mean3.124-3.019=0.105
σ0.308-0.189=0.120
min2.854-2.848=0.007
max3.611-3.312=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.316-1.406=-0.090
σ0.293-0.267=0.026
min1.104-1.101=0.004
max1.817-1.713=0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.001
σ580.935-580.935=0.000
min155.271-155.271=-0.000
max1317.142-1317.141=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean0.540-0.541=-0.002
σ0.557-0.557=-0.000
min0.256-0.258=-0.002
max1.376-1.377=-0.002
policies=20
mean1552.994-1552.974=0.019
σ0.333-0.333=-0.000
min1552.765-1552.749=0.016
max1553.488-1553.469=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean2.598-2.589=0.009
σ0.012-0.016=-0.004
min2.587-2.572=0.015
max2.612-2.609=0.003
policies=200
mean15538.052-15537.991=0.061
σ0.081-0.150=-0.069
min15537.969-15537.788=0.181
max15538.129-15538.114=0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1631.000=-11.000
σ0.000
min1620.000-1631.000=-11.000
max1620.000-1631.000=-11.000
mean26.254-26.160=0.094
σ0.195-0.089=0.106
min26.076-26.070=0.006
max26.532-26.267=0.265