Compare commits

Home / Compare 94405c49 .. 37cb4d73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.001
σ0.368-0.371=-0.003
min53.914-53.909=0.006
max55.103-55.110=-0.007
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.141-0.139=0.002
σ0.004-0.005=-0.001
min0.135-0.132=0.003
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.006-0.008=-0.002
min43.387-43.377=0.010
max43.405-43.405=0.000
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.121=0.002
σ0.002-0.004=-0.002
min0.120-0.118=0.003
max0.129-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.024-1007.021=0.003
σ1.187-1.195=-0.008
min1006.453-1006.453=0.000
max1011.998-1012.031=-0.033
mean1048.900-1055.850=-6.950
σ310.255-316.796=-6.541
min562.000-561.000=1.000
max1629.000-1621.000=8.000
mean1.541-1.526=0.015
σ0.078-0.051=0.027
min1.468-1.459=0.009
max1.810-1.637=0.172

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.001
min0.882
max0.889-0.887=0.002
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.421-0.463=-0.042
σ0.127-0.199=-0.072
min0.344-0.349=-0.006
max0.645-0.817=-0.172
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.899-0.954=-0.055
σ0.093-0.184=-0.091
min0.825-0.848=-0.023
max1.054-1.281=-0.227
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.544-0.552=-0.008
σ0.055-0.046=0.009
min0.503-0.516=-0.013
max0.640-0.629=0.011
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.861-0.874=-0.013
σ0.039-0.035=0.004
min0.827-0.848=-0.022
max0.925-0.934=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.829=0.001
σ0.024-0.024=0.000
min964.803-964.802=0.001
max964.861-964.858=0.003
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.858-0.827=0.031
σ0.017-0.069=-0.052
min0.828-0.709=0.119
max0.871-0.874=-0.003
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.000
σ0.008-0.009=-0.001
min885.504
max885.524-885.524=-0.000
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.730-0.741=-0.011
σ0.014-0.013=0.001
min0.709-0.724=-0.014
max0.740-0.759=-0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean4.313-4.281=0.032
σ0.071-0.088=-0.017
min4.170-4.110=0.059
max4.661-4.618=0.044
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean4.287-4.275=0.012
σ0.054-0.070=-0.016
min4.190-4.116=0.074
max4.456-4.504=-0.048
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.765-0.767=-0.002
σ0.036-0.020=0.016
min0.723-0.733=-0.010
max1.000-0.884=0.116
name=record_render_syntax_err.art
mean2.166-2.166=0.000
σ0.002-0.002=0.000
min2.165
max2.170-2.169=0.001
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.730-0.724=0.007
σ0.015-0.016=-0.001
min0.692-0.692=0.001
max0.808-0.793=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.172-296.981=0.191
σ0.209-0.198=0.011
min297.014-296.860=0.154
max297.742-297.524=0.218
mean2019.000-1906.000=113.000
σ0.000
min2019.000-1906.000=113.000
max2019.000-1906.000=113.000
mean0.551-0.585=-0.035
σ0.030-0.055=-0.025
min0.508-0.504=0.004
max0.581-0.705=-0.123

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.841-286.836=0.005
σ0.041-0.040=0.001
min286.788-286.779=0.008
max286.881-286.875=0.007
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.398-0.392=0.005
σ0.008-0.005=0.003
min0.388-0.388=0.001
max0.408-0.400=0.008
iters=5
new-facts=1
prior-facts=6402
mean1297.291-1297.194=0.097
σ0.100-0.105=-0.005
min1297.193-1297.109=0.084
max1297.436-1297.366=0.070
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean2.003-1.932=0.071
σ0.027-0.193=-0.166
min1.974-1.751=0.223
max2.048-2.226=-0.178
iters=5
new-facts=6402
prior-facts=1
mean1541.349-1541.353=-0.004
σ6.858-6.816=0.042
min1538.081-1538.171=-0.090
max1553.612-1553.544=0.067
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean2.296-2.236=0.060
σ0.151-0.204=-0.053
min2.158-2.050=0.108
max2.542-2.563=-0.021
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1859.134=-0.016
σ0.077-0.054=0.023
min1858.994-1859.073=-0.079
max1859.188-1859.203=-0.014
mean1763.400-1769.800=-6.400
σ168.377-135.234=33.143
min1629.000-1621.000=8.000
max2019.000-1906.000=113.000
mean2.886-3.084=-0.198
σ0.214-0.270=-0.056
min2.561-2.875=-0.314
max3.104-3.539=-0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.366-1.389=-0.023
σ0.278-0.272=0.006
min1.110-1.234=-0.124
max1.842-1.872=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.853-448.855=-0.002
σ581.373-581.372=0.001
min158.165-158.167=-0.003
max1320.912-1320.913=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean0.540-0.551=-0.011
σ0.549-0.577=-0.029
min0.264-0.259=0.005
max1.363-1.417=-0.054
policies=20
mean1581.963-1581.959=0.004
σ0.360-0.356=0.004
min1581.719-1581.715=0.004
max1582.498-1582.488=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean2.629-2.634=-0.006
σ0.015-0.010=0.005
min2.612-2.626=-0.014
max2.649-2.648=0.001
policies=200
mean15827.606-15827.546=0.061
σ0.094-0.052=0.042
min15827.530-15827.509=0.022
max15827.744-15827.623=0.121
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1621.000=8.000
σ0.000
min1629.000-1621.000=8.000
max1629.000-1621.000=8.000
mean26.603-26.602=0.001
σ0.053-0.040=0.013
min26.551-26.570=-0.019
max26.678-26.655=0.023