Compare commits

Home / Compare e2b2b451 .. cb381663

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.704=0.007
σ0.368-0.370=-0.002
min53.572-53.566=0.006
max54.758-54.758=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.149-0.139=0.010
σ0.012-0.004=0.008
min0.131-0.134=-0.003
max0.164-0.145=0.019
cache=y
dps=1
iters=10
policies=100
mean43.058-43.059=-0.001
σ0.007-0.006=0.001
min43.047-43.053=-0.006
max43.069-43.070=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.122=-0.001
σ0.004-0.004=-0.000
min0.115-0.119=-0.004
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.109-1005.107=0.003
σ0.892-0.885=0.007
min1004.641-1004.639=0.001
max1008.795-1008.774=0.021
mean1047.350-1052.500=-5.150
σ297.447-320.512=-23.065
min592.000-552.000=40.000
max1438.000-1631.000=-193.000
mean1.632-1.634=-0.001
σ0.079-0.100=-0.020
min1.496-1.496=0.001
max1.854-1.879=-0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.906-0.883=0.023
σ0.002
min0.904-0.881=0.023
max0.908-0.886=0.023
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.430-0.413=0.017
σ0.153-0.121=0.031
min0.340-0.327=0.013
max0.700-0.623=0.077
name=error_case.art
mean2.335-2.333=0.001
σ0.003
min2.333-2.332=0.001
max2.339-2.337=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.871-0.883=-0.012
σ0.093-0.086=0.008
min0.810-0.823=-0.013
max1.034-1.034=-0.001
name=heavy_item.art
mean1.522-1.521=0.001
σ0.002
min1.521-1.520=0.001
max1.525-1.524=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.544-0.546=-0.003
σ0.056-0.047=0.009
min0.503-0.515=-0.012
max0.640-0.627=0.013
name=nested_use.art
mean2.357-2.355=0.001
σ0.002
min2.356-2.355=0.001
max2.360-2.358=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.842-0.841=0.002
σ0.040-0.039=0.001
min0.803-0.809=-0.006
max0.908-0.907=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.430-963.552=0.878
σ0.033-0.025=0.008
min964.412-963.523=0.889
max964.488-963.584=0.904
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.806-0.819=-0.013
σ0.063-0.029=0.034
min0.700-0.783=-0.084
max0.860-0.850=0.010
name=cdr_enhanced_4k_loc.art
mean885.846-884.856=0.990
σ0.006-0.005=0.001
min885.839-884.847=0.992
max885.853-884.860=0.993
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.680-0.724=-0.044
σ0.077-0.031=0.046
min0.549-0.673=-0.124
max0.738-0.746=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708-7.706=0.001
σ0.002-0.002=-0.000
min7.707-7.705=0.001
max7.711-7.712=-0.002
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean4.235-4.229=0.007
σ0.084-0.081=0.003
min4.112-4.105=0.007
max4.538-4.543=-0.005
name=record_render_large_syntax_err.art
mean7.656-7.655=0.002
σ0.002-0.002=0.000
min7.655-7.654=0.001
max7.659-7.658=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean4.265-4.214=0.051
σ0.077-0.071=0.006
min4.127-4.053=0.075
max4.505-4.491=0.013
name=record_render_success.art
mean2.289-2.288=0.001
σ0.002
min2.289-2.287=0.001
max2.292-2.291=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.751-0.751=0.001
σ0.019-0.018=0.001
min0.716-0.716=0.000
max0.869-0.856=0.013
name=record_render_syntax_err.art
mean2.165-2.163=0.001
σ0.002
min2.164-2.163=0.001
max2.168-2.166=0.001
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.718-0.712=0.006
σ0.017-0.015=0.002
min0.688-0.678=0.010
max0.795-0.768=0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.147-294.260=-0.113
σ0.250-0.270=-0.020
min293.914-294.066=-0.152
max294.728-294.977=-0.250
mean2020.000-2038.000=-18.000
σ0.000
min2020.000-2038.000=-18.000
max2020.000-2038.000=-18.000
mean0.556-0.553=0.003
σ0.036-0.033=0.002
min0.502-0.501=0.001
max0.592-0.584=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.492=0.005
σ0.034-0.034=0.001
min281.457-281.444=0.013
max281.539-281.525=0.013
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.390-0.387=0.003
σ0.006-0.006=0.000
min0.386-0.378=0.008
max0.402-0.394=0.008
iters=5
new-facts=1
prior-facts=6402
mean1291.489-1291.478=0.010
σ0.118-0.110=0.008
min1291.356-1291.355=0.001
max1291.642-1291.606=0.036
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean1.875-1.921=-0.046
σ0.086-0.111=-0.025
min1.796-1.794=0.002
max2.007-2.065=-0.058
iters=5
new-facts=6402
prior-facts=1
mean1534.336-1534.331=0.005
σ4.076-4.059=0.017
min1532.294-1532.294=0.000
max1541.618-1541.582=0.036
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean2.371-2.365=0.006
σ0.379-0.343=0.035
min2.034-2.019=0.015
max2.931-2.852=0.078
iters=5
new-facts=6402
prior-facts=6402
mean1853.349-1853.357=-0.008
σ0.057-0.049=0.008
min1853.298-1853.303=-0.005
max1853.428-1853.424=0.004
mean1725.800-1782.400=-56.600
σ231.141-177.765=53.376
min1438.000-1631.000=-193.000
max2020.000-2038.000=-18.000
mean3.010-2.878=0.132
σ0.297-0.049=0.248
min2.833-2.841=-0.008
max3.530-2.962=0.569

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.835-1.368=0.466
σ0.051-0.343=-0.292
min1.780-1.110=0.670
max1.899-1.936=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.514-442.426=0.088
σ577.234-577.065=0.169
min153.896-153.891=0.005
max1308.365-1308.024=0.341
mean96.250
σ8.500
min92.000
max109.000
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean0.540-0.519=0.021
σ0.562-0.518=0.044
min0.258-0.258=0.001
max1.384-1.296=0.087
policies=20
mean1539.225-1539.196=0.030
σ0.318-0.319=-0.001
min1539.005-1538.976=0.029
max1539.698-1539.669=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean2.578-2.569=0.009
σ0.011-0.012=-0.002
min2.563-2.558=0.005
max2.588-2.587=0.002
policies=200
mean15400.394-15400.376=0.018
σ0.102-0.141=-0.039
min15400.246-15400.235=0.011
max15400.465-15400.554=-0.089
mean9200.000
σ0.000
min9200.000
max9200.000
mean1438.000-1631.000=-193.000
σ0.000
min1438.000-1631.000=-193.000
max1438.000-1631.000=-193.000
mean26.032-26.080=-0.047
σ0.076-0.132=-0.057
min25.960-25.980=-0.020
max26.134-26.274=-0.140