Compare commits

Home / Compare 6648ea16 .. ca696dfd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.704=0.001
σ0.365-0.370=-0.005
min53.565-53.556=0.008
max54.744-54.757=-0.013
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.137-0.138=-0.000
σ0.005-0.006=-0.000
min0.130-0.129=0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.059-43.058=0.001
σ0.007-0.006=0.001
min43.049-43.047=0.002
max43.069-43.065=0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.120=0.001
σ0.004-0.005=-0.002
min0.118-0.115=0.004
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1005.101=0.003
σ0.894-0.888=0.006
min1004.640-1004.635=0.005
max1008.809-1008.782=0.027
mean1050.200-1044.600=5.600
σ315.471-293.905=21.565
min593.000-575.000=18.000
max1653.000-1462.000=191.000
mean1.617-1.621=-0.003
σ0.106-0.063=0.043
min1.450-1.513=-0.063
max1.895-1.745=0.151

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.448-0.410=0.038
σ0.127-0.122=0.004
min0.368-0.330=0.038
max0.671-0.624=0.047
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.909-0.872=0.036
σ0.095-0.088=0.007
min0.834-0.819=0.014
max1.072-1.026=0.045
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.546-0.538=0.008
σ0.057-0.055=0.001
min0.492-0.495=-0.003
max0.637-0.634=0.003
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.877-0.872=0.005
σ0.066-0.069=-0.003
min0.808-0.816=-0.009
max0.963-0.973=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.541=0.011
σ0.025-0.028=-0.003
min963.524-963.523=0.001
max963.584-963.590=-0.006
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.835-0.824=0.011
σ0.030-0.052=-0.022
min0.797-0.738=0.059
max0.865-0.860=0.005
name=cdr_enhanced_4k_loc.art
mean884.857-884.853=0.003
σ0.007-0.006=0.001
min884.847
max884.866-884.860=0.006
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.737-0.729=0.008
σ0.021-0.016=0.005
min0.705-0.704=0.001
max0.758-0.742=0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.001
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean4.321-4.274=0.047
σ0.080-0.070=0.011
min4.202-4.143=0.059
max4.698-4.536=0.163
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean3.929-4.260=-0.331
σ0.374-0.081=0.292
min3.452-4.129=-0.677
max4.547-4.602=-0.055
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.768-0.744=0.024
σ0.035-0.019=0.016
min0.569-0.712=-0.143
max0.891-0.859=0.032
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.567-0.705=-0.138
σ0.094-0.015=0.079
min0.487-0.677=-0.190
max0.815-0.798=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.194-294.415=-0.221
σ0.216-0.239=-0.023
min293.912-294.241=-0.329
max294.629-295.072=-0.443
mean2026.000-1906.000=120.000
σ0.000
min2026.000-1906.000=120.000
max2026.000-1906.000=120.000
mean0.545-0.574=-0.029
σ0.035-0.040=-0.005
min0.504-0.506=-0.002
max0.592-0.656=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.495-281.497=-0.002
σ0.041-0.037=0.004
min281.445-281.453=-0.008
max281.537-281.537=-0.000
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.394-0.393=0.001
σ0.008-0.006=0.002
min0.384-0.387=-0.003
max0.400-0.400=0.000
iters=5
new-facts=1
prior-facts=6402
mean1291.483-1291.475=0.008
σ0.104-0.104=-0.000
min1291.366-1291.348=0.019
max1291.624-1291.591=0.033
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean1.882-2.009=-0.127
σ0.095-0.275=-0.180
min1.796-1.818=-0.022
max2.028-2.484=-0.455
iters=5
new-facts=6402
prior-facts=1
mean1534.349-1534.328=0.021
σ3.999-4.005=-0.006
min1532.358-1532.278=0.080
max1541.497-1541.483=0.014
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean2.177-2.271=-0.094
σ0.165-0.194=-0.029
min2.009-2.044=-0.034
max2.420-2.486=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1853.355=0.002
σ0.048-0.051=-0.003
min1853.300-1853.305=-0.005
max1853.414-1853.426=-0.011
mean1784.400-1759.600=24.800
σ163.995-171.024=-7.029
min1653.000-1505.000=148.000
max2026.000-1906.000=120.000
mean2.906-2.968=-0.062
σ0.075-0.087=-0.012
min2.838-2.882=-0.043
max2.992-3.108=-0.116

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.379-1.812=-0.433
σ0.267-0.095=0.172
min1.102-1.691=-0.590
max1.816-1.937=-0.121

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.428=-0.002
σ577.065-577.065=-0.000
min153.893-153.894=-0.001
max1308.023-1308.025=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean0.543-0.555=-0.012
σ0.569-0.595=-0.026
min0.257-0.257=0.000
max1.397-1.448=-0.051
policies=20
mean1539.203-1539.217=-0.014
σ0.332-0.328=0.004
min1538.974-1538.992=-0.018
max1539.697-1539.705=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean2.592-2.583=0.009
σ0.015-0.027=-0.012
min2.574-2.567=0.007
max2.608-2.622=-0.015
policies=200
mean15400.276-15400.382=-0.106
σ0.065-0.113=-0.048
min15400.217-15400.219=-0.002
max15400.356-15400.482=-0.126
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1462.000=191.000
σ0.000
min1653.000-1462.000=191.000
max1653.000-1462.000=191.000
mean26.094-26.118=-0.024
σ0.025-0.089=-0.064
min26.063-26.018=0.045
max26.123-26.213=-0.090