Compare commits

Home / Compare 770fc783 .. 589b0547

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.046=-0.014
σ0.369-0.369=-0.001
min53.891-53.892=-0.002
max55.080-55.096=-0.016
mean414.000
σ0.000
min414.000
max414.000
mean0.140-0.139=0.001
σ0.003-0.004=-0.000
min0.137-0.135=0.002
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.006-0.004=0.003
min43.375-43.380=-0.005
max43.397-43.392=0.006
mean414.000
σ0.000
min414.000
max414.000
mean0.122-0.121=0.001
σ0.003-0.004=-0.001
min0.119-0.114=0.005
max0.127-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.979=-0.648
σ0.882-0.868=0.014
min1005.836-1006.480=-0.644
max1009.981-1010.569=-0.588
mean1050.100-1047.100=3.000
σ306.907-315.079=-8.171
min584.000-577.000=7.000
max1648.000-1650.000=-2.000
mean1.545-1.557=-0.012
σ0.076-0.062=0.013
min1.381-1.500=-0.118
max1.651-1.727=-0.076

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.422-0.437=-0.014
σ0.135-0.191=-0.055
min0.343-0.332=0.011
max0.661-0.777=-0.115
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.874-0.906=-0.032
σ0.092-0.153=-0.060
min0.822-0.822=-0.000
max1.036-1.178=-0.141
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.572-0.535=0.037
σ0.061-0.050=0.011
min0.509-0.497=0.013
max0.649-0.616=0.033
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean1.006-0.839=0.167
σ0.328-0.036=0.291
min0.820-0.803=0.017
max1.589-0.896=0.694

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.831=-1.279
σ0.024-0.025=-0.000
min963.523-964.802=-1.279
max963.582-964.861=-1.280
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.821-0.823=-0.002
σ0.044-0.031=0.013
min0.745-0.786=-0.041
max0.852-0.856=-0.003
name=cdr_enhanced_4k_loc.art
mean884.856-885.513=-0.657
σ0.005-0.005=0.000
min884.847-885.504=-0.657
max884.861-885.516=-0.656
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.713-0.701=0.012
σ0.039-0.037=0.001
min0.653-0.643=0.010
max0.741-0.743=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.713-7.720=-0.007
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean3.536-3.480=0.055
σ0.092-0.105=-0.012
min3.380-3.327=0.053
max3.782-4.158=-0.376
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean4.155-3.779=0.376
σ0.272-0.355=-0.083
min3.405-3.310=0.095
max4.541-4.323=0.218
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.747-0.733=0.014
σ0.018-0.019=-0.001
min0.711-0.697=0.014
max0.863-0.849=0.014
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.716-0.693=0.022
σ0.018-0.027=-0.009
min0.685-0.521=0.163
max0.826-0.793=0.033

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.599-295.693=-0.094
σ0.241-0.248=-0.008
min295.462-295.425=0.038
max296.277-296.351=-0.073
mean1903.000-1888.000=15.000
σ0.000
min1903.000-1888.000=15.000
max1903.000-1888.000=15.000
mean0.581-0.565=0.015
σ0.043-0.045=-0.002
min0.533-0.497=0.036
max0.686-0.614=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.252-285.405=-0.153
σ0.038-0.041=-0.003
min285.205-285.360=-0.155
max285.291-285.452=-0.161
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.391-0.384=0.007
σ0.011-0.005=0.006
min0.380-0.378=0.002
max0.406-0.391=0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.200-1295.794=-0.594
σ0.114-0.104=0.010
min1295.077-1295.681=-0.604
max1295.342-1295.923=-0.581
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean1.930-1.923=0.007
σ0.105-0.102=0.004
min1.798-1.810=-0.013
max2.023-2.034=-0.012
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1539.916=-1.841
σ4.010-6.854=-2.844
min1536.032-1536.648=-0.616
max1545.238-1552.173=-6.934
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean2.262-2.231=0.031
σ0.204-0.301=-0.097
min2.006-1.930=0.076
max2.508-2.685=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.709=-0.599
σ0.054-0.054=-0.001
min1857.053-1857.648=-0.595
max1857.183-1857.778=-0.594
mean1772.400-1771.000=1.400
σ127.688-118.030=9.659
min1648.000-1650.000=-2.000
max1903.000-1888.000=15.000
mean3.053-2.995=0.058
σ0.305-0.101=0.203
min2.838-2.860=-0.022
max3.578-3.101=0.477

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.422=-0.053
σ0.276-0.290=-0.014
min1.102-1.110=-0.008
max1.823-1.815=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-445.740=-2.132
σ577.065-580.934=-3.869
min155.075-155.272=-0.197
max1309.206-1317.141=-7.935
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.548-0.525=0.023
σ0.569-0.538=0.032
min0.262-0.256=0.006
max1.402-1.332=0.070
policies=20
mean1551.023-1552.978=-1.956
σ0.316-0.321=-0.005
min1550.806-1552.755=-1.950
max1551.493-1553.455=-1.962
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean2.582-2.579=0.003
σ0.015-0.043=-0.027
min2.571-2.551=0.021
max2.605-2.641=-0.037
policies=200
mean15518.566-15537.863=-19.298
σ0.087-0.133=-0.046
min15518.471-15537.773=-19.302
max15518.676-15538.060=-19.384
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean26.382-26.074=0.308
σ0.167-0.075=0.092
min26.255-25.963=0.292
max26.623-26.122=0.501