Compare commits

Home / Compare 66b1b4d1 .. 89e8e23b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.054=0.003
σ0.370-0.368=0.002
min53.908-53.911=-0.003
max55.109-55.101=0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.141=-0.002
σ0.004-0.003=0.001
min0.134-0.138=-0.003
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.001
σ0.006-0.006=0.000
min43.385-43.387=-0.002
max43.403-43.405=-0.002
mean415.100-415.000=0.100
σ0.316-0.000=0.316
min415.000
max416.000-415.000=1.000
mean0.122-0.122=0.001
σ0.004-0.005=-0.001
min0.118-0.115=0.003
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1007.004=-0.042
σ0.904-1.198=-0.293
min1006.487-1006.460=0.027
max1010.713-1012.026=-1.313
mean1050.600-1038.650=11.950
σ310.102-298.683=11.419
min551.000-580.000=-29.000
max1643.000-1584.000=59.000
mean1.561-1.556=0.005
σ0.119-0.091=0.028
min1.471-1.484=-0.013
max1.841-1.807=0.035

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.425-0.414=0.011
σ0.141-0.129=0.012
min0.325-0.338=-0.013
max0.665-0.642=0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.879-0.887=-0.008
σ0.109-0.095=0.015
min0.815-0.828=-0.013
max1.073-1.054=0.019
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.528-0.536=-0.008
σ0.049-0.052=-0.003
min0.478-0.497=-0.019
max0.611-0.626=-0.015
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.838-0.835=0.003
σ0.044-0.041=0.002
min0.805-0.798=0.007
max0.914-0.904=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.831=0.009
σ0.034-0.026=0.008
min964.811-964.803=0.008
max964.896-964.862=0.034
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.848-0.842=0.006
σ0.028-0.021=0.007
min0.799-0.805=-0.007
max0.867-0.859=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.008=-0.002
min885.505-885.504=0.001
max885.518-885.523=-0.005
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.726-0.721=0.005
σ0.023-0.026=-0.003
min0.686-0.688=-0.002
max0.740-0.744=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean4.244-4.184=0.060
σ0.087-0.069=0.018
min4.116-4.061=0.055
max4.480-4.480=0.000
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean4.257-4.204=0.053
σ0.080-0.075=0.005
min4.124-4.076=0.049
max4.517-4.492=0.025
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.744-0.738=0.005
σ0.027-0.018=0.009
min0.607-0.708=-0.100
max0.855-0.838=0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.701-0.697=0.004
σ0.023-0.016=0.007
min0.586-0.668=-0.082
max0.797-0.791=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.426-296.854=-1.429
σ0.268-0.221=0.047
min295.280-296.664=-1.384
max296.172-297.457=-1.285
mean1913.000-1923.000=-10.000
σ0.000
min1913.000-1923.000=-10.000
max1913.000-1923.000=-10.000
mean0.574-0.582=-0.008
σ0.033-0.043=-0.010
min0.535-0.510=0.025
max0.635-0.653=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-286.826=-1.432
σ0.038-0.036=0.002
min285.350-286.778=-1.429
max285.434-286.862=-1.428
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.390-0.395=-0.005
σ0.008-0.013=-0.005
min0.380-0.386=-0.006
max0.397-0.419=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1297.275=-1.493
σ0.117-0.088=0.029
min1295.655-1297.170=-1.514
max1295.926-1297.403=-1.476
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean1.898-2.242=-0.344
σ0.075-0.051=0.024
min1.809-2.175=-0.366
max1.982-2.299=-0.317
iters=5
new-facts=6402
prior-facts=1
mean1539.897-1541.341=-1.444
σ6.868-6.827=0.041
min1536.643-1538.127=-1.483
max1552.178-1553.551=-1.372
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean2.230-2.248=-0.018
σ0.195-0.153=0.041
min2.035-2.111=-0.076
max2.472-2.452=0.020
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1859.109=-1.426
σ0.063-0.071=-0.008
min1857.613-1859.023=-1.410
max1857.770-1859.192=-1.422
mean1772.400-1759.400=13.000
σ135.579-161.757=-26.177
min1643.000-1584.000=59.000
max1913.000-1923.000=-10.000
mean3.130-2.995=0.135
σ0.373-0.185=0.188
min2.862-2.836=0.025
max3.785-3.305=0.480

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.387=-0.149
σ0.376-0.427=-0.052
min0.930-0.931=-0.001
max1.851-1.857=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.705-448.821=-3.117
σ580.934-581.372=-0.438
min155.236-158.134=-2.899
max1317.106-1320.879=-3.773
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean0.526-0.561=-0.034
σ0.528-0.586=-0.058
min0.262-0.263=-0.001
max1.319-1.440=-0.121
policies=20
mean1552.633-1581.626=-28.992
σ0.333-0.362=-0.028
min1552.401-1581.384=-28.983
max1553.128-1582.164=-29.036
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean2.590-2.642=-0.052
σ0.016-0.012=0.004
min2.571-2.629=-0.058
max2.609-2.655=-0.046
policies=200
mean15534.642-15824.145=-289.503
σ0.134-0.141=-0.008
min15534.555-15824.012=-289.457
max15534.839-15824.344=-289.505
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1584.000=59.000
σ0.000
min1643.000-1584.000=59.000
max1643.000-1584.000=59.000
mean26.082-26.618=-0.536
σ0.055-0.098=-0.044
min26.049-26.522=-0.474
max26.163-26.755=-0.592