Compare commits

Home / Compare 9b083bad .. bce4a750

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.001
σ0.369-0.368=0.001
min53.914-53.910=0.003
max55.106-55.101=0.005
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.136-0.139=-0.003
σ0.006-0.004=0.002
min0.130-0.132=-0.002
max0.149-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.005-0.006=-0.000
min43.387-43.384=0.003
max43.402-43.405=-0.003
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.120-0.122=-0.001
σ0.005-0.003=0.002
min0.114-0.118=-0.004
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.927-1007.008=-0.081
σ0.902-1.176=-0.274
min1006.438-1006.435=0.003
max1010.672-1011.930=-1.258
mean1056.050-1045.350=10.700
σ316.402-315.699=0.703
min566.000-569.000=-3.000
max1621.000-1647.000=-26.000
mean1.531-1.538=-0.007
σ0.085-0.082=0.003
min1.351-1.465=-0.114
max1.761-1.740=0.022

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.440-0.413=0.026
σ0.207-0.134=0.073
min0.322-0.329=-0.008
max0.808-0.650=0.158
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.918-0.899=0.018
σ0.168-0.102=0.066
min0.811-0.834=-0.023
max1.215-1.079=0.137
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.001
min1.522
max1.526-1.528=-0.002
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.522-0.544=-0.023
σ0.048-0.048=0.000
min0.485-0.507=-0.022
max0.597-0.622=-0.025
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.827-0.857=-0.030
σ0.031-0.033=-0.002
min0.801-0.830=-0.029
max0.878-0.912=-0.034

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.033-0.020=0.013
min964.810-964.821=-0.011
max964.892-964.872=0.020
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.837-0.844=-0.007
σ0.027-0.023=0.004
min0.804-0.816=-0.012
max0.864-0.862=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.007-0.008=-0.001
min885.505-885.504=0.001
max885.522-885.523=-0.000
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.735-0.737=-0.002
σ0.010-0.008=0.002
min0.717-0.730=-0.013
max0.741-0.748=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean4.238-3.484=0.754
σ0.087-0.092=-0.005
min4.097-3.352=0.745
max4.510-3.772=0.738
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean4.226-3.504=0.722
σ0.098-0.093=0.005
min4.095-3.379=0.716
max4.671-4.174=0.497
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.732-0.541=0.192
σ0.020-0.015=0.005
min0.703-0.512=0.191
max0.882-0.637=0.245
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.701-0.509=0.192
σ0.026-0.014=0.012
min0.561-0.486=0.075
max0.800-0.581=0.219

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.387-296.920=-1.532
σ0.202-0.257=-0.055
min295.203-296.714=-1.511
max295.922-297.612=-1.691
mean1910.000-1957.000=-47.000
σ0.000
min1910.000-1957.000=-47.000
max1910.000-1957.000=-47.000
mean0.560-0.545=0.014
σ0.029-0.032=-0.003
min0.508-0.510=-0.002
max0.612-0.580=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.358-286.822=-1.464
σ0.033-0.041=-0.008
min285.311-286.765=-1.454
max285.396-286.865=-1.470
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.386-0.396=-0.010
σ0.006-0.011=-0.005
min0.381-0.387=-0.006
max0.396-0.413=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.744-1297.271=-1.527
σ0.114-0.096=0.017
min1295.629-1297.157=-1.528
max1295.883-1297.411=-1.528
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean1.936-2.285=-0.348
σ0.114-0.081=0.033
min1.804-2.154=-0.351
max2.037-2.359=-0.322
iters=5
new-facts=6402
prior-facts=1
mean1538.595-1540.117=-1.521
σ4.000-3.983=0.017
min1536.567-1538.179=-1.612
max1545.742-1547.237=-1.494
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean2.302-2.349=-0.048
σ0.247-0.091=0.156
min2.001-2.237=-0.236
max2.660-2.440=0.220
iters=5
new-facts=6402
prior-facts=6402
mean1857.640-1859.123=-1.483
σ0.067-0.064=0.003
min1857.563-1859.037=-1.474
max1857.735-1859.201=-1.466
mean1776.400-1782.000=-5.600
σ137.369-114.728=22.641
min1621.000-1647.000=-26.000
max1910.000-1957.000=-47.000
mean3.056-2.983=0.073
σ0.264-0.179=0.085
min2.852-2.833=0.019
max3.516-3.258=0.258

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.150=0.054
σ0.298-0.276=0.022
min0.940-0.938=0.002
max1.693-1.610=0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.829-447.159=-3.330
σ577.319-578.048=-0.729
min155.168-158.130=-2.961
max1309.808-1314.231=-4.423
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean0.536-0.568=-0.032
σ0.550-0.603=-0.053
min0.258-0.265=-0.007
max1.361-1.472=-0.111
policies=20
mean1551.926-1581.611=-29.685
σ0.336-0.358=-0.023
min1551.698-1581.370=-29.672
max1552.425-1582.144=-29.719
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean2.597-2.636=-0.038
σ0.013-0.020=-0.007
min2.578-2.609=-0.030
max2.605-2.654=-0.048
policies=200
mean15527.597-15824.126=-296.528
σ0.163-0.123=0.041
min15527.463-15823.951=-296.488
max15527.827-15824.229=-296.402
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1647.000=-26.000
σ0.000
min1621.000-1647.000=-26.000
max1621.000-1647.000=-26.000
mean26.120-26.659=-0.539
σ0.043-0.071=-0.028
min26.073-26.606=-0.533
max26.157-26.761=-0.604