Mark 9 lldb unit tests for ubuntu as XFAIL

[DougSnyder]

Summary

the following lldb unit tests fail check-lldb on ubuntu.
TestDataFormatterStdMap.py
TestDataFormatterStdVBool.py
TestDataFormatterStdVector.py
TestDataFormatterSynthVal.py
TestEvents.py
TestInitializerList.py
TestMemoryHistory.py
TestReportData.py
TestValueVarUpdate.py

these unit test failures are for non-core functionality. the intent is to reduce the check-lldb FAILS to core functionality FAILS and then circle back later and fix these FAILS at a later date.

in these unit tests, various sub-tests have been decorated with @expectedFailureLinux if the sub-test was failing or @skipIfLinux if the sub-test was procedurally erroring-out after it passed

[kubamracek]

I'm fine with disabling the ASan tests on Linux.

[vharron]

Siva, I think it would be super helpful if you could add comments to these
xfail/skips that describe the cause and/or recommended fix?

[sivachandra]

On linux, clang (and gcc ofcourse) links to libstdc++. So, the data formatters fail if the version of libstdc++ on the system is not the same as that supported by the data formatters. Look at this bug for more info: http://llvm.org/bugs/show_bug.cgi?id=15301. Comment #8 actually lists the combinations under which they fail/pass.

About TestInitializerList, I think it is a data formatter for initializer_list coming from libc++ and AFAICT, there is no formatter for the one coming from libstdc++.

About the tests which are not data formatter related but are being marked as XFAIL in this patch, the idea here is to start at a known green state for Ubuntu/Linux with respect to a core/basic debugger functionality. We will definitely revisit them and fix them (if they are not already done by somebody else). For example TestEvents and TestValueVarUpdate are related to Python API and should not be treated (IMO atleast) as core debugger functionality.

[kubamracek]

This attempts to make the ASan tests work on Linux.

• http://reviews.llvm.org/D6272 [lldb] Add @skipIfAddressSanitizerUnsupported test decorator

[sivachandra]

Can this change go in?

[vharron]

I'm not seeing any objections. Please submit and we'll revert specific
teats as necessary.

test/functionalities/asan/TestMemoryHistory.py

 
     @skipIfFreeBSD # llvm.org/pr21136 runtimes not yet available by default
     @skipIfRemote
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @dwarf_test
     def test_with_dwarf (self):
         compiler = self.findBuiltClang ()

test/functionalities/asan/TestReportData.py

 
     @skipIfFreeBSD # llvm.org/pr21136 runtimes not yet available by default
     @skipIfRemote
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @dwarf_test
     def test_with_dwarf (self):
         compiler = self.findBuiltClang ()

test/functionalities/data-formatter/data-formatter-stl/libcxx/initializerlist/TestInitializerList.py

 import lldbinline
+from lldbtest import *
 
-lldbinline.MakeInlineTest(__file__, globals())
+# added decorator to mark as XFAIL for Linux
+# non-core functionality, need to reenable and fix later (DES 2014.11.07)
+lldbinline.MakeInlineTest(__file__, globals(),expectedFailureLinux)

test/functionalities/data-formatter/data-formatter-stl/libstdcpp/map/TestDataFormatterStdMap.py

                # assert DeclCXX.h:554 queried property of class with no definition
     @expectedFailureIcc   # llvm.org/pr15301: LLDB prints incorrect size of
                           # libstdc++ containers
-    @skipIfFreeBSD                      
+    @skipIfFreeBSD 
+    @skipIfLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07) 
+    # expectedFailureLinux does not get desired results since test passes and then procedurally errors out
+    #@expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)                     
     @dwarf_test
     def test_with_dwarf_and_run_command(self):
         """Test data formatter commands."""

test/functionalities/data-formatter/data-formatter-stl/libstdcpp/vbool/TestDataFormatterStdVBool.py

         self.data_formatter_commands()
 
     @expectedFailureFreeBSD("llvm.org/pr20548") # fails to build on lab.llvm.org buildbot
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @dwarf_test
     @skipIfDarwin
     def test_with_dwarf_and_run_command(self):

test/functionalities/data-formatter/data-formatter-stl/libstdcpp/vector/TestDataFormatterStdVector.py

 
     @dwarf_test
     @skipIfFreeBSD
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @expectedFailureIcc # llvm.org/pr15301 LLDB prints incorrect sizes of STL containers
     @expectedFailureGcc # llvm.org/pr17499 The data formatter cannot parse STL containers
     def test_with_dwarf_and_run_command(self):

test/functionalities/data-formatter/data-formatter-synthval/TestDataFormatterSynthVal.py

         self.data_formatter_commands()
 
     @skipIfFreeBSD # llvm.org/pr20545 bogus output confuses buildbot parser
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @dwarf_test
     def test_with_dwarf_and_run_command(self):
         """Test using Python synthetic children provider to provide a value."""

test/python_api/event/TestEvents.py

         self.buildDsym()
         self.do_wait_for_event()
 
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @python_api_test
     @dwarf_test
     def test_wait_for_event_with_dwarf(self):

         self.do_add_listener_to_broadcaster()
 
     @skipIfFreeBSD # llvm.org/pr21325
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @python_api_test
     @dwarf_test
     def test_add_listener_to_broadcaster_with_dwarf(self):

test/python_api/value_var_update/TestValueVarUpdate.py

         self.setTearDownCleanup(dictionary=self.d)
         self.do_test()
 
+    @expectedFailureLinux # non-core functionality, need to reenable and fix later (DES 2014.11.07)
     @python_api_test
     @dwarf_test
     def test_with_dwarf_and_process_launch_api(self):