This is an archive of the discontinued LLVM Phabricator instance.

[clang-tidy] New feature --skip-headers, part 1, LocationFilter
AbandonedPublic

Authored by chh on Mar 16 2021, 7:22 AM.

Details

Summary

[clang-tidy] New feature --skip-headers, LocationFilter

  • This new feature has impacts similar to --header-filter and --system-headers.
    • Clang-tidy by default checks header files, reports the number of warnings found in header files but not those warning messages.
    • With --header-filter, clang-tidy shows warnings in selected header files, but not system header files.
    • With --system-headers, clang-tidy shows also warnings in system header files.
    • With --skip-headers, clang-tidy does not check header files, and does not know or count warnings in header files. However, if --header-filter or --system-headers are used, those header files will be checked and warnings be counted and displayed.
  • For users who do not need to know the number of not-shown warnings in header files, this feature saves maybe 60% to 80% of clang-tidy run-time, by skipping checks of header files. When building Android system with clang-tidy, repeated checks on commonly included header files in multiple compilation units took significant part of build time, which could be saved by this new feature.
  • Note that this is not the same as PCH, which usually saves parsing time, but not semantic checks or code generation time.
  • This part 1 implementation only affects the MatchFinder-based checks, not the PPCallback-based or the static analyzer checks. Follow up changes could make the other checks to skip header files and save more time.
  • Add a --show-all-warnings flag. It is hidden, not shown by --help. When it is used, ClangTidyDiagnosticConsumer::checkFilters will not suppress any diagnostic message. This is useful to find tidy checks that have not yet handled the --skip-headers flag.
  • Implementation Methods:
    • Factor out LocationFilter in ClangTidyDiagnosticConsumer
      • The skipLocation checks if a location should not be checked.
      • Use simple cache of the last skipped/accepted FileID to minimize the overhead of skipLocation.
    • Add a LocFilter to Tidy's MatchFinderOptions. In MatchASTVisitor::TraverseDecl and TraverseStmt, skip a sub-tree if the MatchFinderOptions has a LocFilter that decides to skip the location.
    • Add an AllFileFinder for checks that need to match all source files.
      • ForwardDeclarationNamespaceCheck is registered as an AllFileCheck, to avoid missing valid warnings on main source files.
      • UnusedUsingDeclsCheck is registered as an AllFileCheck, to avoid incorrect warnings on main source files.
      • Their diag functions call ClangTidyCheck::skipLocation to skip diagnostics on header files.
  • Tests:
    • Add skip-headers*.cpp tests to show the effects of new flags.
    • Add bugprone-forward-declaration-namespace-header.cpp test to show how AllFileMatchFinder-based checks can depend on header Decls.
    • Add new test cases into misc-unused-using-decls.cpp.
    • Extend some clang-tidy checker tests to make sure that --skip-headers skips checks/warnings in the header files: google-namespaces.cpp modernize-pass-by-value-header.cpp
    • Add runs with --skip-headers in some clang-tidy checker tests to make sure that the option does not hide warnings in the main file:
      • about 18 other clang-tools-extra/test/clang-tidy/checkers/*.cpp
    • Some tests were added --skip-headers=0 flag to get expected warning messages in test header files: checkers/abseil-no-internal-dependencies.cpp checkers/abseil-upgrade-duration-conversions.cpp checkers/google-namespaces.cpp infrastructure/file-filter-symlinks.cpp infrastructure/file-filter.cpp infrastructure/line-filter.cpp
    • Some expected no-output lines in skip-headers-1 have FIXME, so they will pass test before the related PPCallbacks checks support the skip-headers option.

Diff Detail

Event Timeline

chh created this revision.Mar 16 2021, 7:22 AM
chh requested review of this revision.Mar 16 2021, 7:22 AM
Herald added a project: Restricted Project. · View Herald TranscriptMar 16 2021, 7:22 AM
chh updated this revision to Diff 339065.Apr 20 2021, 6:12 PM

hide the --show-all-warnings flag from --help

chh updated this revision to Diff 351617.Jun 11 2021, 6:40 PM
chh retitled this revision from clang-tidy skip-headers; Alt#1; fewer changes to [clang-tidy] Add --skip-headers, part 1.
chh edited the summary of this revision. (Show Details)

sync with latest clang/llvm

chh updated this revision to Diff 359271.Jul 16 2021, 3:22 AM
chh retitled this revision from [clang-tidy] Add --skip-headers, part 1 to [clang-tidy] New feature --skip-headers, (tested as default).
chh edited the summary of this revision. (Show Details)

sync with latest source, update more tests to test skip-headers as default

chh updated this revision to Diff 359461.Jul 16 2021, 3:18 PM
chh edited the summary of this revision. (Show Details)

only coding style changes in clang-tidy files, to match other alternative implementation

chh updated this revision to Diff 359531.Jul 16 2021, 10:43 PM
chh retitled this revision from [clang-tidy] New feature --skip-headers, (tested as default) to [clang-tidy] New feature --skip-headers, part 1, skip Decls.
chh edited the summary of this revision. (Show Details)

--skip-headers is set to false by default;
many tidy tests runs are augmented with explicit --skip-headers or --skip-headers=0
to test this feature as on or off.

chh updated this revision to Diff 360336.Jul 20 2021, 6:39 PM
chh edited the summary of this revision. (Show Details)

Add bugprone-forward-declaration-namespace-header.cpp test; fix some coding style warnings.

chh updated this revision to Diff 360649.Jul 21 2021, 5:01 PM
chh edited the summary of this revision. (Show Details)

Add one more skip-headers-2.cpp test.

chh updated this revision to Diff 361295.Jul 23 2021, 12:17 PM
chh retitled this revision from [clang-tidy] New feature --skip-headers, part 1, skip Decls to [clang-tidy] New feature --skip-headers, part 1, LocFilter.
chh edited the summary of this revision. (Show Details)

Add an AllFileFinder for checks that need to match all source files.
ForwardDeclarationNamespaceCheck is registered as an AllFileCheck,

chh updated this revision to Diff 361870.Jul 26 2021, 6:00 PM

add skip-headers-3.cpp test to show that checking only Decl locations is not enough to skip some warnings in header files

chh updated this revision to Diff 362216.Jul 27 2021, 4:15 PM
chh edited the summary of this revision. (Show Details)
  • Use clang-format layout in ClangTidy.cpp and ClangTidyModule.h.
  • Fix misc-unused-using-decls false-positive warning from --skip-headers.
    • UnusedUsingDeclsCheck is now registered as an AllFileCheck.
    • Add new test cases into misc-unused-using-decls.cpp.
chh updated this revision to Diff 362262.Jul 27 2021, 7:09 PM

apply clang-format

chh updated this revision to Diff 362702.Jul 29 2021, 3:37 AM

sync to the latest source; apply clang-format; add new skip-headers-4.cpp test;
skip modernize-use-nullptr warnings in header files in UseNullptrCheck.cpp

This is enhanced implementation over D98710, to handle the new found failed test cases.

chh updated this revision to Diff 367117.Aug 17 2021, 11:05 PM
chh retitled this revision from [clang-tidy] New feature --skip-headers, part 1, LocFilter to [clang-tidy] New feature --skip-headers, part 1, LocationFilter.
chh edited the summary of this revision. (Show Details)

Factor out LocationFilter; improve more test cases.

chh updated this revision to Diff 367330.Aug 18 2021, 2:54 PM

fix windows test failure

chh abandoned this revision.Sep 14 2022, 1:10 PM
Herald added a project: Restricted Project. · View Herald TranscriptSep 14 2022, 1:10 PM