[git-llvm] Fix eol conversion on Windows for explicit CRLF files

[zturner]

Summary

We were checking for 'native', but we weren't considering files that are explicitly EOL. Secondly, dos2unix does not have a -q option on Windows (how did that even work for you?), so if the command fails we retry without -q.

[rnk]

llvm/utils/git-svn/git-llvm

242

if crlf_files: is more python-y

248

-q is for quiet. My goal was to suppress all warning output. Instead, you could probably do:

shell(['dos2unix'] + crlf_files, ignore_errors=True)

I don't remember what warnings I saw, but they were annoying.

[zturner]

I never got around to getting this committed, but incidentally I built a new machine over the weekend and ran into the same problem *plus* an additional problem which is that with Python 3, git apply doesn't like it when universal_newlines is set to true. Without this additional changes, it is impossible to push anything using the following configuration:

Windows 10
Git 2.18.0.windows.1
Python 3.7.0 32-bit
Running git llvm push from a cmd prompt.

[rnk]

lgtm

In D51444#1257498, @zturner wrote:

Python 3.7.0 32-bit

^ There's your problem =P

[zturner]

In D51444#1258115, @rnk wrote:

lgtm

In D51444#1257498, @zturner wrote:

Python 3.7.0 32-bit

^ There's your problem =P

I know, I know. But we claim to support Python 3, and honestly this is going to be the most likely configuration for new users, because people will just go to the download page and hit download, and that's what they'll get.

llvm/utils/git-svn/git-llvm

def fix_eol_style_native(rev, sr, svn_sr_path):
     files = [f for f in files if os.path.exists(os.path.join(svn_sr_path, f))]
     # Use ignore_errors because 'svn propget' prints errors if the file doesn't
     # have the named property. There doesn't seem to be a way to suppress that.
     eol_props = svn(svn_sr_path, 'propget', 'svn:eol-style', *files,
                     ignore_errors=True)
     crlf_files = []
     if len(files) == 1:
         # No need to split propget output on ' - ' when we have one file.
-        if eol_props.strip() == 'native':
+        if eol_props.strip() in ['native', 'CRLF']:
             crlf_files = files
     else:
         for eol_prop in eol_props.split('\n'):
             # Remove spare CR.
             eol_prop = eol_prop.strip('\r')
             if not eol_prop:
                 continue
             prop_parts = eol_prop.rsplit(' - ', 1)
             if len(prop_parts) != 2:
                 eprint("unable to parse svn propget line:")
                 eprint(eol_prop)
                 continue
             (f, eol_style) = prop_parts
-            if eol_style == 'native':
+            if eol_style in ['native', 'CRLF']:
                 crlf_files.append(f)
-    # Reformat all files with native SVN line endings to Unix format. SVN knows
-    # files with native line endings are text files. It will commit just the
-    # diff, and not a mass line ending change.
-    shell(['dos2unix', '-q'] + crlf_files, cwd=svn_sr_path)
+    if len(crlf_files) > 0:
+        # Reformat all files with native/CRLF SVN line endings to Unix format. SVN knows
+        # files with CRLF line endings are text files. It will commit just the diff,
+        # and not a mass line ending change.
+        try:
+            # GnuWin32 dos2unix doesn't have the -q option.
+            shell(['dos2unix', '-q'] + crlf_files, die_on_failure=False, cwd=svn_sr_path)
+        except RuntimeError:
+            shell(['dos2unix'] + crlf_files, die_on_failure=True, cwd=svn_sr_path)
 
 
 def svn_push_one_rev(svn_repo, rev, dry_run):
     files = git('diff-tree', '--no-commit-id', '--name-only', '-r',
                 rev).split('\n')
     subrepos = {first_dirname(f) for f in files}
     if not subrepos:
         raise RuntimeError('Empty diff for rev %s?' % rev)