GitLab

- Add `remove_invalid_surrogates` function to filter out invalid UTF-16 surrogate pairs
- Integrate the new function into the `detect_lang` workflow
- Include a test case with UTF-16 surrogates to verify the fix

- Improve language detection by removing newline characters from the input text
- Add error handling and fallback mechanism to deal with text containing control characters