[COMPASS-6529] Consistent tests for BOM chars, file encodings and line endings Created: 17/Feb/23  Updated: 01/Mar/23  Resolved: 21/Feb/23

Status: Closed
Project: Compass
Component/s: None
Affects Version/s: None
Fix Version/s: No version

Type: Task Priority: Major - P3
Reporter: Le Roux Bodenstein Assignee: Le Roux Bodenstein
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Epic Link: COMPASS-5576
Story Points: 2
Documentation Changes: Not Needed

 Description   

What happens if there's a BOM?
What if the encoding is not utf=8?
\r\n vs \n line endings

For all the import and export functions that take text file input readable streams.



 Comments   
Comment by Githook User [ 01/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): import tests for windows line endings, non-utf8 encodings, BOM chars COMPASS-6529 (#4075)

  • import tests for windows line endings, non-utf8 encodings, BOM chars
  • throw when encountering non-utf-8
Comment by Githook User [ 27/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): import tests for windows line endings, non-utf8 encodings, BOM chars COMPASS-6529 (#4075)

  • import tests for windows line endings, non-utf8 encodings, BOM chars
  • throw when encountering non-utf-8
Comment by Githook User [ 27/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): test line endings, utf8, BOM char for listCSVFields() COMPASS-6529 (#4088)

test line endings, utf8, BOM char for listCSVFields()
Branch: bump-mongodb-schema-to-10
https://github.com/mongodb-js/compass/commit/5d2476a19719d9e2e838d2042a178d29e111b09f

Comment by Githook User [ 24/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): import tests for windows line endings, non-utf8 encodings, BOM chars COMPASS-6529 (#4075)

  • import tests for windows line endings, non-utf8 encodings, BOM chars
  • throw when encountering non-utf-8
Comment by Githook User [ 23/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): test line endings, utf8, BOM char for listCSVFields() COMPASS-6529 (#4088)

test line endings, utf8, BOM char for listCSVFields()
Branch: change-result
https://github.com/mongodb-js/compass/commit/5d2476a19719d9e2e838d2042a178d29e111b09f

Comment by Githook User [ 23/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): test line endings, utf8, BOM char for listCSVFields() COMPASS-6529 (#4088)

test line endings, utf8, BOM char for listCSVFields()
Branch: main
https://github.com/mongodb-js/compass/commit/5d2476a19719d9e2e838d2042a178d29e111b09f

Comment by Githook User [ 20/Feb/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: test(import): import tests for windows line endings, non-utf8 encodings, BOM chars COMPASS-6529 (#4075)

  • import tests for windows line endings, non-utf8 encodings, BOM chars
  • throw when encountering non-utf-8
Generated at Wed Feb 07 22:43:28 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.