Questions tagged [byte-order-mark]

A byte order mark (BOM) is a Unicode character used to signal the order of bytes in a text file or stream. As the BOM is U+FEFF, it makes it clear whether the high-order bytes are first (stream starts FE.FF) or second (stream starts FF.FE).

Filter by
Sorted by
Tagged with
1 vote
1 answer
21 views

BOM: binary output from Oracle xquery

We need to write UTF-8 csv file from the OSB. To make Excel open it correctly we need to add BOM sequence EFBBBF at the beginning of the file. Is it possible to append binary data to the body, which ...
Dmytro's user avatar
  • 33
0 votes
1 answer
34 views

Prevent addition of a BOM to UTF-8 SecureCRT session logged files

SecureCRT appears to be adding a BOM to all session logged files no matter what character encoding is selected. When UTF-8 is used, SecureCRT generates a UTF-8 with BOM file rather than a simple UTF-...
Nicholas Sparrow's user avatar
0 votes
1 answer
50 views

Remove UTF-8 BOM from TStream output

I'm using Delphi 11. I have to write a UTF-8 .csv file without a BOM using a TStream object, but using TEncoding.UTF8 produces a UTF-8 file with a BOM, so I tried using the encoding directly without ...
Franz Andreani's user avatar
0 votes
1 answer
111 views

PHP / Output file Encoding / Changing from ANSI to UTF-8-BOM

Is there a way to prevent PHP to auto-changing encoding for Excel-file or set encoding? Already tried: ini_set('default_charset', 'ANSI'); ini_set('output_encoding', 'ANSI'); header('Content-Type: ...
EarthLing's user avatar
0 votes
1 answer
91 views

Why does Visual Studio add a byte order mark to new files, and can it cause a problem?

Having enabled eslint in my project, it's now reporting lots of warnings Unexpected Unicode BOM (Byte Order Mark) unicode-bom in my typescript and javascript files. Why does VS include BOMs in my ...
sbridewell's user avatar
-1 votes
1 answer
84 views

WriteFile(...) changes file encoding from UTF-16 LE to UTF-8

I have UTF-16 LE file. If I write the text to .txt file, it becomes UTF-8. Code: hFile = CreateFile(TEXT("D:\\clown.txt"), GENERIC_READ | GENERIC_WRITE, FILE_SHARE_READ, NULL, OPEN_ALWAYS, ...
kseno's user avatar
  • 1
1 vote
0 answers
144 views

How can I generate SBOM in sub-module and get an aggregated SBOM? Regression with makeAggregateBom since 2.7.4 - outputReactorProjects has no effect

I have a multi module maven project which I'd like to create an SBOM on each module and get an Aggregated BOM on the root-folder with cyclonedx-maven-plugin. When I execute the following command : mvn ...
bendwe's user avatar
  • 11
1 vote
1 answer
168 views

Getting UTF-8 JSON file instead of UTF-16 LE BOM using batch script curl

I have a batch script which does a curl command using: powershell -Command "curl.exe -k -S -X GET -H 'Version: 16.0' -H 'Accept: application/json' 'https://IntendedURL' > result.json". I ...
cyborg1234's user avatar
0 votes
0 answers
30 views

Is new Blob() cutting off BOM mark?

I have some API. That API returns file content with BOM mark. I want to put the received data into a new file and then let user to download it. That file has to contain BOM mark provided from API. I ...
Nikita Panormov's user avatar
0 votes
1 answer
285 views

Encoding.UTF8.GetString includes BOM in output string

Consider this code using var mem = new MemoryStream(); await using var writer = new StreamWriter(mem, Encoding.UTF8); await writer.WriteLineAsync("Test"); await writer.FlushAsync(); mem....
Anders's user avatar
  • 17.4k
0 votes
1 answer
106 views

Excel Formula Assigning Parent Part Number to a Child

I am looking for someone to help me out with a code that once worked but now doesn't and I can't figure out what went wrong. Here is a link to the work sheet: https://1drv.ms/x/s!...
Joshua Johnson's user avatar
1 vote
1 answer
300 views

Is there any way for git diff to diff files encoded in UTF-8 BOM properly?

I have a git repository in which all files are encoded in UTF8-BOM, this encoding causes nothing but problems but I have no choice on this matter. When I try to run git diff to check changes between ...
Frozen's user avatar
  • 23
0 votes
0 answers
377 views

cyclonedxBom gradle plugin is not analyzing my dependencies

My problem is the following... I'm trying to use the gradle plugin here https://github.com/CycloneDX/cyclonedx-gradle-plugin for generating a bom in the cyclonedx format. I will need it for pushing it ...
Morgan's user avatar
  • 1
1 vote
0 answers
17 views

UTF8NoBom in PowerShell [duplicate]

I need to generate a txt file in UTF8 without BOM. I started with: "Text" | Out-File .\File.txt which gives me UTF-16 LE encoding. I tried "Text" | Out-File .\File.txt -Encoding ...
Christopher Cass's user avatar
0 votes
0 answers
21 views

Should I use quote = "all" for readr::write_excel_csv

In the documentation* from readr::write_csv I see that quote is set to quote = c("needed", "all", "none") In the documentation* from readr::write_excel_csv I see that ...
user2165379's user avatar
0 votes
0 answers
63 views

BOM \ufeff at beginning of org-babel-tangled file

Recently, I have noticed that \ufeff (BOM for UTF-16) is getting prepended to files tangled using org-babel-tangle. Is my configuration wrong? If yes, which variable have I inadvertantly ...
Pradyparanjpe's user avatar
0 votes
0 answers
59 views

How to remove BOM from the reponse of apache web server?

My php code is here: $filename = '/tmp/tech.dat'; if (file_exists($filename)) { header('Content-Description: File Transfer'); header('Content-Type: application/octet-stream'); header('...
xscript09's user avatar
0 votes
0 answers
27 views

R Recursive Function and map() for Bill Data Structure

Using R tibbles, I have a df as shown below. It's a BOM data structure. df <- data.frame( product_id= c("P1", "P1", "P1", "P1", "P1", "...
LHA's user avatar
  • 39
0 votes
2 answers
822 views

Nodejs XML-Parsing: Non-whitespace before first tag

I want to parse XML-Data in Nodejs, but there always is the error: Non-whitespace before first tag. The reason for this error is, that the file I want to parse is UTF-8 encoded and it has a BOM. Here ...
Nechi's user avatar
  • 41
0 votes
3 answers
349 views

Maven property overriding conflict between parent/bom

I am currently facing an issue with my maven configuration. I was thinking it will work in a way where versions in MyBom will have higher priority on the grand-grand-parent defined versions. This is ...
Sébastien Heilig's user avatar
1 vote
1 answer
78 views

C# Encoding.CreateTranscodingStream does not output file with desired target encoding

I have the following piece of code: using (Stream inputFileStream = File.OpenRead("C:\\Users\\User\\Downloads\\test.txt")) { using (Stream transcodingStream = Encoding....
Vocaloidas's user avatar
0 votes
1 answer
97 views

Why does Systinternals du64.exe unexpectedly output in UTF-16LE with a BOM (noticed it parsing output in perl)?

On a fresh install of Windows 11, running Strawberry perl, I'm debugging a script that parses the output of du64 (disk usage). It worked on Win 10 with ActiveState perl. To debug, I first checked du, ...
kitchin's user avatar
  • 774
0 votes
1 answer
121 views

GLSL simple shader results in strange compilation errors

I have a very simple shader here: #version 460 layout (location = 0) in vec3 inPos; layout (location = 0) out vec3 outPos; void main() { gl_Position = vec4(inPos.x, inPos.y, inPos.z, 1.0); ...
Liyuu_'s user avatar
  • 51
0 votes
0 answers
83 views

UTF-8 same code for two different symbols in Javascript CSV export and Excel

I'm writing a table to CSV that will often include currency symbols. I'm using UTF-8 however whenever I open the file in Excel I get my pound signs displaying as ¬£ rather than just £. I've checked a ...
Richard Ross's user avatar
-2 votes
1 answer
20 views

How to write a iadx or text file with BOM in python

I want to use BOM with UTF-8. But it only saves files in UTF-8. What can I do ?I'm rather new, could you please write an answer as an addition to the sample code I shared directly? import os import ...
Hakan Özaydın's user avatar
0 votes
1 answer
416 views

BOMInputStream needs to be wrapped in another BOMInputStream to work

Pretty much what the title says. I'm writing code that needs to be able to work both with BOM'ed and non-BOM'ed files. Different parsing options need to be implemented, for now I'm implementing ...
TheMessik's user avatar
0 votes
1 answer
119 views

Why does my program print a UTF-8 BOM on Windows?

I have the following program that works fine on Linux: Cargo.toml [package] name = "ansi-color-codec" authors = ["Richard Neumann <ma[email protected]>"] description = &...
Richard Neumann's user avatar
0 votes
2 answers
438 views

JavaScript Login Form Problem Related to Remember me Button

I have made this login form from my basic HTML CSS and JavaScript knowledge. There is a Remember me button in this login form I have created and now I have to give it a functionality. I want to click ...
Abdullah Waseem's user avatar
0 votes
0 answers
40 views

How do I scan BOM In php file names while doing a directory search?

How do I scan Byte Order Marks In PHP file names while doing a directory search? I have about 220 php files with a BOM added to the beginning of the file name. %EF%BB%B They look like this: https://...
GuyTryingToSolveAnIssue's user avatar
-1 votes
1 answer
479 views

Ansible: 'dict object' has no attribute, when using read_csv from file (UTF-8 with BOM)

I am trying to create local users on remote systems using Ansible. The user list is read from a CSV formatted file using Ansible's read_csv. The CSV file is formatted in UTF-8 with Byte order mark (...
norinori's user avatar
0 votes
0 answers
178 views

RestAPI response is providing special characters within string

I'm using below powershell script to call a RestAPI: $Url = 'https://example.com' $Body = @{ "OperationType" = "new" "LongDescription" = "Test Description of ...
gaurav sharma's user avatar
0 votes
0 answers
31 views

Find when data is read from a DOM element with chrome devtools

I am debugging an issue where text contained in a textbox is later used as a query parameter in a request. However the text is being modified somewhere along the way (specifically byte order marks (...
sjsawyer's user avatar
0 votes
1 answer
112 views

Using gh api in powershell to get a file with a UTF-8 bom adds a corrupted version of the BOM to the begining of the file

If I execute the following commands from Powershell core 7.2.6 on windows 11 to grab an XML file with a UTF-8 BOM: gh api -H "Accept: application/vnd.github.raw+text" repos/zippy1981/...
Justin Dearing's user avatar
1 vote
1 answer
186 views

Can't encode csv file opened through paramiko as utf-8-sig to remove BOM using Python

I'm having issues reading a csv file that's opened through sftp using paramiko because the first field contains the BOM  at the beginning. From what I've read, encoding as utf-8-sig will fix this, ...
Roland Wang's user avatar
0 votes
1 answer
337 views

PowerShell, Cannot remove BOM from file

I have been trying dozens of different options for an hour, strip the BOM, set file to ascii / oem / utf8, followed the ideas here, but the BOM remains in all cases. I'm a bit stumped. Firstly, I ...
YorSubs's user avatar
  • 3,326
0 votes
0 answers
305 views

Python -  in front of an api response

The response the API is giving me looks like this: I am using FastAPI to send a post request to an API that returns an XML string: import requests from fastapi import APIRouter, Response router = ...
oliverbj's user avatar
  • 5,841
0 votes
0 answers
305 views

CATIA VBA InStr function having problems. How to solve it?

Im trying to generate an Excel BOM data base without using CATIA. For this porpouse I did an Excel subroutine that reads a CATPart file as a txt file. This way I can manage to get the parameters ...
Seba Sain's user avatar
3 votes
0 answers
114 views

How to disable BOM in RAD studio SOAP request (using WSDL importer) when compiling Multi-Device app for Android

I am using RAD Studio 11 to build Multi-Device Application in Delphi to act as SOAP Client against OpenEdge WEB Services and produce needed types and classes via WSDL Importer. Win32 and Win64 built ...
Dencho Karaivanov's user avatar
0 votes
1 answer
383 views

How to read a text file that has BOM and CRLF?

I have a bunch of text files that have the byte order mark (BOM) in them and also they have the CRLF (\r\n) endings to mark end of line. For example, here is the octal dump snippet: $ od -bc P21_T_3-...
codeforester's user avatar
  • 40.2k
1 vote
3 answers
2k views

While reading a CSV I get a question mark at the beginning

I'm trying to do a small school practice about Java Text I/O and while trying to read a CSV file with name prefixes (a Dutch thing) and surnames I got a question mark in the beginning. It's a small ...
Remzi Cavdar's user avatar
0 votes
1 answer
243 views

Log4j2 write to CSV for Excel without garbled characters

I am using Log4j2 to write a output.csv file with UTF-8 charset. After the output is complete, everything works well. But when I open the output.csv by Excel-2016, every Chinese characters become ...
Kai-Sheng Yang's user avatar
1 vote
1 answer
954 views

How to save txt file with UTF-16 LE BOM encoding in Python

I have files encoded with UTF16 LE BOM encoding and need to alter them and save. However I could not see such encoding option in https://docs.python.org/3.10/library/codecs.html#standard-encodings My ...
Mirek Hotový's user avatar
0 votes
0 answers
573 views

Microsoft.ACE.OLEDB text csv file UTF-8 with BOM - Read problem

I have an application in which the user can query data in a text file (e.g. .csv) with ad hoc SQL SELECT statements. Using ODBC drivers or OLEDB providers (including Microsoft.ACE.OLEDB.16.0) to read ...
Bruce from Seattle's user avatar
1 vote
0 answers
29 views

Decode UTF-16 LE with BOM from ByteArray in C# [duplicate]

I have to extract ID3v2 tags from an MP3 and read the specification. My C# code in general works fine, but I've got a little problem with the text encoding of the tags. For example, let's take the ...
Frank Kremer's user avatar
0 votes
1 answer
1k views

Create a CSV table from a JSON file with a BOM marker in a Logic App

I'm trying to create a CSV table which has emoji's in it and send it as an attachment via logic app. So far, my app creates the JSON with the emoji's in it fine, and it looks as though the input going ...
mickymikemichaelmikemike's user avatar
0 votes
1 answer
990 views

How to generate XML, UTF-8 with BOM using Python Element Tree?

For generating resource XML file for ASP.NET, the third-party tool requires BOM (when migrating to a new version of the tool). At the same time, it requires the XML prolog like <?xml version='1.0' ...
pepr's user avatar
  • 20.3k
1 vote
0 answers
60 views

UTF-8 byte order mark appears when using os.system() but not when printing

I have an issue where when I print a command that I want the python script to run, it prints in perfect syntax, however, when I try to use that exact same variable in order to run the command using os....
Stephen Remich's user avatar
2 votes
3 answers
329 views

Using fscanf, scanning a file into a struct in C, but the first argument is failing already

I have a file where I'm trying to read each line into a struct in C to further work with it. The file looks like this: Bread,212,2.7,36,6,9.8,0.01,0.01,10,500 Pasta,347,2.5,64,13,7,0.01,0.01,6,500 ...
mcklmo's user avatar
  • 79
1 vote
0 answers
42 views

Head tags rendering in the body and BOM detected

In my solution, I have the tags inserted in the head. When I run the application, these tags are rendered inside the body. I've also noticed that the browser detects BOM at the beginning of the body. ...
mapuleta's user avatar
-1 votes
1 answer
143 views

Powershell: how to create a link to a website

I have a litte problem. Right now I have the following code: $xmlFile = 'C:\Users\jonb\Desktop\bom.xml' [xml]$xml = Get-Content $xmlFile $xml.bom.components.component | ForEach-...
bobby17jones's user avatar

1
2 3 4 5
12