Love the description. Lemme take a look

We're gonna do an internal review later this morning. When we have some consensus we'll open it up to public discussion/PRs

Maybe try using an XML parser instead?

We use fast-xml-parser for processing XML as seen in the code just below the decodeEscapedXML function

The decodeEscapedXML function is a post-processor for tag values inside fast-xml-parser.

@trivikr is going to do a deeper dive here and come up with a fix

I'm able to reproduce issue with SQS message message hello\r\nworld

$ node -v
v14.16.1

    "@aws-sdk/client-sqs": "3.15.0",
    "md5": "2.3.0"

import { SQS } from "@aws-sdk/client-sqs";
import md5 from "md5";

const region = "us-west-2";
const client = new SQS({ region });

const QueueName = `test-${Date.now()}`;
const { QueueUrl } = await client.createQueue({ QueueName });

const MessageBody = `hello\r\nworld`;
console.log(MessageBody);
const { MD5OfMessageBody } = await client.sendMessage({
  MessageBody,
  QueueUrl,
});

console.log(
  `\nmd5 check for sent message: ${md5(MessageBody) === MD5OfMessageBody}`
);

const response = await client.receiveMessage({ QueueUrl });
console.log(
  `md5 check for received message: ${
    md5(MessageBody) === md5(response.Messages[0].Body)
  }`
);
console.log(
  `\nStrict Equality Comparison: ${MessageBody === response.Messages[0].Body}`
);

console.log(response.Messages[0].Body);

await client.deleteQueue({ QueueUrl });

$ node sqs.mjs
hello
world

md5 check for sent message: true
/Users/trivikr/workspace/test/node_modules/@aws-sdk/middleware-sdk-sqs/dist/cjs/receive-message.js:21
            throw new Error("Invalid MD5 checksum on messages: " + messageIds.join(", "));
                  ^

Error: Invalid MD5 checksum on messages: 6ddadd53-e4ce-44ea-abb8-a2e5ca1dcfe0
    at /Users/trivikr/workspace/test/node_modules/@aws-sdk/middleware-sdk-sqs/dist/cjs/receive-message.js:21:19
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at async /Users/trivikr/workspace/test/node_modules/@aws-sdk/middleware-logger/dist/cjs/loggerMiddleware.js:6:22
    at async file:///Users/trivikr/workspace/test/sqs.mjs:21:18

This issue is not reproducible with AWS SDK for JavaScript (v2), tested with v2.897.0.

This is an issue with upstream dependency fast-xml-parser which is being discussed at NaturalIntelligence/fast-xml-parser#342

While the fix is available, we'll provide a workaround in AWS SDK for JavaScript (v3).

The upstream fast-xml-parser used to have an option called decodeHTMLchar in the past.
It was removed in favor of tagValueProcessor in NaturalIntelligence/fast-xml-parser@5ac57a5

I don't believe NaturalIntelligence/fast-xml-parser#342 is an issue. Or at least, it's an intentional issue. fast-xml-parser docs show using he to decode entities as implemented in #2381.

(Personally, I think it's crazy it doesn't do that, but someone really wanted a FAST-xml-parser.)

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs and link to relevant comments in this thread.