I had noticed that some Unicode characters were not displayed (showing the "rhombus with question mark" instead), precissely those that have a 0x8D byte when encoded in UTF-8. Examples: the cyrillic e (), 0xD1 0x8D; the "thumbs up" emoji (), 0xF0 0x9F 0x91 0x8D.
I've found that this issue can be fixed by adding "-keepsoftcr" to the corresponding line in jamnntpd.xlat, just like with CP866:
================================
read UTF-8 utf-8 -keepsoftcr
================================
I had noticed that some Unicode characters were not displayed (showingthe "rhombus with question mark" instead), precissely those that have a 0x8D byte when encoded in UTF-8. Examples: the cyrillic e (�), 0xD1 0x8D; the "thumbs up" emoji (�), 0xF0 0x9F 0x91 0x8D.
�
I've found that this issue can be fixed by adding "-keepsoftcr" to thecorresponding line in jamnntpd.xlat, just like with CP866:
================================
read UTF-8 utf-8 -keepsoftcr
================================
Done. :)
>> ================================
>> read UTF-8 utf-8 -keepsoftcr
>> ================================
TK> Done. :)
Your message arrived here without the 0x8D chars... :-m
Maybe your tosser removed them?
Test from HPT. (👍)
TK> Test from HPT. (👍)
Looks fine now 😍 (U+1F60D, 0xF0 0x9F 0x98 0x8D)
Good! I had stripping soft-cr's on in GEcho, now off. Let's see
how this goes out. (👍)(👍)(👍)(👍)(👍)(👍)(👍)(👍)
On 5 Mar 2023 16.17, Carlos Navarro wrote:
Test from HPT. (👍)
Looks fine now 😍 (U+1F60D, 0xF0 0x9F 0x98 0x8D)
Good!
I had stripping soft-cr's on in GEcho, now off. Let's see how this goes out.
(👍)(👍)(👍)(👍)(👍)(👍)(👍)(👍)
Tommi wrote (2023-03-05):
On 5 Mar 2023 16.17, Carlos Navarro wrote:
Test from HPT. (👍)
Looks fine now 😍 (U+1F60D, 0xF0 0x9F 0x98 0x8D)
Good!Does it work?
I had stripping soft-cr's on in GEcho, now off. Let's see how this goes
out.
(👍)(👍)(👍)(👍)(👍)(👍)(👍)(👍)
Did I configure it correctly?
---
* Origin: This site requires JavaScript (2:280/464.47)
problem with jamnntpd is that it does not support multibyte,
You're right about JamNNTPd not supporting multibyte. It wraps lines at 79 bytes, not at 79 chars. Therefore those that have UTF-8 chars (2 or more bytes) become shorter when wrapped. The more UTF-8 chars a line has, the shorter.
This is noticeable in readers that don't support flowed text (most NNTP clients).
ASCII:
aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou
UTF-8:
áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú
áéíóú áéíóú
problem with jamnntpd is that it does not support multibyte,
You're right about JamNNTPd not supporting multibyte. It wraps lines at
79 bytes, not at 79 chars. Therefore those that have UTF-8 chars (2 or more bytes) become shorter when wrapped. The more UTF-8 chars a line
has, the shorter.
This is noticeable in readers that don't support flowed text (most NNTP clients).
ASCII:
aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou aeiou
UTF-8:
áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú áéíóú
You're right about JamNNTPd not supporting multibyte. It wraps lines
at 79 bytes, not at 79 chars. Therefore those that have UTF-8 chars
(2 or more bytes) become shorter when wrapped. The more UTF-8 chars a
line has, the shorter.
I've found that this issue can be fixed by adding "-keepsoftcr" to the
corresponding line in jamnntpd.xlat, just like with CP866:
================================
read UTF-8 utf-8 -keepsoftcr
================================
problem with jamnntpd is that it does not support multibyte, so only can change singlebyte in diffrent charsets
I had noticed that some Unicode characters were not displayed (showing the "rhombus with question mark" instead), precissely those that have
a 0x8D byte when encoded in UTF-8. Examples: the cyrillic e (), 0xD1 0x8D; the "thumbs up" emoji (Fl), 0xF0 0x9F 0x91 0x8D.
I've found that this issue can be fixed by adding "-keepsoftcr" to the corresponding line in jamnntpd.xlat, just like with CP866:
================================
read UTF-8 utf-8 -keepsoftcr
================================
Carlos
better is to setup thunderbird to NOT send utf-8 at all
08/02/2024 6:08, Benny Pedersen -> Carlos Navarro:
I don't understand what you mean. JamNNTPd seems to work fine with UTF-8, except for some issues with quotes.
On Tue, 20 Feb 2024 23:56:32 +0100, Carlos Navarro -> Benny Pedersen wrote:
08/02/2024 6:08, Benny Pedersen -> Carlos Navarro:
I don't understand what you mean. JamNNTPd seems to work fine
with UTF-8, except for some issues with quotes.
Bringing the thread from the Golded echo about Jamnntpd over here.
Here's a test to see if those characters are before level 2 and 3
quotes on this reply.
I've found that this issue can be fixed by adding
"-keepsoftcr" to the corresponding line in jamnntpd.xlat,
just like with CP866:
================================
read UTF-8 utf-8 -keepsoftcr
================================
problem with jamnntpd is that it does not support multibyte,
so only can change singlebyte in diffrent charsets
Bringing the thread from the Golded echo about Jamnntpd over here.
Here's a test to see if those characters are before level 2 and 3
quotes on this reply.
Quoted the whole thing in Golded. I don't see anything here. I also hex dumped the message before replying to it, and didn't see anything in
there either. *shrug*
Quoted the whole thing in Golded. I don't see anything here. I also hex dumped the message before replying to it, and didn't see anything in
there either. *shrug*
If you don't see the crap, it is probably because of
your conversion settings in Golded.
If you don't see the crap, it is probably because of
your conversion settings in Golded.
Or mine. I don't know. :)
I don't understand what you mean. JamNNTPd seems to work fine with
UTF-8, except for some issues with quotes.
Bringing the thread from the Golded echo about Jamnntpd over here. Here's a
test to see if those characters are before level 2 and 3 quotes on this reply.
I don't understand what you mean. JamNNTPd seems to work fine
with UTF-8, except for some issues with quotes.
Bringing the thread from the Golded echo about Jamnntpd over here.
Here's a test to see if those characters are before level 2 and 3
quotes on this reply.
Quoted the whole thing in Golded. I don't see anything here. I also hex dumped the message before replying to it, and didn't see anything in there either. *shrug*
On 23 Feb 2024, Tommi Koivula said the following...
If you don't see the crap, it is probably because of
your conversion settings in Golded.
Or mine. I don't know. :)
When viewing this message in Golded it had as empty tear line & the
origin line has a line break. When viewed in Mystic is has a bunch of UTF-8 characters:
https://postimg.cc/gallery/0khhW7t
When viewing this message in Golded it had as empty tear line & the origin line has a line break. When viewed in Mystic is has a bunch of UTF-8 characters:
https://postimg.cc/gallery/0khhW7t
They are in your message! And I see them:
0160 74 2C 0D 20 C2 A0 43 4E 3E 3E 3E 3E 20 6A 75 73
But I do see crap there. And as you may see, it is not only the quotes, also multiple spaces are converted to crap.
If you don't see the crap, it is probably because of your conversion settings in Golded.
How did my original reply to Carlos look on your end?
I think this is the message you're referring to: https://postimg.cc/gallery/kq34nZw
How did my original reply to Carlos look on your end?
I think this is the message you're referring to: https://postimg.cc/gallery/kq34nZw
They are in your message! And I see them:
0160 74 2C 0D 20 C2 A0 43 4E 3E 3E 3E 3E 20 6A 75 73
And yet they didn't show in your reply to me, like some of the other ones did. This or the last message you wrote, unless you removed them yourself.
I think this is the message you're referring to:
https://postimg.cc/gallery/kq34nZw
Yes, that's the one.. along with most of the others I wrote from Thunderbird. It seems Thunderbird adds non-breaking spaces (or   in html) anywhere there's two or more concurrent spaces next to each other.
I've completely disabled html in TB now, and am forcing plain-text. So we will see in the near future if there's still an issue.
^^
Still there...
^^
Still there...
^^
Still there...
... "Take my advice, I don't use it anyway."
--- Betterbird (Windows)
There is another thunderbird clone called Epyrus. This one allows
posting other charsets than utf-8.
http://www.epyrus.org/
^^
Still there...
Last attempt for the evening, I suppose. This one I changed the original message body to plain text before replying to it.
Frustrating, because I can't check it before the message is sent. It's something Thunderbird is doing after the message is saved.
^^
Still there...
Maybe? Maybe not?
There is another thunderbird clone called Epyrus. This one allows
posting other charsets than utf-8.
Seamonkey also allows posting other than utf-8.
However, the problem is not utf-8, I think it has proved that it is Thunderbird.
Check the .pkt file...
problem with jamnntpd is that it does not support multibyte,
You're right about JamNNTPd not supporting multibyte. It wraps lines
at 79 bytes, not at 79 chars. Therefore those that have UTF-8 chars
(2 or more bytes) become shorter when wrapped. The more UTF-8 chars a
line has, the shorter.
On 25.02.2024 13:25, Carlos Navarro wrote:
Actually by default Jamnntpd wraps to 72, not 79, but that is irrelevant. :) As you said, the problem with utf-8 text is that Jamnntpd counts bytes, not chars.problem with jamnntpd is that it does not support multibyte,You're right about JamNNTPd not supporting multibyte. It wraps lines
at 79 bytes, not at 79 chars. Therefore those that have UTF-8 chars
(2 or more bytes) become shorter when wrapped. The more UTF-8 chars a
line has, the shorter.
I've set "#define WRAP_WIDTH 972" now in this Jamnntpd. I can re-wrap quoted text with Ctrl-R in TB. Seems nice so far.
'Tommi
...0123456789 0123456789 0123456789 0123456789 0123456789 0123456789 0123456789 0123456789 0123456789 0123456789
'Tommi
Hello, Tommi Koivula.
On 01/03/2024 8.51 you wrote:
On 25.02.2024 13:25, Carlos Navarro wrote:
problem with jamnntpd is that it does not support multibyte,
You're right about JamNNTPd not supporting multibyte. It wraps lines
at 79 bytes, not at 79 chars. Therefore those that have UTF-8 chars
(2 or more bytes) become shorter when wrapped. The more UTF-8 chars a
line has, the shorter.
Actually by default Jamnntpd wraps to 72, not 79, but that isirrelevant. :) As you said, the problem with utf-8 text is that Jamnntpd counts bytes, not chars.
I've set "#define WRAP_WIDTH 972" now in this Jamnntpd. I canre-wrap quoted text with Ctrl-R in TB. Seems nice so far.
'Tommi0123456789 0123456789 0123456789 0123456789 0123456789
...0123456789 0123456789 0123456789 0123456789 0123456789
'Tommi
http://pics.rsh.ru/img/Screens5769_saapazgl.jpg
Looks ok now in Hotdoged.
Looks ok now in Hotdoged.
http://pics.rsh.ru/img/Screens5769_saapazgl.jpg
Looks ok now in Hotdoged.
Definitely doesn't look ok quoted back by hotdoged though. In TB or Golded. :)
From what I've gathered, WRAP_WIDTH is your quotes. LINE_WIDTH is what
you write.
You probably don't want to mess with stuff you've quoted, as that has to
be viewable in a 80 column terminal (BBSes, for example).
LINE_WIDTH may need to be adjusted to 72, instead of 79. So when quoting
79 characters it won't wrap the last 7 characters on to the next line.
But that's the problem of the author how the written text is formatted. Hotdoded is not the best tool for editing messages. :)
Now I'm testing WRAP_WIDTH = 72 as well as LINE_WIDTH = 72. But I have
a feeling my long tearline will wrap early now, which I can't see
until I post this message.
Regards,
Nick
... "Take my advice, I don't use it anyway."
--- Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:115.0) Gecko/20100101 Thunderb
* Origin: _thePharcyde distribution system (Wisconsin) (1:154/10)
Now I'm testing WRAP_WIDTH = 72 as well as LINE_WIDTH = 72. But I have a feeling my long tearline will wrap early now, which I can't see until I post this message.
Hello Nicholas Boel!
23 Feb 24 07:05:22, Tommi Koivula wrote to Nicholas Boel:
If you don't see the crap, it is probably because of
your conversion settings in Golded.
Or mine. I don't know. :)
'Tommi
-+-
+ Origin: (2:221/1)
Sysop: | Fercho |
---|---|
Lugar: | La Plata, Buenos Aires |
Usuarios: | 32 |
Nodos: | 10 (0 / 10) |
Uptime: | 63:14:14 |
Llamadas: | 123 |
Archivoss: | 15,607 |
Mensajes: | 35,510 |
Novedades:
Servidor de Quake 3 Arena Online! - Conectate a ferchobbs.ddns.net, puerto 27960 y vence con tu equipo!