1. Forum
  2. FidoNet
  3. UTF-8

  • slightly edited

    From Chris Jacobs to All on Friday, March 24, 2023 01:42:00
    ========================================================================
    I deleted an ö
    Then I added the ö again.

    System: Vertrauen
    Area: FidoNet UTF-8
    Date: 03-24-23 00:14
    From: Michiel van der Vlist
    To: All
    Subj: UTF-8 nodelist report ------------------------------------------------------------------------

    chkwf8 2.0.1 W32 UTF-8 well formed sequence test.
    © 2015-2017, Michiel van der Vlist, PA0MMV (2:280/5555)

    File: dailyutf.083

    ,208,-=P=I=X=-,S?ve,Björn_Felten,46-31-960447,9600,CM,XA,V34
    ^
    1568 lines read.
    1553 lines found with ASCII only.
    14 lines found with well formed UTF-8 sequences.
    1 line found with an ill formed UTF-8 sequence.
    0 lines found with a BOM.

    ... Αναπληρωτής Επίτροπος Αστυνομίας
    --- Deputy Nodelist Police Commissioner
    * Origin: Главный заместитель комиссара полиции нодлиста (2:280/5555)


    ... MultiMail, the new multi-platform, multi-format offline reader!
    --- MultiMail/Win v0.52
  • From Michiel van der Vlist@2:280/5555 to Chris Jacobs on Friday, March 24, 2023 17:30:54
    Hello Chris,

    On Friday March 24 2023 01:42, you wrote to All:

    I deleted an ö Then I added the ö again.

    The program that checks for ill formed UTF-8 sequences is triggered by the first error in a line. The first character in error is replaced by a question mark for the report. Any following errors in the same line are ingnored and "passed as is" to the report.

    The line in question is encoded in LATIN-1 and contains two non ASCII characters. The first is represented by a '?'. How the second is displayed on your screen depends on how your reader is configured. Some will display it as garbage and others may be "smart" enough to interpret it as encoded in LATIN-1 and display it accordingly.


    Cheers, Michiel

    --- GoldED+/W32-MSVC 1.1.5-b20170303
    * Origin: Nieuw Schnøørd (2:280/5555)