[fpc-devel] Unicode resource strings

[Mattias Gaertner]

On Tue, 21 Aug 2012 14:19:44 +0500
Ivanko B <ivankob4mse2 at gmail.com> wrote:

> I have implemented multiple text edit/display widgets that do plenty
>  of string manipulation... all based on the UTF-8 encoding. I have
>  suffered NO speed penalties.
> ================
> Sure no problems for GUI. But how about processing large texts ?

Especially on large texts UTF-8 can be better, because it needs less
memory and fetching memory pages is expensive. 
I ported the widestring XML units of FPC to UTF-8
because I had to handle thousands of xml files with about 400
MB. Because these documents are in UTF-8 parsing is about 2-3
times faster on these documents, searching is about 20 to 50% faster,
which is pretty much the saved memory pages.
The UTF-8 overhead is not measurable.

Another example are the codetools.

Mattias