[fpc-devel] Unicode resource strings
nc-gaertnma at netcologne.de
Tue Aug 21 12:05:31 CEST 2012
On Tue, 21 Aug 2012 14:19:44 +0500
Ivanko B <ivankob4mse2 at gmail.com> wrote:
> I have implemented multiple text edit/display widgets that do plenty
> of string manipulation... all based on the UTF-8 encoding. I have
> suffered NO speed penalties.
> Sure no problems for GUI. But how about processing large texts ?
Especially on large texts UTF-8 can be better, because it needs less
memory and fetching memory pages is expensive.
I ported the widestring XML units of FPC to UTF-8
because I had to handle thousands of xml files with about 400
MB. Because these documents are in UTF-8 parsing is about 2-3
times faster on these documents, searching is about 20 to 50% faster,
which is pretty much the saved memory pages.
The UTF-8 overhead is not measurable.
Another example are the codetools.
More information about the fpc-devel