[fpc-pascal] Effect of blocking AI crawlers in forums and wikis

[Nikolay Nikolov]

On 9/6/25 12:05 AM, Wayne Sherman via fpc-pascal wrote:
> Is it possible to make the forum and wiki data available on a mirror
> for the use of AI crawlers?
> (are search engine crawlers also blocked?)
Would you pay money for the hosting and for the maintenance of such a 
mirror?
> You asked ChatGPT5:
> "If websites with large Pascal forums and wikis block AI data
> harvesting bots, what will be the result for LLMs missing this
> training data and what will be the effect on these LLMs for Pascal
> related queries? Provide a simple concise answer with bullet points."

You should've asked:

"If websites with large Pascal forums and wikis get DDoS'd by AI data 
harvesting bots..."

The answer should be that, if they get DDoS'd, then nobody would be able 
to access them - neither AI bots, nor regular users. So, the outcome 
would be worse.

> ChatGPT said:

Please don't post ChatGPT generated responses as if they have any kind 
of authority. ChatGPT comes with a fine print: "ChatGPT can make 
mistakes." In this particular case, the company that trains ChatGPT has 
a clear conflict of interest. It is only normal that it exaggerates the 
effect of blocking AI harvesting bots.

Nikolay
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freepascal.org/pipermail/fpc-pascal/attachments/20250906/49a774ea/attachment.htm>