[fpc-pascal] FPC websites blocked

[Guillermo Martínez Jiménez]

IIRC somebody suggested to block all LLM crawlers to prevent DDOS-like
problems.

BTW I use Startpage for web searching and it seems to have access to
all Free Pascal documents, wiki and forums and DuckDuckGo seems to have
litle problems too so I don't see the problem.  Just stop using ChatGPT
to do your work (you shouldn't use it to do your work anyway, I'm
pretty sure you can do it way better than any LLM out there).

Regards,
Guillermo "Ñuño" Martínez.

El Thu, 16 Apr 2026 08:34:41 -0700
Wayne Sherman via fpc-pascal <fpc-pascal at lists.freepascal.org> escribió:
> I was doing some research via ChatGPT and asked the following:
> 
> "In relation to the conversation above, what is described here?:
> https://wiki.freepascal.org/Release_engineering"
> 
> The response was not worth reading because ChatGPT could not access
> the page.  Note this part of the response:
> 
> "One limitation: the wiki page itself was blocked by the site’s access
> protection in this browsing session, so I could not read the full body
> directly. My description is based on the search snippet, category
> links, talk page, and related references."
> 
> The FPC wiki website is also blocked from archive.org.  Note the
> latest capture for this page:
> https://web.archive.org/web/20250909050155/https://wiki.freepascal.org/Release_engineering
> 
> Are these pages also blocked from Google search and other search
> engines?  I am unable to check that but someone with write access to
> the web server can check and monitor the status of Google's web
> crawler indexes.  See here:
> https://support.google.com/webmasters/answer/9012289?hl=en
> 
> Question:
> "What will the long term consequences be of blocking any of the Free
> Pascal (fpc) websites (i.e. the main website, the forum, and the wiki)
> from AI / LLM tools, archive.org, and web search engines? How will
> users and potential new users of Free Pascal be affected? Summarize in
> one paragraph."
> 
> Response:
> https://chatgpt.com/share/69e10026-f080-83e8-99bb-c48001698c87
> _______________________________________________
> fpc-pascal maillist  -  fpc-pascal at lists.freepascal.org
> https://lists.freepascal.org/cgi-bin/mailman/listinfo/fpc-pascal