Post by: newshunter on August 09, 2023, 01:00:35 AM
ChatGPT users have the option to scrap the web crawler by adding a “disallow” command to a standard file on the server.
Source: OpenAI launches web crawler 'GPTBot' amid plans for next model: GPT-5 (https://cointelegraph.com/news/open-ai-launch-gptbot-web-crawler-amid-gpt5-trademark)
Would appreciate your opinion about this