Google To Work On Complementary Robots.txt Protocols
Google announced last night that it is looking to develop a complementary protocol to the 30-year-old robots.txt protocol. This is because of all the new generative AI technologies Google and other companies are releasing. This announcement comes shortly after the news around Open AI accessing paywalled content for its ChatGPT service. But I know many…