update robots.txt (#3940)

disallow crawlers from /assets/
they treat it as junk/bad content
This commit is contained in:
Royiex 2025-08-17 02:19:24 +02:00 committed by GitHub
parent 9db9de6683
commit a3a2fa7173
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -1,2 +1,3 @@
User-agent: *
Disallow: /assets/
Allow: /